Sep 15 11:23:09.192807 ip-10-0-139-116 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 15 11:23:09.192818 ip-10-0-139-116 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 15 11:23:09.192827 ip-10-0-139-116 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 15 11:23:09.193027 ip-10-0-139-116 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 15 11:23:19.442484 ip-10-0-139-116 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 15 11:23:19.442500 ip-10-0-139-116 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e94e744a771a43158a026da0d0324de7 --
Sep 15 11:24:56.257819 ip-10-0-139-116 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 11:24:56.662087 ip-10-0-139-116 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:24:56.662087 ip-10-0-139-116 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 11:24:56.662087 ip-10-0-139-116 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:24:56.662087 ip-10-0-139-116 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 11:24:56.662087 ip-10-0-139-116 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:24:56.663197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.663113    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 11:24:56.667155 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667139    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:24:56.667155 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667154    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667159    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667164    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667167    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667170    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667173    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667176    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667179    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667181    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667185    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667189    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667192    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667196    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667200    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667208    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667211    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667214    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667217    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:24:56.667220 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667220    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667223    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667226    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667229    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667232    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667235    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667238    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667240    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667243    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667246    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667253    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667256    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667259    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667261    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667264    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667266    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667269    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667271    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667273    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667276    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:24:56.667655 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667279    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667281    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667283    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667286    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667289    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667291    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667293    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667296    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667298    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667300    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667303    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667305    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667307    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667310    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667314    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667316    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667319    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667321    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667324    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667326    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:24:56.668126 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667328    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667331    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667333    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667336    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667338    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667341    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667343    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667345    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667349    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667351    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667353    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667356    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667359    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667361    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667364    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667366    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667368    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667371    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667373    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667376    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:24:56.668616 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667378    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667380    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667383    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667385    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667388    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667390    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667393    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667396    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667398    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667401    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667404    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667406    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667409    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667411    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667414    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667416    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667418    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667421    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667423    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.667425    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:24:56.669114 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668129    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668135    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668138    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668140    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668143    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668146    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668149    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668151    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668154    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668157    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668159    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668162    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668164    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668167    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668170    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668173    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668175    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668178    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668180    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668183    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:24:56.669607 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668186    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668188    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668191    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668194    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668197    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668199    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668202    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668205    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668207    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668210    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668214    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668218    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668221    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668223    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668226    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668229    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668232    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668235    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668240    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:24:56.670095 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668243    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668247    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668250    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668253    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668256    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668258    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668261    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668264    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668266    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668268    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668271    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668274    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668277    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668280    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668282    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668285    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668287    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668290    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668292    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:24:56.670553 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668295    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668297    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668299    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668302    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668304    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668307    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668309    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668311    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668314    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668316    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668319    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668322    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668324    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668327    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668329    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668332    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668334    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668336    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668339    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668341    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:24:56.671018 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668344    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668347    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668349    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668352    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668356    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668359    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668361    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668364    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668367    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668370    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668373    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668376    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668378    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668381    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668383    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668386    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668388    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668390    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668393    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668395    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:24:56.671608 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668398    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668774    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668779    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668782    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668785    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668788    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668791    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668794    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668796    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668799    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668802    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668804    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668806    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668809    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668812    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668814    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668817    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668820    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668823    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668826    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:24:56.672089 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668828    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668831    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668834    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668837    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668839    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668842    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668844    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668847    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668849    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668852    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668854    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668857    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668860    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668863    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668865    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668867    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668870    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668872    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668875    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668878    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:24:56.672581 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668880    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668883    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668885    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668888    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668891    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668893    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668896    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668898    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668901    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668904    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668906    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668909    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668911    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668914    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668916    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668919    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668921    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668924    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668926    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:24:56.673054 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668928    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668931    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668933    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668935    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668938    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668940    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668943    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668945    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668948    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668950    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668953    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668955    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668958    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668960    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668963    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668965    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668968    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668970    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668973    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668975    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:24:56.673508 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668979    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668981    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668984    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668986    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668989    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668991    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668994    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.668998    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669001    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669004    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669008    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669011    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669014    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669017    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669020    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669023    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669025    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669029    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669032    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:24:56.674034 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669038    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669041    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669110    2570 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669143    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669150    2570 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669154    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669159    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669162    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669166    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669171    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669174    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669177    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669181    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669184    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669187    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669190    2570 flags.go:64] FLAG: --cgroup-root=""
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669193    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669197    2570 flags.go:64] FLAG: --client-ca-file=""
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669200    2570 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669202    2570 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669206    2570 flags.go:64] FLAG: --cluster-domain=""
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669209    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669212    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669215    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 11:24:56.674477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669219    2570 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669222    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669225    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669228    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669232    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669235    2570 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669237    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669240    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669245    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669252    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669256    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669258    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669261    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669264    2570 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669267    2570 flags.go:64] FLAG: --enable-server="true"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669271    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669275    2570 flags.go:64] FLAG: --event-burst="100"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669278    2570 flags.go:64] FLAG: --event-qps="50"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669281    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669284    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669287    2570 flags.go:64] FLAG: --eviction-hard=""
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669291    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669294    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669297    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669300    2570 flags.go:64] FLAG: --eviction-soft=""
Sep 15 11:24:56.675047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669315    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669319    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669322    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669326    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669329    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669332    2570 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669335    2570 flags.go:64] FLAG: --feature-gates=""
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669338    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669341    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669344    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669348    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669350    2570 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669353    2570 flags.go:64] FLAG: --help="false"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669356    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-139-116.ec2.internal"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669359    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669364    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669367    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669371    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669374    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669377    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669385    2570 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669389    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669392    2570 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 11:24:56.675669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669395    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669399    2570 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669402    2570 flags.go:64] FLAG: --kube-reserved=""
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669405    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669408    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669410    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669413    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669416    2570 flags.go:64] FLAG: --lock-file=""
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669419    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669422    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669425    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669430    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669432    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669435    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669438    2570 flags.go:64] FLAG: --logging-format="text"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669441    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669444    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669447    2570 flags.go:64] FLAG: --manifest-url=""
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669450    2570 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669458    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669461    2570 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669465    2570 flags.go:64] FLAG: --max-pods="110"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669467    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669470    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669475    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 11:24:56.676232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669478    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669481    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669484    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669487    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669494    2570 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669497    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669500    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669503    2570 flags.go:64] FLAG: --pod-cidr=""
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669506    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669511    2570 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669514    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669517    2570 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669520    2570 flags.go:64] FLAG: --port="10250"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669537    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669540    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08e3927e00ad29be9"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669543    2570 flags.go:64] FLAG: --qos-reserved=""
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669546    2570 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669549    2570 flags.go:64] FLAG: --register-node="true"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669552    2570 flags.go:64] FLAG: --register-with-taints=""
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669556    2570 flags.go:64] FLAG: --registry-burst="10"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669559    2570 flags.go:64] FLAG: --registry-qps="5"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669562    2570 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669564    2570 flags.go:64] FLAG: --reserved-memory=""
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669568    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669571    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 11:24:56.676875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669574    2570 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669577    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669580    2570 flags.go:64] FLAG: --runonce="false"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669582    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669586    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669589    2570 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669592    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669597    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669600    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669603    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669605    2570 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669609    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669613    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669617    2570 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669619    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669623    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669626    2570 flags.go:64] FLAG: --system-cgroups=""
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669629    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669634    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669637    2570 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669640    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669644    2570 flags.go:64] FLAG: --tls-min-version=""
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669646    2570 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669649    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669652    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 11:24:56.677505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669655    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669658    2570 flags.go:64] FLAG: --v="2"
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669661    2570 flags.go:64] FLAG: --version="false"
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669665    2570 flags.go:64] FLAG: --vmodule=""
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669669    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.669672    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669781    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669785    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669789    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669792    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669795    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669797    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669800    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669802    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669806    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669809    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669811    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669814    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669816    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669820    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669823    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:24:56.678124 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669825    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669828    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669830    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669834    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669836    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669839    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669842    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669844    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669847    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669849    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669852    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669854    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669857    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669859    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669862    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669864    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669867    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669869    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669871    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669874    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:24:56.678627 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669876    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669879    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669881    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669884    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669886    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669890    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669893    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669896    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669898    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669908    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669913    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669916    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669919    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669922    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669925    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669928    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669931    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669934    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669936    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669939    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:24:56.679104 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669941    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669945    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669947    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669950    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669952    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669955    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669958    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669961    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669963    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669965    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669968    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669970    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669974    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669977    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669980    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669983    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669986    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669991    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669993    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:24:56.679600 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669996    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.669998    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670001    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670005    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670008    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670011    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670015    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670018    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670021    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670023    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670026    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670029    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670032    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670034    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670037    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670039    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670042    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670044    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670047    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:24:56.680046 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670049    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670052    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670054    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670057    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670059    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.670062    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.670760    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.678159    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.678174    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.678192    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.678198    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678251    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678256    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678260    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678262    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:24:56.680534 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678265    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678269    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678272    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678276    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678279    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678281    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678284    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678286    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678290    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678293    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678295    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678297    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678300    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678303    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678306    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678308    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678311    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678314    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678317    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678319    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:24:56.680896 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678322    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678325    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678328    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678330    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678333    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678336    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678339    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678342    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678344    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678348    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678352    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678355    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678358    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678362    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678364    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678367    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678369    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678372    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678375    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:24:56.681374 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678377    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678381    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678385    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678388    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678391    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678394    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678396    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678399    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678402    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678404    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678407    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678409    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678412    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678415    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678417    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678420    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678422    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678424    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678428    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:24:56.681918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678430    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678433    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678435    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678438    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678440    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678444    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678448    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678450    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678453    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678456    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678458    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678461    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678463    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678466    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678469    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678471    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678474    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678476    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678479    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678481    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:24:56.682373 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678484    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678487    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678489    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678492    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678494    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678497    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678499    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678502    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678504    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678507    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678509    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678512    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678515    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678517    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678520    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678522    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:24:56.682853 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678537    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.678542    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678644    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678649    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678652    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678656    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678660    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678663    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678666    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678669    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678672    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678674    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678677    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678680    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678683    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:24:56.683221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678686    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678688    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678691    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678694    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678697    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678699    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678702    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678704    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678707    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678709    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678711    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678714    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678717    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678720    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678722    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678725    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678727    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678730    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678732    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678735    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:24:56.683593 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678739    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678741    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678744    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678747    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678750    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678753    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678756    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678758    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678761    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678763    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678766    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678769    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678771    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678774    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678776    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678779    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678781    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678783    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678786    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:24:56.684063 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678788    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678791    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678793    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678796    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678798    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678801    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678804    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678807    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678809    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678811    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678814    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678816    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678819    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678821    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678824    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678826    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678828    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678831    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678833    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678836    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:24:56.684515 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678838    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678840    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678843    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678845    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678848    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678851    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678853    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678856    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678858    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678860    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678863    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678866    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678868    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678870    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678873    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678875    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678878    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678881    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678883    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678885    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:24:56.684985 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678888    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:24:56.685460 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678890    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:24:56.685460 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678893    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:24:56.685460 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678895    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:24:56.685460 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678897    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:24:56.685460 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678900    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:24:56.685460 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:56.678903    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:24:56.685460 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.678907    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:24:56.685460 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.679006    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 11:24:56.685460 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.684912    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 11:24:56.686023 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.686011    2570 server.go:1019] "Starting client certificate rotation"
Sep 15 11:24:56.686125 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.686108    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:24:56.686159 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.686150    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:24:56.689562 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.689550    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:24:56.690662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.690645    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:24:56.701258 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.701240    2570 log.go:25] "Validated CRI v1 runtime API"
Sep 15 11:24:56.704585 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.704571    2570 log.go:25] "Validated CRI v1 image API"
Sep 15 11:24:56.705418 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.705404    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 11:24:56.709843 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.709821    2570 fs.go:135] Filesystem UUIDs: map[0fc4db99-9eae-44f2-a42b-4e6acdb85cc0:/dev/nvme0n1p4 4faa57dd-8726-46a9-882b-07077c6dcfd6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 15 11:24:56.709898 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.709843    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 11:24:56.715472 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.715328    2570 manager.go:216] Machine: {Timestamp:2026-09-15 11:24:56.713997482 +0000 UTC m=+0.369276366 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3202568 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cd42c7519f9ef1da254ee5a39847a SystemUUID:ec2cd42c-7519-f9ef-1da2-54ee5a39847a BootID:e94e744a-771a-4315-8a02-6da0d0324de7 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:db:06:a7:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:db:06:a7:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:9f:6d:eb:b9:8f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 11:24:56.715472 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.715465    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 11:24:56.715648 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.715564    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 11:24:56.717179 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.717164    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:24:56.718980 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.718953    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 11:24:56.719127 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.718983    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 11:24:56.720556 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.720543    2570 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 11:24:56.720589 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.720559    2570 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 11:24:56.720589 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.720567    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:24:56.721397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.721387    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:24:56.722632 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.722622    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 11:24:56.727416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.727405    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:24:56.727520 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.727511    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 11:24:56.727591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.727563    2570 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 11:24:56.727591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.727573    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 11:24:56.727591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.727586    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 11:24:56.727696 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.727595    2570 kubelet.go:398] "Adding apiserver pod source"
Sep 15 11:24:56.727696 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.727603    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 11:24:56.727955 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.727944    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:24:56.728015 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.727961    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:24:56.730351 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.730334    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 11:24:56.732738 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.732722    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 11:24:56.732783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.732754    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 11:24:56.735601 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735589    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 11:24:56.735666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735608    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 11:24:56.735666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735615    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 11:24:56.735666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735621    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 11:24:56.735666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735629    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 11:24:56.735666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735634    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 11:24:56.735666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735646    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 11:24:56.735666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735652    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 11:24:56.735666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735658    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 11:24:56.735666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735663    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 11:24:56.735886 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735671    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 11:24:56.735886 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.735688    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 11:24:56.736609 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.736588    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 11:24:56.736609 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.736604    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 11:24:56.736731 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.736671    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 11:24:56.736731 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.736698    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 11:24:56.740425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.740412    2570 server.go:1268] "Started kubelet"
Sep 15 11:24:56.740557 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.740492    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 11:24:56.740621 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.740581    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 11:24:56.740621 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.740540    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 11:24:56.741273 ip-10-0-139-116 systemd[1]: Started Kubernetes Kubelet.
Sep 15 11:24:56.741720 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.741696    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 11:24:56.745596 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.745578    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 11:24:56.746864 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.746846    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 11:24:56.748897 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.748883    2570 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 11:24:56.752077 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.750930    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-116.ec2.internal.18d57ad862e5b873  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-116.ec2.internal,UID:ip-10-0-139-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-116.ec2.internal,},FirstTimestamp:2026-09-15 11:24:56.740386931 +0000 UTC m=+0.395665815,LastTimestamp:2026-09-15 11:24:56.740386931 +0000 UTC m=+0.395665815,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-116.ec2.internal,}"
Sep 15 11:24:56.752233 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.752210    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 11:24:56.752950 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.752935    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 11:24:56.753126 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.753084    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:56.753698 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.753681    2570 factory.go:55] Registering systemd factory
Sep 15 11:24:56.753762 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.753701    2570 factory.go:223] Registration of the systemd container factory successfully
Sep 15 11:24:56.753811 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.753771    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 11:24:56.753811 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.753772    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 11:24:56.753811 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.753798    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 11:24:56.753949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.753893    2570 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 11:24:56.753949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.753911    2570 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 11:24:56.753949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.753895    2570 factory.go:153] Registering CRI-O factory
Sep 15 11:24:56.753949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.753933    2570 factory.go:223] Registration of the crio container factory successfully
Sep 15 11:24:56.754103 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.753978    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 11:24:56.754103 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.753999    2570 factory.go:103] Registering Raw factory
Sep 15 11:24:56.754103 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.754013    2570 manager.go:1196] Started watching for new ooms in manager
Sep 15 11:24:56.754350 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.754337    2570 manager.go:349] Starting recovery of all containers
Sep 15 11:24:56.757633 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.757606    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 11:24:56.757736 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.757714    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 11:24:56.763181 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.763159    2570 manager.go:354] Recovery completed
Sep 15 11:24:56.764130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.764106    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9wg9p"
Sep 15 11:24:56.767326 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.767310    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:24:56.770084 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.769941    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9wg9p"
Sep 15 11:24:56.770084 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.769995    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:24:56.770084 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.770034    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:24:56.770629 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.770609    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:24:56.771207 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.771189    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 11:24:56.771207 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.771203    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 11:24:56.771207 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.771208    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:24:56.771362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.771216    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:24:56.771752 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.771680    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-116.ec2.internal.18d57ad864a9bd06  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-116.ec2.internal,UID:ip-10-0-139-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-116.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-116.ec2.internal,},FirstTimestamp:2026-09-15 11:24:56.770010374 +0000 UTC m=+0.425289260,LastTimestamp:2026-09-15 11:24:56.770010374 +0000 UTC m=+0.425289260,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-116.ec2.internal,}"
Sep 15 11:24:56.771974 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.771955    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:24:56.772049 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.771982    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:24:56.772049 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.771992    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:24:56.773420 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.773407    2570 policy_none.go:49] "None policy: Start"
Sep 15 11:24:56.773467 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.773425    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 11:24:56.773467 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.773435    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 11:24:56.775776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.775761    2570 policy_none.go:47] "Start"
Sep 15 11:24:56.801119 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.801103    2570 manager.go:337] "Starting Device Plugin manager"
Sep 15 11:24:56.801200 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.801144    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 11:24:56.801200 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.801155    2570 server.go:87] "Starting device plugin registration server"
Sep 15 11:24:56.801472 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.801460    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 11:24:56.801554 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.801474    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 11:24:56.801648 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.801632    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 11:24:56.801730 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.801700    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 11:24:56.801730 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.801707    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 11:24:56.802152 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.802132    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 11:24:56.802226 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.802185    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:56.873302 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.873265    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 11:24:56.875485 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.874420    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 11:24:56.875485 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.874461    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 11:24:56.875485 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.874482    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 11:24:56.875485 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.874518    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 11:24:56.876703 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.876686    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:24:56.901715 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.901698    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:24:56.902552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.902538    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:24:56.902609 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.902567    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:24:56.902609 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.902578    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:24:56.902609 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.902598    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-116.ec2.internal"
Sep 15 11:24:56.908519 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.908506    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-116.ec2.internal"
Sep 15 11:24:56.908573 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.908535    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-116.ec2.internal\": node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:56.933100 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.933024    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:56.974819 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.974795    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-116.ec2.internal"]
Sep 15 11:24:56.974913 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.974851    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:24:56.976490 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.976475    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:24:56.976583 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.976498    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:24:56.976583 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.976509    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:24:56.978846 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.978834    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:24:56.978960 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.978944    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:56.979006 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.978986    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:24:56.979554 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.979521    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:24:56.979625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.979569    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:24:56.979625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.979580    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:24:56.979625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.979521    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:24:56.979753 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.979652    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:24:56.979753 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.979679    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:24:56.981797 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.981781    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:56.981881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.981814    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:24:56.982479 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.982465    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:24:56.982562 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.982488    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:24:56.982562 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:56.982500    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:24:56.999034 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:56.999015    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-116.ec2.internal\" not found" node="ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.002560 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:57.002519    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-116.ec2.internal\" not found" node="ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.033391 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:57.033374    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:57.055386 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:57.055368    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3debddb7c159d01ebc9dc0c64b49a027-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal\" (UID: \"3debddb7c159d01ebc9dc0c64b49a027\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.055460 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:57.055391    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3debddb7c159d01ebc9dc0c64b49a027-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal\" (UID: \"3debddb7c159d01ebc9dc0c64b49a027\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.055460 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:57.055409    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06f232f311e4bd0ea0f4417f4173efba-config\") pod \"kube-apiserver-proxy-ip-10-0-139-116.ec2.internal\" (UID: \"06f232f311e4bd0ea0f4417f4173efba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.134451 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:57.134431    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:57.155787 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:57.155761    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3debddb7c159d01ebc9dc0c64b49a027-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal\" (UID: \"3debddb7c159d01ebc9dc0c64b49a027\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.155787 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:57.155791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3debddb7c159d01ebc9dc0c64b49a027-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal\" (UID: \"3debddb7c159d01ebc9dc0c64b49a027\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.155912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:57.155806    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06f232f311e4bd0ea0f4417f4173efba-config\") pod \"kube-apiserver-proxy-ip-10-0-139-116.ec2.internal\" (UID: \"06f232f311e4bd0ea0f4417f4173efba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.155912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:57.155869    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06f232f311e4bd0ea0f4417f4173efba-config\") pod \"kube-apiserver-proxy-ip-10-0-139-116.ec2.internal\" (UID: \"06f232f311e4bd0ea0f4417f4173efba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.155912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:57.155874    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3debddb7c159d01ebc9dc0c64b49a027-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal\" (UID: \"3debddb7c159d01ebc9dc0c64b49a027\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.155912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:57.155888    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3debddb7c159d01ebc9dc0c64b49a027-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal\" (UID: \"3debddb7c159d01ebc9dc0c64b49a027\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.235226 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:57.235170    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:57.300663 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:57.300630    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.305467 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:57.305383    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:57.335962 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:57.335937    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:59.335492 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:59.335468    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:59.436046 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:59.435990    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:59.536493 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:59.536462    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:59.585005 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.584983    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 11:24:59.585401 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.585105    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 11:24:59.637437 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:59.637416    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:59.675093 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.675062    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 11:19:58 +0000 UTC" deadline="2028-02-18 17:57:22.877160802 +0000 UTC"
Sep 15 11:24:59.675093 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.675089    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12510h32m23.202074955s"
Sep 15 11:24:59.680032 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.680014    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:24:59.737966 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:59.737915    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:59.810243 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:59.810214    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f232f311e4bd0ea0f4417f4173efba.slice/crio-3ed37e7e4b1fede3150b0882cf770ba9f2d157ceb93570ac5804b2c2e4e4e3cb WatchSource:0}: Error finding container 3ed37e7e4b1fede3150b0882cf770ba9f2d157ceb93570ac5804b2c2e4e4e3cb: Status 404 returned error can't find the container with id 3ed37e7e4b1fede3150b0882cf770ba9f2d157ceb93570ac5804b2c2e4e4e3cb
Sep 15 11:24:59.810735 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:24:59.810720    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3debddb7c159d01ebc9dc0c64b49a027.slice/crio-fa252cce49f08033a3628e7236e0cb5e7f1579c1c6d5bd422729a0aca4d919b0 WatchSource:0}: Error finding container fa252cce49f08033a3628e7236e0cb5e7f1579c1c6d5bd422729a0aca4d919b0: Status 404 returned error can't find the container with id fa252cce49f08033a3628e7236e0cb5e7f1579c1c6d5bd422729a0aca4d919b0
Sep 15 11:24:59.814723 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.814706    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:24:59.838443 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:24:59.838420    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-116.ec2.internal\" not found"
Sep 15 11:24:59.871272 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.871256    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:24:59.874399 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.874384    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:24:59.952486 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.952462    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:59.960856 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.960837    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:24:59.961596 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.961583    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal"
Sep 15 11:24:59.974862 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:24:59.974839    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:25:00.551222 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.551195    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:00.627668 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.627631    2570 apiserver.go:52] "Watching apiserver"
Sep 15 11:25:00.635195 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.635166    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 11:25:00.636068 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.636036    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds","openshift-cluster-node-tuning-operator/tuned-hp82r","openshift-image-registry/node-ca-889s2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal","openshift-network-diagnostics/network-check-target-clnqp","openshift-network-operator/iptables-alerter-274hv","openshift-ovn-kubernetes/ovnkube-node-psfsv","kube-system/global-pull-secret-syncer-2gnj8","kube-system/konnectivity-agent-2wfh5","kube-system/kube-apiserver-proxy-ip-10-0-139-116.ec2.internal","openshift-dns/node-resolver-8gtj9","openshift-multus/multus-additional-cni-plugins-xmwfg","openshift-multus/multus-vjfkp","openshift-multus/network-metrics-daemon-7dh7b"]
Sep 15 11:25:00.639203 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.639175    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8gtj9"
Sep 15 11:25:00.641273 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.641251    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.641768 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.641749    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 11:25:00.641883 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.641791    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qgddh\""
Sep 15 11:25:00.641883 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.641846    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 11:25:00.643345 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.643321    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:25:00.643776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.643757    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x4ftj\""
Sep 15 11:25:00.643930 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.643913    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:00.644013 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:00.643989    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:00.644013 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.643757    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 11:25:00.646736 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.646524    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.649889 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.649162    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:00.649889 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:00.649237    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:00.650042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.649937    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 11:25:00.650154 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.650135    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 11:25:00.650342 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.650326    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 11:25:00.650848 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.650579    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 11:25:00.650848 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.650612    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 11:25:00.650848 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.650678    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vzgfm\""
Sep 15 11:25:00.651572 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.651541    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.652048 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.652032    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 11:25:00.654914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.654140    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 11:25:00.654914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.654266    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 11:25:00.654914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.654274    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2wxf9\""
Sep 15 11:25:00.654914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.654405    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 11:25:00.654914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.654500    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 11:25:00.654914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.654508    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.654914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.654756    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 11:25:00.654914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.654822    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 11:25:00.656793 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.656597    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:00.656793 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:00.656663    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:00.656793 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.656690    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tns7t\""
Sep 15 11:25:00.657306 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.657099    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 11:25:00.657306 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.657114    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 11:25:00.657306 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.657138    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 11:25:00.659509 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.659209    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:00.661826 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.661793    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-274hv"
Sep 15 11:25:00.662254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.662237    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 11:25:00.662358 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.662339    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f4b9x\""
Sep 15 11:25:00.662436 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.662424    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 11:25:00.664083 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664033    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:25:00.664083 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664071    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.664484 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664457    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-ovnkube-script-lib\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.664586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664501    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.664586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-sys-fs\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.664586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664574    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-node-log\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.664750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-cni-netd\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.664750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664622    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-ovn-node-metrics-cert\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.664750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664645    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-tuned\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.664750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664671    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg8vz\" (UniqueName: \"kubernetes.io/projected/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-kube-api-access-lg8vz\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:00.664750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-run-ovn-kubernetes\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.664750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664712    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 11:25:00.664750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664724    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-modprobe-d\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.664750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664748    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-kubernetes\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-sys\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664792    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp8xb\" (UniqueName: \"kubernetes.io/projected/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-kube-api-access-zp8xb\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664820    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-systemd\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664871    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f140243f-0052-4d96-b1fe-fe0803ac135b-cnibin\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664895    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-sysctl-d\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-sysctl-conf\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-run\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.664985    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-run-systemd\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665015    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-lib-modules\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665037    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-tmp\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665065    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvwtg\" (UniqueName: \"kubernetes.io/projected/f140243f-0052-4d96-b1fe-fe0803ac135b-kube-api-access-fvwtg\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.665117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665085    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-slash\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665136    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pm6k4\""
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665142    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665177    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-registration-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665191    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-host\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665206    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-run-openvswitch\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665225    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-log-socket\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665255    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-socket-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665275    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f140243f-0052-4d96-b1fe-fe0803ac135b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn24r\" (UniqueName: \"kubernetes.io/projected/450a1f25-d9e7-4c3e-9a2f-106752daca9d-kube-api-access-fn24r\") pod \"node-resolver-8gtj9\" (UID: \"450a1f25-d9e7-4c3e-9a2f-106752daca9d\") " pod="openshift-dns/node-resolver-8gtj9"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665310    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-sysconfig\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-run-netns\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665355    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-ovnkube-config\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665375    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-env-overrides\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665400    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt549\" (UniqueName: \"kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549\") pod \"network-check-target-clnqp\" (UID: \"eeb30891-2c06-4839-9f72-3aa1b489b8b3\") " pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665424    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-device-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.665662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665442    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f140243f-0052-4d96-b1fe-fe0803ac135b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-run-ovn\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665493    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-cni-bin\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665517    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f140243f-0052-4d96-b1fe-fe0803ac135b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665547    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/450a1f25-d9e7-4c3e-9a2f-106752daca9d-hosts-file\") pod \"node-resolver-8gtj9\" (UID: \"450a1f25-d9e7-4c3e-9a2f-106752daca9d\") " pod="openshift-dns/node-resolver-8gtj9"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665586    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665462    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665745    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f140243f-0052-4d96-b1fe-fe0803ac135b-system-cni-dir\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665806    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj5l7\" (UniqueName: \"kubernetes.io/projected/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-kube-api-access-bj5l7\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665848    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djwq\" (UniqueName: \"kubernetes.io/projected/a1e22137-b99e-44b4-a347-e8f21d9d1495-kube-api-access-8djwq\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665880    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/450a1f25-d9e7-4c3e-9a2f-106752daca9d-tmp-dir\") pod \"node-resolver-8gtj9\" (UID: \"450a1f25-d9e7-4c3e-9a2f-106752daca9d\") " pod="openshift-dns/node-resolver-8gtj9"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.665972    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f140243f-0052-4d96-b1fe-fe0803ac135b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.666012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-var-lib-openvswitch\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.666074    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-etc-openvswitch\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.666123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.666146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-var-lib-kubelet\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.666168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-kubelet\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.666388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.666198    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-systemd-units\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.667149 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.666501    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:25:00.667149 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.666577    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g5ssh\""
Sep 15 11:25:00.667149 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.666633    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 11:25:00.668428 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.668413    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-889s2"
Sep 15 11:25:00.670836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.670820    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 11:25:00.670990 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.670959    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 11:25:00.671073 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.671016    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xtmnz\""
Sep 15 11:25:00.671237 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.671223    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 11:25:00.691936 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.691913    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jc4d5"
Sep 15 11:25:00.699438 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.699416    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jc4d5"
Sep 15 11:25:00.753716 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.753692    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 11:25:00.767130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767103    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea91870e-ff4f-46de-9a9c-d4984ac39f88-agent-certs\") pod \"konnectivity-agent-2wfh5\" (UID: \"ea91870e-ff4f-46de-9a9c-d4984ac39f88\") " pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:00.767234 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767140    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/032eaed3-d560-4389-96c7-a53d53a04c23-host-slash\") pod \"iptables-alerter-274hv\" (UID: \"032eaed3-d560-4389-96c7-a53d53a04c23\") " pod="openshift-network-operator/iptables-alerter-274hv"
Sep 15 11:25:00.767234 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767173    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-tuned\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.767234 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767213    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg8vz\" (UniqueName: \"kubernetes.io/projected/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-kube-api-access-lg8vz\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:00.767411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-run-ovn-kubernetes\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.767411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767329    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-etc-kubernetes\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.767411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767355    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-modprobe-d\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.767411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767365    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-run-ovn-kubernetes\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.767411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767381    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-kubernetes\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.767411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767407    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-sys\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp8xb\" (UniqueName: \"kubernetes.io/projected/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-kube-api-access-zp8xb\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767454    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwm9k\" (UniqueName: \"kubernetes.io/projected/032eaed3-d560-4389-96c7-a53d53a04c23-kube-api-access-cwm9k\") pod \"iptables-alerter-274hv\" (UID: \"032eaed3-d560-4389-96c7-a53d53a04c23\") " pod="openshift-network-operator/iptables-alerter-274hv"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767480    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-system-cni-dir\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767502    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-run-k8s-cni-cncf-io\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767507    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-modprobe-d\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767507    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-kubernetes\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767525    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-systemd\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767550    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f140243f-0052-4d96-b1fe-fe0803ac135b-cnibin\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767587    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-sys\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767589    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-var-lib-cni-bin\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767622    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlt54\" (UniqueName: \"kubernetes.io/projected/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-kube-api-access-xlt54\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767663    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f140243f-0052-4d96-b1fe-fe0803ac135b-cnibin\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767662    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-systemd\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767688    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e89114c8-5946-4fdc-b752-7568f994e251-dbus\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:00.767719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-sysctl-d\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767746    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-sysctl-conf\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767820    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-sysctl-d\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767831    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-run\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767854    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-run-systemd\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767860    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-sysctl-conf\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767896    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-run-netns\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767899    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-run-systemd\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767914    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-var-lib-kubelet\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767914    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-run\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767935    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-conf-dir\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767941    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767963    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-lib-modules\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.767985    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-tmp\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvwtg\" (UniqueName: \"kubernetes.io/projected/f140243f-0052-4d96-b1fe-fe0803ac135b-kube-api-access-fvwtg\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768022    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-slash\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768098    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-lib-modules\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768125    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.768362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768164    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-slash\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768170    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-registration-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768228    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-run-multus-certs\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768249    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-host\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768272    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-run-openvswitch\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768291    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-registration-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-host\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768295    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-log-socket\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768327    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-log-socket\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768339    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-socket-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768358    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-run-openvswitch\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-daemon-config\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768386    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f140243f-0052-4d96-b1fe-fe0803ac135b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768410    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn24r\" (UniqueName: \"kubernetes.io/projected/450a1f25-d9e7-4c3e-9a2f-106752daca9d-kube-api-access-fn24r\") pod \"node-resolver-8gtj9\" (UID: \"450a1f25-d9e7-4c3e-9a2f-106752daca9d\") " pod="openshift-dns/node-resolver-8gtj9"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768418    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-socket-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768431    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-sysconfig\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.769031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768454    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-run-netns\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768501    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-ovnkube-config\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/032eaed3-d560-4389-96c7-a53d53a04c23-iptables-alerter-script\") pod \"iptables-alerter-274hv\" (UID: \"032eaed3-d560-4389-96c7-a53d53a04c23\") " pod="openshift-network-operator/iptables-alerter-274hv"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-hostroot\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768635    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-var-lib-cni-multus\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768656    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e89114c8-5946-4fdc-b752-7568f994e251-kubelet-config\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-env-overrides\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768701    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt549\" (UniqueName: \"kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549\") pod \"network-check-target-clnqp\" (UID: \"eeb30891-2c06-4839-9f72-3aa1b489b8b3\") " pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768756    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-device-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768776    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f140243f-0052-4d96-b1fe-fe0803ac135b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768796    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-run-ovn\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768821    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-cni-bin\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768844    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f140243f-0052-4d96-b1fe-fe0803ac135b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768863    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/450a1f25-d9e7-4c3e-9a2f-106752daca9d-hosts-file\") pod \"node-resolver-8gtj9\" (UID: \"450a1f25-d9e7-4c3e-9a2f-106752daca9d\") " pod="openshift-dns/node-resolver-8gtj9"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768885    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768912    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f140243f-0052-4d96-b1fe-fe0803ac135b-system-cni-dir\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.769640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768940    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj5l7\" (UniqueName: \"kubernetes.io/projected/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-kube-api-access-bj5l7\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768972    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f140243f-0052-4d96-b1fe-fe0803ac135b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.768979    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djwq\" (UniqueName: \"kubernetes.io/projected/a1e22137-b99e-44b4-a347-e8f21d9d1495-kube-api-access-8djwq\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769015    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/71a45129-8300-4e2f-83fc-138206ef4396-serviceca\") pod \"node-ca-889s2\" (UID: \"71a45129-8300-4e2f-83fc-138206ef4396\") " pod="openshift-image-registry/node-ca-889s2"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769036    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/450a1f25-d9e7-4c3e-9a2f-106752daca9d-tmp-dir\") pod \"node-resolver-8gtj9\" (UID: \"450a1f25-d9e7-4c3e-9a2f-106752daca9d\") " pod="openshift-dns/node-resolver-8gtj9"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769057    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f140243f-0052-4d96-b1fe-fe0803ac135b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769078    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-var-lib-openvswitch\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769087    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-sysconfig\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-cni-binary-copy\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-socket-dir-parent\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769135    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-run-netns\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769142    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71a45129-8300-4e2f-83fc-138206ef4396-host\") pod \"node-ca-889s2\" (UID: \"71a45129-8300-4e2f-83fc-138206ef4396\") " pod="openshift-image-registry/node-ca-889s2"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769162    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqvvr\" (UniqueName: \"kubernetes.io/projected/71a45129-8300-4e2f-83fc-138206ef4396-kube-api-access-zqvvr\") pod \"node-ca-889s2\" (UID: \"71a45129-8300-4e2f-83fc-138206ef4396\") " pod="openshift-image-registry/node-ca-889s2"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769177    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-ovnkube-config\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769195    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-etc-openvswitch\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769218    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769241    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea91870e-ff4f-46de-9a9c-d4984ac39f88-konnectivity-ca\") pod \"konnectivity-agent-2wfh5\" (UID: \"ea91870e-ff4f-46de-9a9c-d4984ac39f88\") " pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:00.770444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-cni-dir\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-var-lib-kubelet\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769311    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-kubelet\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-systemd-units\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769374    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-ovnkube-script-lib\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769430    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-sys-fs\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769457    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-node-log\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769479    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-cni-netd\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769502    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-ovn-node-metrics-cert\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769526    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-cnibin\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769611    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f140243f-0052-4d96-b1fe-fe0803ac135b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769649    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/450a1f25-d9e7-4c3e-9a2f-106752daca9d-hosts-file\") pod \"node-resolver-8gtj9\" (UID: \"450a1f25-d9e7-4c3e-9a2f-106752daca9d\") " pod="openshift-dns/node-resolver-8gtj9"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769701    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-device-dir\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:00.769737    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769905    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f140243f-0052-4d96-b1fe-fe0803ac135b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769774    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f140243f-0052-4d96-b1fe-fe0803ac135b-system-cni-dir\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769794    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-run-ovn\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.771280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769895    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-cni-bin\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769944    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:00.769950    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs podName:05b2d78d-4daf-451e-8d23-dfd20c0e8abb nodeName:}" failed. No retries permitted until 2026-09-15 11:25:01.269909462 +0000 UTC m=+3.026155838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs") pod "network-metrics-daemon-7dh7b" (UID: "05b2d78d-4daf-451e-8d23-dfd20c0e8abb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769990    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-var-lib-kubelet\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769744    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-env-overrides\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.769992    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-var-lib-openvswitch\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.770138    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-node-log\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.770152    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-etc-openvswitch\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.770176    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-systemd-units\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.770180    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-cni-netd\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.770254    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.770294    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-host-kubelet\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.770337    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1e22137-b99e-44b4-a347-e8f21d9d1495-sys-fs\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.770664    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-ovnkube-script-lib\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.770713    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/450a1f25-d9e7-4c3e-9a2f-106752daca9d-tmp-dir\") pod \"node-resolver-8gtj9\" (UID: \"450a1f25-d9e7-4c3e-9a2f-106752daca9d\") " pod="openshift-dns/node-resolver-8gtj9"
Sep 15 11:25:00.772116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.770880    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f140243f-0052-4d96-b1fe-fe0803ac135b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.772864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.772257    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-etc-tuned\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.772864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.772334    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-tmp\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.774491 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.774467    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-ovn-node-metrics-cert\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.777814 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:00.777796    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:00.777896 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:00.777820    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:00.777896 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:00.777834    2570 projected.go:196] Error preparing data for projected volume kube-api-access-bt549 for pod openshift-network-diagnostics/network-check-target-clnqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:00.777896 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:00.777885    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549 podName:eeb30891-2c06-4839-9f72-3aa1b489b8b3 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:01.277870488 +0000 UTC m=+3.034116858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bt549" (UniqueName: "kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549") pod "network-check-target-clnqp" (UID: "eeb30891-2c06-4839-9f72-3aa1b489b8b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:00.779639 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.779610    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg8vz\" (UniqueName: \"kubernetes.io/projected/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-kube-api-access-lg8vz\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:00.779840 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.779820    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp8xb\" (UniqueName: \"kubernetes.io/projected/ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0-kube-api-access-zp8xb\") pod \"tuned-hp82r\" (UID: \"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0\") " pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.779898 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.779800    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal" event={"ID":"3debddb7c159d01ebc9dc0c64b49a027","Type":"ContainerStarted","Data":"fa252cce49f08033a3628e7236e0cb5e7f1579c1c6d5bd422729a0aca4d919b0"}
Sep 15 11:25:00.780242 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.780221    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn24r\" (UniqueName: \"kubernetes.io/projected/450a1f25-d9e7-4c3e-9a2f-106752daca9d-kube-api-access-fn24r\") pod \"node-resolver-8gtj9\" (UID: \"450a1f25-d9e7-4c3e-9a2f-106752daca9d\") " pod="openshift-dns/node-resolver-8gtj9"
Sep 15 11:25:00.781541 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.781498    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvwtg\" (UniqueName: \"kubernetes.io/projected/f140243f-0052-4d96-b1fe-fe0803ac135b-kube-api-access-fvwtg\") pod \"multus-additional-cni-plugins-xmwfg\" (UID: \"f140243f-0052-4d96-b1fe-fe0803ac135b\") " pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.781541 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.781532    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-116.ec2.internal" event={"ID":"06f232f311e4bd0ea0f4417f4173efba","Type":"ContainerStarted","Data":"3ed37e7e4b1fede3150b0882cf770ba9f2d157ceb93570ac5804b2c2e4e4e3cb"}
Sep 15 11:25:00.784522 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.784503    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj5l7\" (UniqueName: \"kubernetes.io/projected/ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d-kube-api-access-bj5l7\") pod \"ovnkube-node-psfsv\" (UID: \"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d\") " pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.785043 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.785018    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djwq\" (UniqueName: \"kubernetes.io/projected/a1e22137-b99e-44b4-a347-e8f21d9d1495-kube-api-access-8djwq\") pod \"aws-ebs-csi-driver-node-mwtds\" (UID: \"a1e22137-b99e-44b4-a347-e8f21d9d1495\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.870304 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870213    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/032eaed3-d560-4389-96c7-a53d53a04c23-host-slash\") pod \"iptables-alerter-274hv\" (UID: \"032eaed3-d560-4389-96c7-a53d53a04c23\") " pod="openshift-network-operator/iptables-alerter-274hv"
Sep 15 11:25:00.870304 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870257    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-etc-kubernetes\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.870304 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870280    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwm9k\" (UniqueName: \"kubernetes.io/projected/032eaed3-d560-4389-96c7-a53d53a04c23-kube-api-access-cwm9k\") pod \"iptables-alerter-274hv\" (UID: \"032eaed3-d560-4389-96c7-a53d53a04c23\") " pod="openshift-network-operator/iptables-alerter-274hv"
Sep 15 11:25:00.870304 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870302    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-system-cni-dir\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870325    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-run-k8s-cni-cncf-io\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-var-lib-cni-bin\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870373    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlt54\" (UniqueName: \"kubernetes.io/projected/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-kube-api-access-xlt54\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e89114c8-5946-4fdc-b752-7568f994e251-dbus\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870418    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-run-netns\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870440    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-var-lib-kubelet\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-conf-dir\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-run-multus-certs\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-daemon-config\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870538    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-var-lib-cni-bin\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/032eaed3-d560-4389-96c7-a53d53a04c23-iptables-alerter-script\") pod \"iptables-alerter-274hv\" (UID: \"032eaed3-d560-4389-96c7-a53d53a04c23\") " pod="openshift-network-operator/iptables-alerter-274hv"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870603    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/032eaed3-d560-4389-96c7-a53d53a04c23-host-slash\") pod \"iptables-alerter-274hv\" (UID: \"032eaed3-d560-4389-96c7-a53d53a04c23\") " pod="openshift-network-operator/iptables-alerter-274hv"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870634    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-hostroot\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870639    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-var-lib-kubelet\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-var-lib-cni-multus\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-etc-kubernetes\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e89114c8-5946-4fdc-b752-7568f994e251-kubelet-config\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:00.871511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-run-netns\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870714    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-conf-dir\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870728    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870769    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-system-cni-dir\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870772    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/71a45129-8300-4e2f-83fc-138206ef4396-serviceca\") pod \"node-ca-889s2\" (UID: \"71a45129-8300-4e2f-83fc-138206ef4396\") " pod="openshift-image-registry/node-ca-889s2"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870770    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-hostroot\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870814    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-cni-binary-copy\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:00.870842    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870867    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-run-k8s-cni-cncf-io\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870842    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-var-lib-cni-multus\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870816    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e89114c8-5946-4fdc-b752-7568f994e251-kubelet-config\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:00.870892    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret podName:e89114c8-5946-4fdc-b752-7568f994e251 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:01.370875771 +0000 UTC m=+3.127122128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret") pod "global-pull-secret-syncer-2gnj8" (UID: "e89114c8-5946-4fdc-b752-7568f994e251") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-socket-dir-parent\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870912    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-host-run-multus-certs\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870924    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71a45129-8300-4e2f-83fc-138206ef4396-host\") pod \"node-ca-889s2\" (UID: \"71a45129-8300-4e2f-83fc-138206ef4396\") " pod="openshift-image-registry/node-ca-889s2"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870947    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqvvr\" (UniqueName: \"kubernetes.io/projected/71a45129-8300-4e2f-83fc-138206ef4396-kube-api-access-zqvvr\") pod \"node-ca-889s2\" (UID: \"71a45129-8300-4e2f-83fc-138206ef4396\") " pod="openshift-image-registry/node-ca-889s2"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870958    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-socket-dir-parent\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea91870e-ff4f-46de-9a9c-d4984ac39f88-konnectivity-ca\") pod \"konnectivity-agent-2wfh5\" (UID: \"ea91870e-ff4f-46de-9a9c-d4984ac39f88\") " pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:00.872298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.870997    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-cni-dir\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.873133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.871026    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-cnibin\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.873133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.871048    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea91870e-ff4f-46de-9a9c-d4984ac39f88-agent-certs\") pod \"konnectivity-agent-2wfh5\" (UID: \"ea91870e-ff4f-46de-9a9c-d4984ac39f88\") " pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:00.873133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.871159    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/71a45129-8300-4e2f-83fc-138206ef4396-serviceca\") pod \"node-ca-889s2\" (UID: \"71a45129-8300-4e2f-83fc-138206ef4396\") " pod="openshift-image-registry/node-ca-889s2"
Sep 15 11:25:00.873133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.871166    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71a45129-8300-4e2f-83fc-138206ef4396-host\") pod \"node-ca-889s2\" (UID: \"71a45129-8300-4e2f-83fc-138206ef4396\") " pod="openshift-image-registry/node-ca-889s2"
Sep 15 11:25:00.873133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.871210    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-cni-dir\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.873133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.871274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/032eaed3-d560-4389-96c7-a53d53a04c23-iptables-alerter-script\") pod \"iptables-alerter-274hv\" (UID: \"032eaed3-d560-4389-96c7-a53d53a04c23\") " pod="openshift-network-operator/iptables-alerter-274hv"
Sep 15 11:25:00.873133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.871345    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e89114c8-5946-4fdc-b752-7568f994e251-dbus\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:00.873133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.871352    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-cni-binary-copy\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.873133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.871378    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-cnibin\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.873133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.871483    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-multus-daemon-config\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.873133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.871608    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea91870e-ff4f-46de-9a9c-d4984ac39f88-konnectivity-ca\") pod \"konnectivity-agent-2wfh5\" (UID: \"ea91870e-ff4f-46de-9a9c-d4984ac39f88\") " pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:00.873702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.873658    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea91870e-ff4f-46de-9a9c-d4984ac39f88-agent-certs\") pod \"konnectivity-agent-2wfh5\" (UID: \"ea91870e-ff4f-46de-9a9c-d4984ac39f88\") " pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:00.880671 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.880647    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlt54\" (UniqueName: \"kubernetes.io/projected/7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c-kube-api-access-xlt54\") pod \"multus-vjfkp\" (UID: \"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c\") " pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:00.884173 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.884150    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwm9k\" (UniqueName: \"kubernetes.io/projected/032eaed3-d560-4389-96c7-a53d53a04c23-kube-api-access-cwm9k\") pod \"iptables-alerter-274hv\" (UID: \"032eaed3-d560-4389-96c7-a53d53a04c23\") " pod="openshift-network-operator/iptables-alerter-274hv"
Sep 15 11:25:00.884273 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.884222    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqvvr\" (UniqueName: \"kubernetes.io/projected/71a45129-8300-4e2f-83fc-138206ef4396-kube-api-access-zqvvr\") pod \"node-ca-889s2\" (UID: \"71a45129-8300-4e2f-83fc-138206ef4396\") " pod="openshift-image-registry/node-ca-889s2"
Sep 15 11:25:00.950937 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.950910    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8gtj9"
Sep 15 11:25:00.958004 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.957982    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hp82r"
Sep 15 11:25:00.967481 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.967457    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xmwfg"
Sep 15 11:25:00.977549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.977526    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:00.985330 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.985312    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds"
Sep 15 11:25:00.990973 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.990954    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:00.998585 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:00.998553    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-274hv"
Sep 15 11:25:01.006290 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.006263    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vjfkp"
Sep 15 11:25:01.012860 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.012842    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-889s2"
Sep 15 11:25:01.273877 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.273848    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:01.274038 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:01.274002    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:01.274118 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:01.274105    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs podName:05b2d78d-4daf-451e-8d23-dfd20c0e8abb nodeName:}" failed. No retries permitted until 2026-09-15 11:25:02.274083936 +0000 UTC m=+4.030330314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs") pod "network-metrics-daemon-7dh7b" (UID: "05b2d78d-4daf-451e-8d23-dfd20c0e8abb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:01.374713 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.374684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt549\" (UniqueName: \"kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549\") pod \"network-check-target-clnqp\" (UID: \"eeb30891-2c06-4839-9f72-3aa1b489b8b3\") " pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:01.374888 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.374720    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:01.374888 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:01.374819    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:01.374888 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:01.374849    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:01.374888 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:01.374875    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:01.374888 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:01.374878    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret podName:e89114c8-5946-4fdc-b752-7568f994e251 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:02.37486178 +0000 UTC m=+4.131108137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret") pod "global-pull-secret-syncer-2gnj8" (UID: "e89114c8-5946-4fdc-b752-7568f994e251") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:01.374888 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:01.374888    2570 projected.go:196] Error preparing data for projected volume kube-api-access-bt549 for pod openshift-network-diagnostics/network-check-target-clnqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:01.375116 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:01.374941    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549 podName:eeb30891-2c06-4839-9f72-3aa1b489b8b3 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:02.374925935 +0000 UTC m=+4.131172310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bt549" (UniqueName: "kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549") pod "network-check-target-clnqp" (UID: "eeb30891-2c06-4839-9f72-3aa1b489b8b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:01.685272 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:01.685248    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf140243f_0052_4d96_b1fe_fe0803ac135b.slice/crio-b53191e2d99c1d0ccd488f8dbb19ab80c273d2f5e916c9c96162284cbbfdc8b2 WatchSource:0}: Error finding container b53191e2d99c1d0ccd488f8dbb19ab80c273d2f5e916c9c96162284cbbfdc8b2: Status 404 returned error can't find the container with id b53191e2d99c1d0ccd488f8dbb19ab80c273d2f5e916c9c96162284cbbfdc8b2
Sep 15 11:25:01.693074 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:01.693053    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea91870e_ff4f_46de_9a9c_d4984ac39f88.slice/crio-2770863ba770d59f9153559d1293f755e57f3b7e8010bbf4e96503f14912f4d1 WatchSource:0}: Error finding container 2770863ba770d59f9153559d1293f755e57f3b7e8010bbf4e96503f14912f4d1: Status 404 returned error can't find the container with id 2770863ba770d59f9153559d1293f755e57f3b7e8010bbf4e96503f14912f4d1
Sep 15 11:25:01.693509 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:01.693483    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e22137_b99e_44b4_a347_e8f21d9d1495.slice/crio-0cc0aab47025c1a62cc33ab87c9e39409fb05bdc626fa75ef521dc4c21774335 WatchSource:0}: Error finding container 0cc0aab47025c1a62cc33ab87c9e39409fb05bdc626fa75ef521dc4c21774335: Status 404 returned error can't find the container with id 0cc0aab47025c1a62cc33ab87c9e39409fb05bdc626fa75ef521dc4c21774335
Sep 15 11:25:01.694773 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:01.694691    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5945f9_1cd5_4822_a37e_e7e0bcd8b34d.slice/crio-da35dc612b2c93d2fef728b5fd2667c321a04068bbe3029e7b06ed81f34e7dff WatchSource:0}: Error finding container da35dc612b2c93d2fef728b5fd2667c321a04068bbe3029e7b06ed81f34e7dff: Status 404 returned error can't find the container with id da35dc612b2c93d2fef728b5fd2667c321a04068bbe3029e7b06ed81f34e7dff
Sep 15 11:25:01.696347 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:01.696198    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450a1f25_d9e7_4c3e_9a2f_106752daca9d.slice/crio-78672730541ed0d5812ce76d17995b9c44042f75007f3857b936cf2e7beab4e7 WatchSource:0}: Error finding container 78672730541ed0d5812ce76d17995b9c44042f75007f3857b936cf2e7beab4e7: Status 404 returned error can't find the container with id 78672730541ed0d5812ce76d17995b9c44042f75007f3857b936cf2e7beab4e7
Sep 15 11:25:01.696918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:01.696894    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4f04a2_7c1b_4c77_8366_8b0d9100dcf0.slice/crio-4baff7304f0831b597e20916e2a873a5b757838441798ab092ed934a1aa12712 WatchSource:0}: Error finding container 4baff7304f0831b597e20916e2a873a5b757838441798ab092ed934a1aa12712: Status 404 returned error can't find the container with id 4baff7304f0831b597e20916e2a873a5b757838441798ab092ed934a1aa12712
Sep 15 11:25:01.699550 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:01.699454    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e721517_cfb0_4ff3_8c41_c5e1e08cdd6c.slice/crio-4077905be55fcb73f0d30c5aa04d90e7270d96ea634fc0e54c76be9a43648807 WatchSource:0}: Error finding container 4077905be55fcb73f0d30c5aa04d90e7270d96ea634fc0e54c76be9a43648807: Status 404 returned error can't find the container with id 4077905be55fcb73f0d30c5aa04d90e7270d96ea634fc0e54c76be9a43648807
Sep 15 11:25:01.701817 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:01.701787    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032eaed3_d560_4389_96c7_a53d53a04c23.slice/crio-5427eac1251f070018abe3ec9d92daa80b56affe6325631945c9af103600e75c WatchSource:0}: Error finding container 5427eac1251f070018abe3ec9d92daa80b56affe6325631945c9af103600e75c: Status 404 returned error can't find the container with id 5427eac1251f070018abe3ec9d92daa80b56affe6325631945c9af103600e75c
Sep 15 11:25:01.702438 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.702297    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:20:00 +0000 UTC" deadline="2028-05-16 23:42:22.660353113 +0000 UTC"
Sep 15 11:25:01.702438 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.702345    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14628h17m20.95801376s"
Sep 15 11:25:01.703049 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:01.702970    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a45129_8300_4e2f_83fc_138206ef4396.slice/crio-85b5388b61f80683d113a4ffe6359b8063967c11c2b5e332234393dd35ebd845 WatchSource:0}: Error finding container 85b5388b61f80683d113a4ffe6359b8063967c11c2b5e332234393dd35ebd845: Status 404 returned error can't find the container with id 85b5388b61f80683d113a4ffe6359b8063967c11c2b5e332234393dd35ebd845
Sep 15 11:25:01.773814 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.773793    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:01.773930 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:01.773899    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:01.785654 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.785633    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-274hv" event={"ID":"032eaed3-d560-4389-96c7-a53d53a04c23","Type":"ContainerStarted","Data":"5427eac1251f070018abe3ec9d92daa80b56affe6325631945c9af103600e75c"}
Sep 15 11:25:01.786677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.786652    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vjfkp" event={"ID":"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c","Type":"ContainerStarted","Data":"4077905be55fcb73f0d30c5aa04d90e7270d96ea634fc0e54c76be9a43648807"}
Sep 15 11:25:01.791813 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.791793    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hp82r" event={"ID":"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0","Type":"ContainerStarted","Data":"4baff7304f0831b597e20916e2a873a5b757838441798ab092ed934a1aa12712"}
Sep 15 11:25:01.796265 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.796244    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds" event={"ID":"a1e22137-b99e-44b4-a347-e8f21d9d1495","Type":"ContainerStarted","Data":"0cc0aab47025c1a62cc33ab87c9e39409fb05bdc626fa75ef521dc4c21774335"}
Sep 15 11:25:01.800391 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.800370    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv" event={"ID":"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d","Type":"ContainerStarted","Data":"da35dc612b2c93d2fef728b5fd2667c321a04068bbe3029e7b06ed81f34e7dff"}
Sep 15 11:25:01.804453 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.804431    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-889s2" event={"ID":"71a45129-8300-4e2f-83fc-138206ef4396","Type":"ContainerStarted","Data":"85b5388b61f80683d113a4ffe6359b8063967c11c2b5e332234393dd35ebd845"}
Sep 15 11:25:01.805674 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.805654    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8gtj9" event={"ID":"450a1f25-d9e7-4c3e-9a2f-106752daca9d","Type":"ContainerStarted","Data":"78672730541ed0d5812ce76d17995b9c44042f75007f3857b936cf2e7beab4e7"}
Sep 15 11:25:01.806776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.806757    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2wfh5" event={"ID":"ea91870e-ff4f-46de-9a9c-d4984ac39f88","Type":"ContainerStarted","Data":"2770863ba770d59f9153559d1293f755e57f3b7e8010bbf4e96503f14912f4d1"}
Sep 15 11:25:01.807838 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.807820    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmwfg" event={"ID":"f140243f-0052-4d96-b1fe-fe0803ac135b","Type":"ContainerStarted","Data":"b53191e2d99c1d0ccd488f8dbb19ab80c273d2f5e916c9c96162284cbbfdc8b2"}
Sep 15 11:25:01.809549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:01.809530    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-116.ec2.internal" event={"ID":"06f232f311e4bd0ea0f4417f4173efba","Type":"ContainerStarted","Data":"4c83a47fce08046abffd87b181f3cb18b807375f4c3e4dd69889ccb3d5fd10ad"}
Sep 15 11:25:02.280245 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:02.279660    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:02.280245 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:02.279867    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:02.280245 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:02.279929    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs podName:05b2d78d-4daf-451e-8d23-dfd20c0e8abb nodeName:}" failed. No retries permitted until 2026-09-15 11:25:04.27991016 +0000 UTC m=+6.036156517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs") pod "network-metrics-daemon-7dh7b" (UID: "05b2d78d-4daf-451e-8d23-dfd20c0e8abb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:02.381713 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:02.380676    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt549\" (UniqueName: \"kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549\") pod \"network-check-target-clnqp\" (UID: \"eeb30891-2c06-4839-9f72-3aa1b489b8b3\") " pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:02.381713 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:02.380728    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:02.381713 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:02.380891    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:02.381713 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:02.380957    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret podName:e89114c8-5946-4fdc-b752-7568f994e251 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:04.380932526 +0000 UTC m=+6.137178884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret") pod "global-pull-secret-syncer-2gnj8" (UID: "e89114c8-5946-4fdc-b752-7568f994e251") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:02.381713 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:02.381581    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:02.381713 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:02.381605    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:02.381713 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:02.381620    2570 projected.go:196] Error preparing data for projected volume kube-api-access-bt549 for pod openshift-network-diagnostics/network-check-target-clnqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:02.381713 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:02.381662    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549 podName:eeb30891-2c06-4839-9f72-3aa1b489b8b3 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:04.381648198 +0000 UTC m=+6.137894554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bt549" (UniqueName: "kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549") pod "network-check-target-clnqp" (UID: "eeb30891-2c06-4839-9f72-3aa1b489b8b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:02.702689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:02.702551    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:20:00 +0000 UTC" deadline="2028-04-30 08:09:32.164159685 +0000 UTC"
Sep 15 11:25:02.702689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:02.702621    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14228h44m29.461543124s"
Sep 15 11:25:02.780953 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:02.780401    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:02.780953 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:02.780401    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:02.780953 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:02.780523    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:02.780953 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:02.780628    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:02.836639 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:02.835343    2570 generic.go:356] "Generic (PLEG): container finished" podID="3debddb7c159d01ebc9dc0c64b49a027" containerID="472139d4493827931bb9bbd7d42ec6240eba373bb189894480fbbbb6f4c0f615" exitCode=0
Sep 15 11:25:02.836639 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:02.835418    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal" event={"ID":"3debddb7c159d01ebc9dc0c64b49a027","Type":"ContainerDied","Data":"472139d4493827931bb9bbd7d42ec6240eba373bb189894480fbbbb6f4c0f615"}
Sep 15 11:25:02.854160 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:02.854111    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-116.ec2.internal" podStartSLOduration=3.854094005 podStartE2EDuration="3.854094005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:01.823015155 +0000 UTC m=+3.579261551" watchObservedRunningTime="2026-09-15 11:25:02.854094005 +0000 UTC m=+4.610340386"
Sep 15 11:25:03.774542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:03.774506    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:03.775002 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:03.774656    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:03.868011 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:03.867901    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal" event={"ID":"3debddb7c159d01ebc9dc0c64b49a027","Type":"ContainerStarted","Data":"346cc8b521bf0b7211a3d8b891eafc4ba0b73d27eef4dcd705c0ff5e2613bfc8"}
Sep 15 11:25:03.882597 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:03.882443    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-116.ec2.internal" podStartSLOduration=4.882425812 podStartE2EDuration="4.882425812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:03.881968857 +0000 UTC m=+5.638215231" watchObservedRunningTime="2026-09-15 11:25:03.882425812 +0000 UTC m=+5.638672191"
Sep 15 11:25:04.296093 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:04.296049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:04.296267 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:04.296188    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:04.296267 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:04.296247    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs podName:05b2d78d-4daf-451e-8d23-dfd20c0e8abb nodeName:}" failed. No retries permitted until 2026-09-15 11:25:08.296229485 +0000 UTC m=+10.052475843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs") pod "network-metrics-daemon-7dh7b" (UID: "05b2d78d-4daf-451e-8d23-dfd20c0e8abb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:04.397316 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:04.396517    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt549\" (UniqueName: \"kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549\") pod \"network-check-target-clnqp\" (UID: \"eeb30891-2c06-4839-9f72-3aa1b489b8b3\") " pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:04.397316 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:04.396582    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:04.397316 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:04.396738    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:04.397316 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:04.396804    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret podName:e89114c8-5946-4fdc-b752-7568f994e251 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:08.396785173 +0000 UTC m=+10.153031533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret") pod "global-pull-secret-syncer-2gnj8" (UID: "e89114c8-5946-4fdc-b752-7568f994e251") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:04.397316 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:04.397203    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:04.397316 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:04.397222    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:04.397316 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:04.397244    2570 projected.go:196] Error preparing data for projected volume kube-api-access-bt549 for pod openshift-network-diagnostics/network-check-target-clnqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:04.397316 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:04.397286    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549 podName:eeb30891-2c06-4839-9f72-3aa1b489b8b3 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:08.397272331 +0000 UTC m=+10.153518689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bt549" (UniqueName: "kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549") pod "network-check-target-clnqp" (UID: "eeb30891-2c06-4839-9f72-3aa1b489b8b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:04.774277 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:04.774247    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:04.774438 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:04.774375    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:04.774802 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:04.774209    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:04.775143 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:04.774893    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:05.774354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:05.774321    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:05.774511 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:05.774464    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:06.774654 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:06.774374    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:06.775099 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:06.774750    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:06.775099 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:06.774534    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:06.775195 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:06.775172    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:07.774685 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:07.774614    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:07.775090 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:07.774755    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:08.329938 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:08.329364    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:08.329938 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:08.329515    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:08.329938 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:08.329593    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs podName:05b2d78d-4daf-451e-8d23-dfd20c0e8abb nodeName:}" failed. No retries permitted until 2026-09-15 11:25:16.329573433 +0000 UTC m=+18.085819805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs") pod "network-metrics-daemon-7dh7b" (UID: "05b2d78d-4daf-451e-8d23-dfd20c0e8abb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:08.430495 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:08.430451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt549\" (UniqueName: \"kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549\") pod \"network-check-target-clnqp\" (UID: \"eeb30891-2c06-4839-9f72-3aa1b489b8b3\") " pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:08.430495 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:08.430497    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:08.430706 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:08.430643    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:08.430772 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:08.430724    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret podName:e89114c8-5946-4fdc-b752-7568f994e251 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:16.430705433 +0000 UTC m=+18.186951803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret") pod "global-pull-secret-syncer-2gnj8" (UID: "e89114c8-5946-4fdc-b752-7568f994e251") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:08.430772 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:08.430648    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:08.430869 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:08.430779    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:08.430869 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:08.430797    2570 projected.go:196] Error preparing data for projected volume kube-api-access-bt549 for pod openshift-network-diagnostics/network-check-target-clnqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:08.430869 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:08.430857    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549 podName:eeb30891-2c06-4839-9f72-3aa1b489b8b3 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:16.43084143 +0000 UTC m=+18.187087789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bt549" (UniqueName: "kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549") pod "network-check-target-clnqp" (UID: "eeb30891-2c06-4839-9f72-3aa1b489b8b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:08.775842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:08.775373    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:08.775842 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:08.775484    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:08.775842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:08.775535    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:08.775842 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:08.775658    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:09.774483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:09.774426    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:09.774812 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:09.774584    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:10.774267 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:10.774222    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:10.774267 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:10.774264    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:10.774779 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:10.774365    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:10.774779 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:10.774486    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:11.774347 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:11.774317    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:11.774718 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:11.774420    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:12.774631 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:12.774592    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:12.775084 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:12.774725    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:12.775084 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:12.774788    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:12.775084 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:12.774906    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:13.774577 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:13.774531    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:13.774765 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:13.774654    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:14.774597 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:14.774550    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:14.774754 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:14.774693    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:14.774754 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:14.774742    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:14.775081 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:14.774860    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:15.774361 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:15.774325    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:15.774633 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:15.774467    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:16.389235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:16.389201    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:16.389668 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:16.389336    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:16.389668 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:16.389400    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs podName:05b2d78d-4daf-451e-8d23-dfd20c0e8abb nodeName:}" failed. No retries permitted until 2026-09-15 11:25:32.389382287 +0000 UTC m=+34.145628666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs") pod "network-metrics-daemon-7dh7b" (UID: "05b2d78d-4daf-451e-8d23-dfd20c0e8abb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:16.490530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:16.490493    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt549\" (UniqueName: \"kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549\") pod \"network-check-target-clnqp\" (UID: \"eeb30891-2c06-4839-9f72-3aa1b489b8b3\") " pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:16.490530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:16.490534    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:16.490744 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:16.490690    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:16.490744 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:16.490705    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:16.490744 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:16.490736    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:16.490893 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:16.490749    2570 projected.go:196] Error preparing data for projected volume kube-api-access-bt549 for pod openshift-network-diagnostics/network-check-target-clnqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:16.490893 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:16.490759    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret podName:e89114c8-5946-4fdc-b752-7568f994e251 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:32.490741446 +0000 UTC m=+34.246987816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret") pod "global-pull-secret-syncer-2gnj8" (UID: "e89114c8-5946-4fdc-b752-7568f994e251") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:16.490893 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:16.490801    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549 podName:eeb30891-2c06-4839-9f72-3aa1b489b8b3 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:32.490785347 +0000 UTC m=+34.247031719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bt549" (UniqueName: "kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549") pod "network-check-target-clnqp" (UID: "eeb30891-2c06-4839-9f72-3aa1b489b8b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:16.774165 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:16.774132    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:16.774338 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:16.774260    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:16.774338 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:16.774289    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:16.774456 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:16.774340    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:17.774160 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:17.774128    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:17.774614 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:17.774245    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:18.775148 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:18.774785    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:18.775148 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:18.774832    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:18.775148 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:18.774920    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:18.775148 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:18.775047    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:19.774979 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.774749    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:19.775125 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:19.775098    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:19.900046 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.899988    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vjfkp" event={"ID":"7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c","Type":"ContainerStarted","Data":"0f4f610a2dad2051288cb542f3c0067340ab936e9a136f148dd0f38fd451b89b"}
Sep 15 11:25:19.902374 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.902349    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hp82r" event={"ID":"ed4f04a2-7c1b-4c77-8366-8b0d9100dcf0","Type":"ContainerStarted","Data":"7e7cbfd3770357100b47500aeabf36abb635af5e101e1eaec2500df6fbe0ae3e"}
Sep 15 11:25:19.903982 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.903958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds" event={"ID":"a1e22137-b99e-44b4-a347-e8f21d9d1495","Type":"ContainerStarted","Data":"5070153e7772326d3d3c5d6e71a9f42c7496f6a34bcf5425ce41c23551bd8f3b"}
Sep 15 11:25:19.907309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.907283    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv" event={"ID":"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d","Type":"ContainerStarted","Data":"555797e0b9fb4631a5de0db6ee56cdc08d3fae4a6980a754a972b5b7f0564562"}
Sep 15 11:25:19.907408 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.907346    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv" event={"ID":"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d","Type":"ContainerStarted","Data":"e2ed4d30d508dde210226211dfd3dc3f8bc596ecb68a5f2d64ca50678d8ccdfb"}
Sep 15 11:25:19.907408 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.907389    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv" event={"ID":"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d","Type":"ContainerStarted","Data":"7bf1b2f6ca99598dd0b404d61c3d5c9af45f0ca4dd54124d8b1eb31f07a8a352"}
Sep 15 11:25:19.907514 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.907437    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv" event={"ID":"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d","Type":"ContainerStarted","Data":"e700b42d08d13a4242bb2190ee171595672cc65048e89608608950d0c159ccbe"}
Sep 15 11:25:19.907514 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.907484    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv" event={"ID":"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d","Type":"ContainerStarted","Data":"1d88699ebcfc74700646f9a1284ee62b264da598ea28ddda05a946e389bebac5"}
Sep 15 11:25:19.908877 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.908847    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-889s2" event={"ID":"71a45129-8300-4e2f-83fc-138206ef4396","Type":"ContainerStarted","Data":"87666545ef27587cde84a8329e8e3bee324e2882281a21422e5437dc5635aad1"}
Sep 15 11:25:19.910390 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.910359    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8gtj9" event={"ID":"450a1f25-d9e7-4c3e-9a2f-106752daca9d","Type":"ContainerStarted","Data":"f519840aea0994f99a677026128e52a49fb3adb5e7ddaedfddfeab97c44b646a"}
Sep 15 11:25:19.912096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.912071    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2wfh5" event={"ID":"ea91870e-ff4f-46de-9a9c-d4984ac39f88","Type":"ContainerStarted","Data":"d626ada7cae87c6b7d3d8cde367c22193506e09099317bb0ef2fa4cc56914fb2"}
Sep 15 11:25:19.913697 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.913674    2570 generic.go:356] "Generic (PLEG): container finished" podID="f140243f-0052-4d96-b1fe-fe0803ac135b" containerID="07ecf3a756f9055ef82c792eab31521622613ac9ccf7b33a7b4674e8b817f357" exitCode=0
Sep 15 11:25:19.913799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.913705    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmwfg" event={"ID":"f140243f-0052-4d96-b1fe-fe0803ac135b","Type":"ContainerDied","Data":"07ecf3a756f9055ef82c792eab31521622613ac9ccf7b33a7b4674e8b817f357"}
Sep 15 11:25:19.918050 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.918004    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vjfkp" podStartSLOduration=3.4830576300000002 podStartE2EDuration="20.9179865s" totalImagesPullingTime="17.43492887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:19.917505346 +0000 UTC m=+21.673751726" watchObservedRunningTime="2026-09-15 11:25:19.9179865 +0000 UTC m=+21.674232880"
Sep 15 11:25:19.932328 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.932294    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-889s2" podStartSLOduration=3.561817894 podStartE2EDuration="20.932281634s" totalImagesPullingTime="17.37046374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:19.931629587 +0000 UTC m=+21.687875962" watchObservedRunningTime="2026-09-15 11:25:19.932281634 +0000 UTC m=+21.688528027"
Sep 15 11:25:19.976623 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:19.976509    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2wfh5" podStartSLOduration=3.57174273 podStartE2EDuration="20.976491381s" totalImagesPullingTime="17.404748651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:19.975738397 +0000 UTC m=+21.731984777" watchObservedRunningTime="2026-09-15 11:25:19.976491381 +0000 UTC m=+21.732737771"
Sep 15 11:25:20.006349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.006306    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8gtj9" podStartSLOduration=4.602950725 podStartE2EDuration="22.006288154s" totalImagesPullingTime="17.403337429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:20.005963822 +0000 UTC m=+21.762210201" watchObservedRunningTime="2026-09-15 11:25:20.006288154 +0000 UTC m=+21.762534534"
Sep 15 11:25:20.024251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.024216    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hp82r" podStartSLOduration=4.620145863 podStartE2EDuration="22.024204033s" totalImagesPullingTime="17.40405817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:20.023986618 +0000 UTC m=+21.780233006" watchObservedRunningTime="2026-09-15 11:25:20.024204033 +0000 UTC m=+21.780450411"
Sep 15 11:25:20.698182 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.698080    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 11:25:20.711509 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.711098    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T11:25:20.698103621Z","UUID":"6c26fc6c-9918-45ce-bd8a-01f741ec4bf3","Handler":null,"Name":"","Endpoint":""}
Sep 15 11:25:20.712651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.712633    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 11:25:20.712763 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.712677    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 11:25:20.774668 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.774646    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:20.774668 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.774658    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:20.774835 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:20.774743    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:20.774902 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:20.774873    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:20.918130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.918099    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-274hv" event={"ID":"032eaed3-d560-4389-96c7-a53d53a04c23","Type":"ContainerStarted","Data":"7a40e070012ab8135ee54ad7ad82a16936eda83064e655e59484f9d62e103a4a"}
Sep 15 11:25:20.920211 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.920186    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds" event={"ID":"a1e22137-b99e-44b4-a347-e8f21d9d1495","Type":"ContainerStarted","Data":"09caf731a6133aeb501c386bd63a78aabbcf08904e90b9e9dc68980572bf039b"}
Sep 15 11:25:20.926081 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.926054    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv" event={"ID":"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d","Type":"ContainerStarted","Data":"7f8cfdeb49a17ba00e880817a2f0e826fa94574af7c01c831a0bb895ac4d11d7"}
Sep 15 11:25:20.957141 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:20.957075    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-274hv" podStartSLOduration=4.559455175 podStartE2EDuration="21.95706376s" totalImagesPullingTime="17.397608585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:20.956657248 +0000 UTC m=+22.712903625" watchObservedRunningTime="2026-09-15 11:25:20.95706376 +0000 UTC m=+22.713310174"
Sep 15 11:25:21.203151 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:21.203119    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:21.203746 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:21.203729    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:21.774515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:21.774485    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:21.774700 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:21.774641    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:21.928131 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:21.928101    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:21.928479 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:21.928410    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2wfh5"
Sep 15 11:25:22.774800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:22.774767    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:22.774995 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:22.774887    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:22.774995 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:22.774951    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:22.775082 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:22.775062    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:22.932457 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:22.932416    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds" event={"ID":"a1e22137-b99e-44b4-a347-e8f21d9d1495","Type":"ContainerStarted","Data":"4158f395f8ee13ea9e965b954115b4bed281a64a8a3a4a646d085fcb48e86d1c"}
Sep 15 11:25:22.936346 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:22.936316    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv" event={"ID":"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d","Type":"ContainerStarted","Data":"14fe019f0f90579d886664bf005f5cc1af0456d958b2ad5ab804408c2622577c"}
Sep 15 11:25:22.952143 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:22.952104    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwtds" podStartSLOduration=4.202886607 podStartE2EDuration="23.952092721s" totalImagesPullingTime="19.749206114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:24:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:22.951577049 +0000 UTC m=+24.707823428" watchObservedRunningTime="2026-09-15 11:25:22.952092721 +0000 UTC m=+24.708339098"
Sep 15 11:25:23.774334 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:23.774303    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:23.774514 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:23.774439    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:24.774531 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:24.774345    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:24.775069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:24.774345    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:24.775069 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:24.774639    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:24.775069 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:24.774678    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:24.941252 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:24.941223    2570 generic.go:356] "Generic (PLEG): container finished" podID="f140243f-0052-4d96-b1fe-fe0803ac135b" containerID="9784ab6cce26842822a00d37ed22a9f4266f98157f9ba1e638f686d9bae14657" exitCode=0
Sep 15 11:25:24.941420 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:24.941309    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmwfg" event={"ID":"f140243f-0052-4d96-b1fe-fe0803ac135b","Type":"ContainerDied","Data":"9784ab6cce26842822a00d37ed22a9f4266f98157f9ba1e638f686d9bae14657"}
Sep 15 11:25:24.945109 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:24.945085    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv" event={"ID":"ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d","Type":"ContainerStarted","Data":"730ab3446326c6ffbb3f792b59f70f31e8b4cb37025c4c70b682c7225eac8f55"}
Sep 15 11:25:24.945357 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:24.945338    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:24.945429 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:24.945403    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:24.959849 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:24.959820    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:24.959929 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:24.959917    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:24.988325 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:24.988279    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv" podStartSLOduration=8.378145299 podStartE2EDuration="25.988266449s" totalImagesPullingTime="17.61012115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:24.98787381 +0000 UTC m=+26.744120187" watchObservedRunningTime="2026-09-15 11:25:24.988266449 +0000 UTC m=+26.744512826"
Sep 15 11:25:25.774479 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:25.774447    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:25.774624 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:25.774572    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:25.947326 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:25.947301    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 15 11:25:26.172620 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:26.172588    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-clnqp"]
Sep 15 11:25:26.172779 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:26.172725    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:26.172838 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:26.172810    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:26.175425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:26.175389    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2gnj8"]
Sep 15 11:25:26.175545 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:26.175500    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:26.175638 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:26.175614    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:26.175974 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:26.175944    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7dh7b"]
Sep 15 11:25:26.176087 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:26.176037    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:26.176154 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:26.176134    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:26.205787 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:26.205761    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:26.950987 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:26.950954    2570 generic.go:356] "Generic (PLEG): container finished" podID="f140243f-0052-4d96-b1fe-fe0803ac135b" containerID="18ee129ea0289155c1e37230649d5edb73f84ee333d7b9799755eb3e660cc916" exitCode=0
Sep 15 11:25:26.951608 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:26.951037    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmwfg" event={"ID":"f140243f-0052-4d96-b1fe-fe0803ac135b","Type":"ContainerDied","Data":"18ee129ea0289155c1e37230649d5edb73f84ee333d7b9799755eb3e660cc916"}
Sep 15 11:25:27.773690 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:27.773661    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:27.773836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:27.773759    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:27.773836 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:27.773770    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:27.773836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:27.773787    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:27.773932 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:27.773858    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:27.773965 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:27.773925    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:28.958050 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:28.958022    2570 generic.go:356] "Generic (PLEG): container finished" podID="f140243f-0052-4d96-b1fe-fe0803ac135b" containerID="421a7c7b7c6dbe98752a4bbf17136655ac832342e74db15cc8c1d214d45de406" exitCode=0
Sep 15 11:25:28.958432 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:28.958074    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmwfg" event={"ID":"f140243f-0052-4d96-b1fe-fe0803ac135b","Type":"ContainerDied","Data":"421a7c7b7c6dbe98752a4bbf17136655ac832342e74db15cc8c1d214d45de406"}
Sep 15 11:25:29.773857 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:29.773827    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:29.774022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:29.773946    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:29.774022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:29.773961    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:29.774022 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:29.773954    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:29.774158 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:29.774051    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:29.774158 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:29.774114    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:31.774044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:31.774000    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:31.774624 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:31.774141    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:31.774624 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:31.774140    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clnqp" podUID="eeb30891-2c06-4839-9f72-3aa1b489b8b3"
Sep 15 11:25:31.774624 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:31.774266    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dh7b" podUID="05b2d78d-4daf-451e-8d23-dfd20c0e8abb"
Sep 15 11:25:31.774624 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:31.774291    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:31.774624 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:31.774380    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gnj8" podUID="e89114c8-5946-4fdc-b752-7568f994e251"
Sep 15 11:25:32.403306 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:32.403265    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:32.403492 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:32.403392    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:32.403492 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:32.403461    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs podName:05b2d78d-4daf-451e-8d23-dfd20c0e8abb nodeName:}" failed. No retries permitted until 2026-09-15 11:26:04.403443957 +0000 UTC m=+66.159690317 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs") pod "network-metrics-daemon-7dh7b" (UID: "05b2d78d-4daf-451e-8d23-dfd20c0e8abb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:32.503704 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:32.503671    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt549\" (UniqueName: \"kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549\") pod \"network-check-target-clnqp\" (UID: \"eeb30891-2c06-4839-9f72-3aa1b489b8b3\") " pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:32.503704 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:32.503705    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:32.503933 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:32.503849    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:32.503933 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:32.503915    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret podName:e89114c8-5946-4fdc-b752-7568f994e251 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:04.503901058 +0000 UTC m=+66.260147414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret") pod "global-pull-secret-syncer-2gnj8" (UID: "e89114c8-5946-4fdc-b752-7568f994e251") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:32.504031 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:32.503851    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:32.504031 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:32.503962    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:32.504031 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:32.503979    2570 projected.go:196] Error preparing data for projected volume kube-api-access-bt549 for pod openshift-network-diagnostics/network-check-target-clnqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:32.504147 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:32.504033    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549 podName:eeb30891-2c06-4839-9f72-3aa1b489b8b3 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:04.504019067 +0000 UTC m=+66.260265435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bt549" (UniqueName: "kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549") pod "network-check-target-clnqp" (UID: "eeb30891-2c06-4839-9f72-3aa1b489b8b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:32.970061 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:32.970033    2570 generic.go:356] "Generic (PLEG): container finished" podID="f140243f-0052-4d96-b1fe-fe0803ac135b" containerID="b9d3db84364a33383792c9c6b23056bcf3cd32d590be9c3d85bef0c18e04c724" exitCode=0
Sep 15 11:25:32.970332 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:32.970077    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmwfg" event={"ID":"f140243f-0052-4d96-b1fe-fe0803ac135b","Type":"ContainerDied","Data":"b9d3db84364a33383792c9c6b23056bcf3cd32d590be9c3d85bef0c18e04c724"}
Sep 15 11:25:33.058070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.058044    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-116.ec2.internal" event="NodeReady"
Sep 15 11:25:33.058214 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.058201    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 11:25:33.091169 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.091147    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7967fbf76-k4c72"]
Sep 15 11:25:33.093819 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.093801    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.096445 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.096412    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 11:25:33.096542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.096509    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 11:25:33.096702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.096577    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n56tl\""
Sep 15 11:25:33.096702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.096641    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 11:25:33.102043 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.102011    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 11:25:33.105595 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.105577    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qz727"]
Sep 15 11:25:33.108118 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.108102    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.109234 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.109211    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7967fbf76-k4c72"]
Sep 15 11:25:33.110821 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.110804    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 11:25:33.110913 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.110856    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 11:25:33.110913 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.110869    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2sd6\""
Sep 15 11:25:33.111754 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.111736    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tfnbf"]
Sep 15 11:25:33.114262 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.114236    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tfnbf"
Sep 15 11:25:33.116276 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.116259    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 11:25:33.116694 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.116679    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fs9cl\""
Sep 15 11:25:33.117122 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.117109    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 11:25:33.117173 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.117113    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 11:25:33.120809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.120673    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qz727"]
Sep 15 11:25:33.120809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.123064    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tfnbf"]
Sep 15 11:25:33.209725 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.209668    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a8f8849-55a5-4213-b482-83f452708e0f-config-volume\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.209725 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.209697    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-bound-sa-token\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.209881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.209732    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-image-registry-private-configuration\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.209881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.209747    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-trusted-ca\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.209881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.209830    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-installation-pull-secrets\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.210000 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.209894    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.210000 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.209927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-ca-trust-extracted\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.210000 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.209946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba9ce9cc-5e32-423e-83cc-a947cdd88641-cert\") pod \"ingress-canary-tfnbf\" (UID: \"ba9ce9cc-5e32-423e-83cc-a947cdd88641\") " pod="openshift-ingress-canary/ingress-canary-tfnbf"
Sep 15 11:25:33.210000 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.209966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.210000 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.209981    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbg5z\" (UniqueName: \"kubernetes.io/projected/ba9ce9cc-5e32-423e-83cc-a947cdd88641-kube-api-access-wbg5z\") pod \"ingress-canary-tfnbf\" (UID: \"ba9ce9cc-5e32-423e-83cc-a947cdd88641\") " pod="openshift-ingress-canary/ingress-canary-tfnbf"
Sep 15 11:25:33.210000 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.209997    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a8f8849-55a5-4213-b482-83f452708e0f-tmp-dir\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.210189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.210017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m84ws\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-kube-api-access-m84ws\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.210189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.210035    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qjbt\" (UniqueName: \"kubernetes.io/projected/4a8f8849-55a5-4213-b482-83f452708e0f-kube-api-access-9qjbt\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.210189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.210100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-certificates\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.246727 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.246706    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:33.311217 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311196    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-image-registry-private-configuration\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.311315 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311224    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-trusted-ca\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.311315 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311248    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-installation-pull-secrets\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.311315 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.311462 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311320    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-ca-trust-extracted\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.311462 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311344    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba9ce9cc-5e32-423e-83cc-a947cdd88641-cert\") pod \"ingress-canary-tfnbf\" (UID: \"ba9ce9cc-5e32-423e-83cc-a947cdd88641\") " pod="openshift-ingress-canary/ingress-canary-tfnbf"
Sep 15 11:25:33.311462 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311374    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.311462 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311398    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbg5z\" (UniqueName: \"kubernetes.io/projected/ba9ce9cc-5e32-423e-83cc-a947cdd88641-kube-api-access-wbg5z\") pod \"ingress-canary-tfnbf\" (UID: \"ba9ce9cc-5e32-423e-83cc-a947cdd88641\") " pod="openshift-ingress-canary/ingress-canary-tfnbf"
Sep 15 11:25:33.311462 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:33.311402    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:25:33.311462 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:33.311415    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7967fbf76-k4c72: secret "image-registry-tls" not found
Sep 15 11:25:33.311462 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a8f8849-55a5-4213-b482-83f452708e0f-tmp-dir\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.311462 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m84ws\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-kube-api-access-m84ws\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.311821 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:33.311466    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:25:33.311821 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:33.311475    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls podName:e395cb69-cd43-4294-bbdc-a0b3a42bcd38 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:33.811457674 +0000 UTC m=+35.567704033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls") pod "image-registry-7967fbf76-k4c72" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38") : secret "image-registry-tls" not found
Sep 15 11:25:33.311821 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311509    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qjbt\" (UniqueName: \"kubernetes.io/projected/4a8f8849-55a5-4213-b482-83f452708e0f-kube-api-access-9qjbt\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.311821 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:33.311519    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls podName:4a8f8849-55a5-4213-b482-83f452708e0f nodeName:}" failed. No retries permitted until 2026-09-15 11:25:33.811505795 +0000 UTC m=+35.567752165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls") pod "dns-default-qz727" (UID: "4a8f8849-55a5-4213-b482-83f452708e0f") : secret "dns-default-metrics-tls" not found
Sep 15 11:25:33.311821 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311574    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-certificates\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.311821 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311609    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a8f8849-55a5-4213-b482-83f452708e0f-config-volume\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.311821 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.311635    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-bound-sa-token\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.312133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.312017    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a8f8849-55a5-4213-b482-83f452708e0f-tmp-dir\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.312179 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.312135    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-ca-trust-extracted\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.312235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.312217    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-certificates\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.312288 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.312221    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a8f8849-55a5-4213-b482-83f452708e0f-config-volume\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.312902 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.312763    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-trusted-ca\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.315495 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.315473    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-installation-pull-secrets\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.315584 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.315477    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-image-registry-private-configuration\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.315584 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.315530    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba9ce9cc-5e32-423e-83cc-a947cdd88641-cert\") pod \"ingress-canary-tfnbf\" (UID: \"ba9ce9cc-5e32-423e-83cc-a947cdd88641\") " pod="openshift-ingress-canary/ingress-canary-tfnbf"
Sep 15 11:25:33.319813 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.319757    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-bound-sa-token\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.319813 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.319763    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbg5z\" (UniqueName: \"kubernetes.io/projected/ba9ce9cc-5e32-423e-83cc-a947cdd88641-kube-api-access-wbg5z\") pod \"ingress-canary-tfnbf\" (UID: \"ba9ce9cc-5e32-423e-83cc-a947cdd88641\") " pod="openshift-ingress-canary/ingress-canary-tfnbf"
Sep 15 11:25:33.320165 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.320147    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qjbt\" (UniqueName: \"kubernetes.io/projected/4a8f8849-55a5-4213-b482-83f452708e0f-kube-api-access-9qjbt\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.320379 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.320355    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m84ws\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-kube-api-access-m84ws\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.330432 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.330404    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:33.448158 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.448131    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tfnbf"
Sep 15 11:25:33.722955 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.722922    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tfnbf"]
Sep 15 11:25:33.727437 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:33.727414    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9ce9cc_5e32_423e_83cc_a947cdd88641.slice/crio-699f9077e697b99c3a647165660657032cd46242909c5075d2a7aab9dc21463f WatchSource:0}: Error finding container 699f9077e697b99c3a647165660657032cd46242909c5075d2a7aab9dc21463f: Status 404 returned error can't find the container with id 699f9077e697b99c3a647165660657032cd46242909c5075d2a7aab9dc21463f
Sep 15 11:25:33.774142 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.774121    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:25:33.774246 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.774121    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:25:33.774369 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.774122    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:25:33.776972 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.776957    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:25:33.778021 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.778002    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:25:33.778211 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.778196    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:25:33.778307 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.778290    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q47md\""
Sep 15 11:25:33.778373 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.778359    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:25:33.778373 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.778368    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mvt2n\""
Sep 15 11:25:33.815862 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.815840    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:33.815940 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.815906    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:33.816000 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:33.815984    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:25:33.816035 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:33.816011    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:25:33.816035 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:33.816021    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7967fbf76-k4c72: secret "image-registry-tls" not found
Sep 15 11:25:33.816097 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:33.816039    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls podName:4a8f8849-55a5-4213-b482-83f452708e0f nodeName:}" failed. No retries permitted until 2026-09-15 11:25:34.816024615 +0000 UTC m=+36.572270976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls") pod "dns-default-qz727" (UID: "4a8f8849-55a5-4213-b482-83f452708e0f") : secret "dns-default-metrics-tls" not found
Sep 15 11:25:33.816097 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:33.816056    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls podName:e395cb69-cd43-4294-bbdc-a0b3a42bcd38 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:34.816046614 +0000 UTC m=+36.572292970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls") pod "image-registry-7967fbf76-k4c72" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38") : secret "image-registry-tls" not found
Sep 15 11:25:33.974985 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.974950    2570 generic.go:356] "Generic (PLEG): container finished" podID="f140243f-0052-4d96-b1fe-fe0803ac135b" containerID="3feeaf4440eaa8f63f7fafb451b93d58993cb9a6d4cdba2f85f07637724d7a0f" exitCode=0
Sep 15 11:25:33.975636 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.975027    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmwfg" event={"ID":"f140243f-0052-4d96-b1fe-fe0803ac135b","Type":"ContainerDied","Data":"3feeaf4440eaa8f63f7fafb451b93d58993cb9a6d4cdba2f85f07637724d7a0f"}
Sep 15 11:25:33.976090 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:33.976067    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tfnbf" event={"ID":"ba9ce9cc-5e32-423e-83cc-a947cdd88641","Type":"ContainerStarted","Data":"699f9077e697b99c3a647165660657032cd46242909c5075d2a7aab9dc21463f"}
Sep 15 11:25:34.823660 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:34.823628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:34.823854 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:34.823729    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:34.823854 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:34.823783    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:25:34.823854 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:34.823833    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:25:34.823996 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:34.823856    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls podName:4a8f8849-55a5-4213-b482-83f452708e0f nodeName:}" failed. No retries permitted until 2026-09-15 11:25:36.823836706 +0000 UTC m=+38.580083075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls") pod "dns-default-qz727" (UID: "4a8f8849-55a5-4213-b482-83f452708e0f") : secret "dns-default-metrics-tls" not found
Sep 15 11:25:34.823996 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:34.823858    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7967fbf76-k4c72: secret "image-registry-tls" not found
Sep 15 11:25:34.823996 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:34.823899    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls podName:e395cb69-cd43-4294-bbdc-a0b3a42bcd38 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:36.823889876 +0000 UTC m=+38.580136246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls") pod "image-registry-7967fbf76-k4c72" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38") : secret "image-registry-tls" not found
Sep 15 11:25:34.982311 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:34.982108    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmwfg" event={"ID":"f140243f-0052-4d96-b1fe-fe0803ac135b","Type":"ContainerStarted","Data":"39eacf74c5bc4f79d15727f78f24a2072e095c9e9cc1c3f017a984740dee1214"}
Sep 15 11:25:35.006454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:35.005795    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xmwfg" podStartSLOduration=9.289443619 podStartE2EDuration="37.005769993s" totalImagesPullingTime="27.716326374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:24:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:35.003843458 +0000 UTC m=+36.760089838" watchObservedRunningTime="2026-09-15 11:25:35.005769993 +0000 UTC m=+36.762016374"
Sep 15 11:25:35.124822 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:35.124724    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:35.226658 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:35.226620    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:36.839188 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:36.839151    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:36.839188 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:36.839188    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:36.839654 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:36.839278    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:25:36.839654 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:36.839292    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:25:36.839654 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:36.839309    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7967fbf76-k4c72: secret "image-registry-tls" not found
Sep 15 11:25:36.839654 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:36.839328    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls podName:4a8f8849-55a5-4213-b482-83f452708e0f nodeName:}" failed. No retries permitted until 2026-09-15 11:25:40.839314774 +0000 UTC m=+42.595561130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls") pod "dns-default-qz727" (UID: "4a8f8849-55a5-4213-b482-83f452708e0f") : secret "dns-default-metrics-tls" not found
Sep 15 11:25:36.839654 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:36.839352    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls podName:e395cb69-cd43-4294-bbdc-a0b3a42bcd38 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:40.839340681 +0000 UTC m=+42.595587037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls") pod "image-registry-7967fbf76-k4c72" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38") : secret "image-registry-tls" not found
Sep 15 11:25:36.988544 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:36.988509    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tfnbf" event={"ID":"ba9ce9cc-5e32-423e-83cc-a947cdd88641","Type":"ContainerStarted","Data":"5153db30ba1ada48542be6a262910e863ee9f4a4dd21d7c4d7b58251be374e28"}
Sep 15 11:25:37.005650 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:37.005601    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tfnbf" podStartSLOduration=1.477361618 podStartE2EDuration="4.005582453s" totalImagesPullingTime="2.528220835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:37.005229686 +0000 UTC m=+38.761476077" watchObservedRunningTime="2026-09-15 11:25:37.005582453 +0000 UTC m=+38.761828832"
Sep 15 11:25:37.576751 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:37.576721    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:37.630587 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:37.630536    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:40.180120 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.180089    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ckmzf"]
Sep 15 11:25:40.220063 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.220029    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ckmzf"]
Sep 15 11:25:40.220221 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.220174    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ckmzf"
Sep 15 11:25:40.222940 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.222914    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lh4pp\""
Sep 15 11:25:40.223024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.222953    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:25:40.223077 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.222954    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 15 11:25:40.224599 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.224575    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:40.285165 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.285133    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"]
Sep 15 11:25:40.301675 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.301644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:40.303641 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.303622    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"]
Sep 15 11:25:40.303763 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.303743    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:25:40.307049 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.307030    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2l452\""
Sep 15 11:25:40.307296 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.307279    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 15 11:25:40.307390 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.307313    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 15 11:25:40.307451 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.307401    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:25:40.367050 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.367014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d5rp\" (UniqueName: \"kubernetes.io/projected/47eb8d3a-6c40-441d-bdb4-073735e5922b-kube-api-access-9d5rp\") pod \"volume-data-source-validator-86695b7cc7-ckmzf\" (UID: \"47eb8d3a-6c40-441d-bdb4-073735e5922b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ckmzf"
Sep 15 11:25:40.384742 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.384711    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"]
Sep 15 11:25:40.405756 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.405730    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"]
Sep 15 11:25:40.405923 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.405831    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:25:40.408117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.408099    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zxjst\""
Sep 15 11:25:40.408223 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.408182    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 15 11:25:40.408267 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.408187    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 15 11:25:40.467806 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.467728    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d5rp\" (UniqueName: \"kubernetes.io/projected/47eb8d3a-6c40-441d-bdb4-073735e5922b-kube-api-access-9d5rp\") pod \"volume-data-source-validator-86695b7cc7-ckmzf\" (UID: \"47eb8d3a-6c40-441d-bdb4-073735e5922b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ckmzf"
Sep 15 11:25:40.467806 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.467786    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r92c\" (UniqueName: \"kubernetes.io/projected/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-kube-api-access-4r92c\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:25:40.467974 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.467816    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:25:40.477190 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.477164    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d5rp\" (UniqueName: \"kubernetes.io/projected/47eb8d3a-6c40-441d-bdb4-073735e5922b-kube-api-access-9d5rp\") pod \"volume-data-source-validator-86695b7cc7-ckmzf\" (UID: \"47eb8d3a-6c40-441d-bdb4-073735e5922b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ckmzf"
Sep 15 11:25:40.515250 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.515212    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:40.529055 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.529033    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ckmzf"
Sep 15 11:25:40.568402 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.568374    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r92c\" (UniqueName: \"kubernetes.io/projected/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-kube-api-access-4r92c\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:25:40.568519 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.568417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:25:40.568519 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.568449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:25:40.568519 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.568478    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/499b0286-0e77-4a9e-b576-9d4b2c224b93-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:25:40.568668 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:40.568620    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 11:25:40.568725 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:40.568712    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls podName:d8d50b4f-8b14-4ed7-821f-85f75eb1d70d nodeName:}" failed. No retries permitted until 2026-09-15 11:25:41.068691623 +0000 UTC m=+42.824937996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-7pqpn" (UID: "d8d50b4f-8b14-4ed7-821f-85f75eb1d70d") : secret "samples-operator-tls" not found
Sep 15 11:25:40.579513 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.579486    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r92c\" (UniqueName: \"kubernetes.io/projected/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-kube-api-access-4r92c\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:25:40.616121 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.616089    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:40.669358 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.669322    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:25:40.669358 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.669359    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/499b0286-0e77-4a9e-b576-9d4b2c224b93-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:25:40.669618 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:40.669493    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 11:25:40.669618 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:40.669592    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert podName:499b0286-0e77-4a9e-b576-9d4b2c224b93 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:41.169550727 +0000 UTC m=+42.925797083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-q6tjj" (UID: "499b0286-0e77-4a9e-b576-9d4b2c224b93") : secret "networking-console-plugin-cert" not found
Sep 15 11:25:40.669990 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.669972    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/499b0286-0e77-4a9e-b576-9d4b2c224b93-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:25:40.809246 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.809217    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ckmzf"]
Sep 15 11:25:40.812076 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:40.812046    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47eb8d3a_6c40_441d_bdb4_073735e5922b.slice/crio-e416155d9483a5e40d92e4220403c11831bb8a6653c4085de89f2c2c3afc1248 WatchSource:0}: Error finding container e416155d9483a5e40d92e4220403c11831bb8a6653c4085de89f2c2c3afc1248: Status 404 returned error can't find the container with id e416155d9483a5e40d92e4220403c11831bb8a6653c4085de89f2c2c3afc1248
Sep 15 11:25:40.871069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.871039    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:40.871179 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.871139    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:40.871234 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:40.871185    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:25:40.871234 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:40.871217    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:25:40.871234 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:40.871227    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7967fbf76-k4c72: secret "image-registry-tls" not found
Sep 15 11:25:40.871329 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:40.871244    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls podName:4a8f8849-55a5-4213-b482-83f452708e0f nodeName:}" failed. No retries permitted until 2026-09-15 11:25:48.871228173 +0000 UTC m=+50.627474529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls") pod "dns-default-qz727" (UID: "4a8f8849-55a5-4213-b482-83f452708e0f") : secret "dns-default-metrics-tls" not found
Sep 15 11:25:40.871329 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:40.871262    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls podName:e395cb69-cd43-4294-bbdc-a0b3a42bcd38 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:48.871250885 +0000 UTC m=+50.627497241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls") pod "image-registry-7967fbf76-k4c72" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38") : secret "image-registry-tls" not found
Sep 15 11:25:40.998347 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:40.998317    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ckmzf" event={"ID":"47eb8d3a-6c40-441d-bdb4-073735e5922b","Type":"ContainerStarted","Data":"e416155d9483a5e40d92e4220403c11831bb8a6653c4085de89f2c2c3afc1248"}
Sep 15 11:25:41.071973 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:41.071909    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:25:41.072176 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:41.072044    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 11:25:41.072176 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:41.072104    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls podName:d8d50b4f-8b14-4ed7-821f-85f75eb1d70d nodeName:}" failed. No retries permitted until 2026-09-15 11:25:42.072087153 +0000 UTC m=+43.828333526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-7pqpn" (UID: "d8d50b4f-8b14-4ed7-821f-85f75eb1d70d") : secret "samples-operator-tls" not found
Sep 15 11:25:41.172904 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:41.172872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:25:41.173011 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:41.172988    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 11:25:41.173048 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:41.173034    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert podName:499b0286-0e77-4a9e-b576-9d4b2c224b93 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:42.173021775 +0000 UTC m=+43.929268131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-q6tjj" (UID: "499b0286-0e77-4a9e-b576-9d4b2c224b93") : secret "networking-console-plugin-cert" not found
Sep 15 11:25:42.079890 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:42.079851    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:25:42.080258 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:42.079971    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 11:25:42.080258 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:42.080022    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls podName:d8d50b4f-8b14-4ed7-821f-85f75eb1d70d nodeName:}" failed. No retries permitted until 2026-09-15 11:25:44.080008626 +0000 UTC m=+45.836254982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-7pqpn" (UID: "d8d50b4f-8b14-4ed7-821f-85f75eb1d70d") : secret "samples-operator-tls" not found
Sep 15 11:25:42.180838 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:42.180802    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:25:42.180985 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:42.180957    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 11:25:42.181035 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:42.181021    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert podName:499b0286-0e77-4a9e-b576-9d4b2c224b93 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:44.181004065 +0000 UTC m=+45.937250421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-q6tjj" (UID: "499b0286-0e77-4a9e-b576-9d4b2c224b93") : secret "networking-console-plugin-cert" not found
Sep 15 11:25:43.004961 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:43.004923    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ckmzf" event={"ID":"47eb8d3a-6c40-441d-bdb4-073735e5922b","Type":"ContainerStarted","Data":"9d3b04e9b3b67edf8f3cd2cce0dce54aa22c96f94961d201b198efd8c4beb51f"}
Sep 15 11:25:43.019419 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:43.019369    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ckmzf" podStartSLOduration=1.590181219 podStartE2EDuration="3.019354046s" totalImagesPullingTime="1.429172827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:43.019305411 +0000 UTC m=+44.775551791" watchObservedRunningTime="2026-09-15 11:25:43.019354046 +0000 UTC m=+44.775600424"
Sep 15 11:25:43.127471 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:43.127419    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:43.228173 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:43.228142    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:43.405370 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:43.405337    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:43.474125 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:43.474094    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:43.570420 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:43.570393    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:44.095840 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:44.095808    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:25:44.096001 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:44.095940    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 11:25:44.096001 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:44.096000    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls podName:d8d50b4f-8b14-4ed7-821f-85f75eb1d70d nodeName:}" failed. No retries permitted until 2026-09-15 11:25:48.095986021 +0000 UTC m=+49.852232377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-7pqpn" (UID: "d8d50b4f-8b14-4ed7-821f-85f75eb1d70d") : secret "samples-operator-tls" not found
Sep 15 11:25:44.197015 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:44.196984    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:25:44.197338 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:44.197108    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 11:25:44.197338 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:44.197166    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert podName:499b0286-0e77-4a9e-b576-9d4b2c224b93 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:48.197151416 +0000 UTC m=+49.953397773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-q6tjj" (UID: "499b0286-0e77-4a9e-b576-9d4b2c224b93") : secret "networking-console-plugin-cert" not found
Sep 15 11:25:44.510404 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:44.510373    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:44.591029 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:44.591000    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:45.615683 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:45.615648    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:46.468836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:46.468799    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:46.522798 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:46.522770    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:48.122082 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:48.122050    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:25:48.122425 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:48.122189    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 11:25:48.122425 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:48.122243    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls podName:d8d50b4f-8b14-4ed7-821f-85f75eb1d70d nodeName:}" failed. No retries permitted until 2026-09-15 11:25:56.122230207 +0000 UTC m=+57.878476564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-7pqpn" (UID: "d8d50b4f-8b14-4ed7-821f-85f75eb1d70d") : secret "samples-operator-tls" not found
Sep 15 11:25:48.223118 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:48.223092    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:25:48.223228 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:48.223182    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 11:25:48.223228 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:48.223224    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert podName:499b0286-0e77-4a9e-b576-9d4b2c224b93 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:56.22321398 +0000 UTC m=+57.979460337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-q6tjj" (UID: "499b0286-0e77-4a9e-b576-9d4b2c224b93") : secret "networking-console-plugin-cert" not found
Sep 15 11:25:48.387980 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:48.387906    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:48.927532 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:48.927499    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:25:48.927532 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:48.927538    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:25:48.927741 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:48.927644    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:25:48.927741 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:48.927653    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:25:48.927741 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:48.927661    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7967fbf76-k4c72: secret "image-registry-tls" not found
Sep 15 11:25:48.927741 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:48.927716    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls podName:4a8f8849-55a5-4213-b482-83f452708e0f nodeName:}" failed. No retries permitted until 2026-09-15 11:26:04.927704171 +0000 UTC m=+66.683950528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls") pod "dns-default-qz727" (UID: "4a8f8849-55a5-4213-b482-83f452708e0f") : secret "dns-default-metrics-tls" not found
Sep 15 11:25:48.927741 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:48.927728    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls podName:e395cb69-cd43-4294-bbdc-a0b3a42bcd38 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:04.92772293 +0000 UTC m=+66.683969286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls") pod "image-registry-7967fbf76-k4c72" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38") : secret "image-registry-tls" not found
Sep 15 11:25:52.072311 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.072279    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:52.083605 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.083580    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg"]
Sep 15 11:25:52.085489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.085469    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg"
Sep 15 11:25:52.088203 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.088185    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 15 11:25:52.088287 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.088231    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nkqpw\""
Sep 15 11:25:52.089069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.089053    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 15 11:25:52.096767 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.096746    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg"]
Sep 15 11:25:52.166571 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.166519    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:52.253600 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.253576    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47g9\" (UniqueName: \"kubernetes.io/projected/289effb1-ed78-47a8-aa75-176886152757-kube-api-access-b47g9\") pod \"migrator-8b4d697c5-z6mxg\" (UID: \"289effb1-ed78-47a8-aa75-176886152757\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg"
Sep 15 11:25:52.265775 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.265745    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:52.321314 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.321289    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:52.354701 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.354654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47g9\" (UniqueName: \"kubernetes.io/projected/289effb1-ed78-47a8-aa75-176886152757-kube-api-access-b47g9\") pod \"migrator-8b4d697c5-z6mxg\" (UID: \"289effb1-ed78-47a8-aa75-176886152757\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg"
Sep 15 11:25:52.363197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.363168    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47g9\" (UniqueName: \"kubernetes.io/projected/289effb1-ed78-47a8-aa75-176886152757-kube-api-access-b47g9\") pod \"migrator-8b4d697c5-z6mxg\" (UID: \"289effb1-ed78-47a8-aa75-176886152757\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg"
Sep 15 11:25:52.394186 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.394158    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg"
Sep 15 11:25:52.659936 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.659870    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg"]
Sep 15 11:25:52.662465 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:52.662436    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289effb1_ed78_47a8_aa75_176886152757.slice/crio-65080af0d72295487b8f6636462432075b3ff6b632cad9703103d5bfbacf20f3 WatchSource:0}: Error finding container 65080af0d72295487b8f6636462432075b3ff6b632cad9703103d5bfbacf20f3: Status 404 returned error can't find the container with id 65080af0d72295487b8f6636462432075b3ff6b632cad9703103d5bfbacf20f3
Sep 15 11:25:52.736939 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.736906    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:52.832512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.832485    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:52.835727 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.835708    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-whksv"]
Sep 15 11:25:52.838467 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.838453    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:52.841169 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.841152    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 11:25:52.841354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.841332    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 11:25:52.841464 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.841367    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jd6pn\""
Sep 15 11:25:52.841464 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.841379    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 11:25:52.842650 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.842627    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 11:25:52.849589 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.849551    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-whksv"]
Sep 15 11:25:52.959286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.959224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:52.959383 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.959328    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06f38fb1-df45-4e79-982f-0c027386144c-data-volume\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:52.959447 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.959389    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:52.959447 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.959415    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjtb\" (UniqueName: \"kubernetes.io/projected/06f38fb1-df45-4e79-982f-0c027386144c-kube-api-access-6vjtb\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:52.959532 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:52.959444    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06f38fb1-df45-4e79-982f-0c027386144c-crio-socket\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:53.027323 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:53.027300    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg" event={"ID":"289effb1-ed78-47a8-aa75-176886152757","Type":"ContainerStarted","Data":"65080af0d72295487b8f6636462432075b3ff6b632cad9703103d5bfbacf20f3"}
Sep 15 11:25:53.061189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:53.060673    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06f38fb1-df45-4e79-982f-0c027386144c-data-volume\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:53.061189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:53.060718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:53.061189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:53.060739    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjtb\" (UniqueName: \"kubernetes.io/projected/06f38fb1-df45-4e79-982f-0c027386144c-kube-api-access-6vjtb\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:53.061189 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:53.060802    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:25:53.061189 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:53.060873    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm podName:06f38fb1-df45-4e79-982f-0c027386144c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:53.560856967 +0000 UTC m=+55.317103323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-whksv" (UID: "06f38fb1-df45-4e79-982f-0c027386144c") : configmap "kube-rbac-proxy" not found
Sep 15 11:25:53.061189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:53.060906    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06f38fb1-df45-4e79-982f-0c027386144c-crio-socket\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:53.061189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:53.060960    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:53.061189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:53.061018    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06f38fb1-df45-4e79-982f-0c027386144c-crio-socket\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:53.061189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:53.061021    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06f38fb1-df45-4e79-982f-0c027386144c-data-volume\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:53.061189 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:53.061057    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:25:53.061189 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:53.061113    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls podName:06f38fb1-df45-4e79-982f-0c027386144c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:53.561098138 +0000 UTC m=+55.317344523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-whksv" (UID: "06f38fb1-df45-4e79-982f-0c027386144c") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:25:53.068754 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:53.068732    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjtb\" (UniqueName: \"kubernetes.io/projected/06f38fb1-df45-4e79-982f-0c027386144c-kube-api-access-6vjtb\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:53.566475 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:53.566444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:53.566878 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:53.566572    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:53.566878 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:53.566638    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:25:53.566878 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:53.566652    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:25:53.566878 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:53.566712    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm podName:06f38fb1-df45-4e79-982f-0c027386144c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:54.566697688 +0000 UTC m=+56.322944045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-whksv" (UID: "06f38fb1-df45-4e79-982f-0c027386144c") : configmap "kube-rbac-proxy" not found
Sep 15 11:25:53.566878 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:53.566724    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls podName:06f38fb1-df45-4e79-982f-0c027386144c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:54.566718659 +0000 UTC m=+56.322965015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-whksv" (UID: "06f38fb1-df45-4e79-982f-0c027386144c") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:25:54.031732 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.031697    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg" event={"ID":"289effb1-ed78-47a8-aa75-176886152757","Type":"ContainerStarted","Data":"c348831356368f32b76af2b3ba26126a1b8413eb2dee121ca2dc2962d56bb007"}
Sep 15 11:25:54.031882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.031749    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg" event={"ID":"289effb1-ed78-47a8-aa75-176886152757","Type":"ContainerStarted","Data":"5893e315a12561cc373d8f4f12e258e7c3697aff76001d54dc744f9ec7fa09c7"}
Sep 15 11:25:54.046763 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.046718    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z6mxg" podStartSLOduration=0.951667469 podStartE2EDuration="2.04670371s" totalImagesPullingTime="1.095036241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:54.046032019 +0000 UTC m=+55.802278408" watchObservedRunningTime="2026-09-15 11:25:54.04670371 +0000 UTC m=+55.802950087"
Sep 15 11:25:54.411549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.411508    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:54.468915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.468889    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:54.575666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.575639    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:54.575958 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.575685    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:54.575958 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:54.575758    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:25:54.575958 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:54.575782    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:25:54.575958 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:54.575819    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm podName:06f38fb1-df45-4e79-982f-0c027386144c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:56.575802616 +0000 UTC m=+58.332048987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-whksv" (UID: "06f38fb1-df45-4e79-982f-0c027386144c") : configmap "kube-rbac-proxy" not found
Sep 15 11:25:54.575958 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:54.575832    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls podName:06f38fb1-df45-4e79-982f-0c027386144c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:56.575826791 +0000 UTC m=+58.332073148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-whksv" (UID: "06f38fb1-df45-4e79-982f-0c027386144c") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:25:54.610367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.610346    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-hk4kl"]
Sep 15 11:25:54.613229 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.613215    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-hk4kl"
Sep 15 11:25:54.615883 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.615865    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 15 11:25:54.616159 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.616145    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 15 11:25:54.617045 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.617029    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 15 11:25:54.617124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.617035    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 15 11:25:54.617124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.617035    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wfcm4\""
Sep 15 11:25:54.622346 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.622327    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-hk4kl"]
Sep 15 11:25:54.652067 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.652043    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:54.709685 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.709631    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:54.777952 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.777928    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9-signing-key\") pod \"service-ca-568869fdc5-hk4kl\" (UID: \"34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9\") " pod="openshift-service-ca/service-ca-568869fdc5-hk4kl"
Sep 15 11:25:54.778027 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.777959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9-signing-cabundle\") pod \"service-ca-568869fdc5-hk4kl\" (UID: \"34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9\") " pod="openshift-service-ca/service-ca-568869fdc5-hk4kl"
Sep 15 11:25:54.778104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.778088    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bwdk\" (UniqueName: \"kubernetes.io/projected/34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9-kube-api-access-2bwdk\") pod \"service-ca-568869fdc5-hk4kl\" (UID: \"34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9\") " pod="openshift-service-ca/service-ca-568869fdc5-hk4kl"
Sep 15 11:25:54.878329 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.878304    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bwdk\" (UniqueName: \"kubernetes.io/projected/34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9-kube-api-access-2bwdk\") pod \"service-ca-568869fdc5-hk4kl\" (UID: \"34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9\") " pod="openshift-service-ca/service-ca-568869fdc5-hk4kl"
Sep 15 11:25:54.878416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.878355    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9-signing-key\") pod \"service-ca-568869fdc5-hk4kl\" (UID: \"34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9\") " pod="openshift-service-ca/service-ca-568869fdc5-hk4kl"
Sep 15 11:25:54.878416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.878370    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9-signing-cabundle\") pod \"service-ca-568869fdc5-hk4kl\" (UID: \"34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9\") " pod="openshift-service-ca/service-ca-568869fdc5-hk4kl"
Sep 15 11:25:54.879040 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.879020    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9-signing-cabundle\") pod \"service-ca-568869fdc5-hk4kl\" (UID: \"34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9\") " pod="openshift-service-ca/service-ca-568869fdc5-hk4kl"
Sep 15 11:25:54.880512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.880492    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9-signing-key\") pod \"service-ca-568869fdc5-hk4kl\" (UID: \"34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9\") " pod="openshift-service-ca/service-ca-568869fdc5-hk4kl"
Sep 15 11:25:54.887938 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.887921    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bwdk\" (UniqueName: \"kubernetes.io/projected/34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9-kube-api-access-2bwdk\") pod \"service-ca-568869fdc5-hk4kl\" (UID: \"34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9\") " pod="openshift-service-ca/service-ca-568869fdc5-hk4kl"
Sep 15 11:25:54.921706 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:54.921679    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-hk4kl"
Sep 15 11:25:55.011286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:55.011263    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8gtj9_450a1f25-d9e7-4c3e-9a2f-106752daca9d/dns-node-resolver/0.log"
Sep 15 11:25:55.191585 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:55.190398    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-hk4kl"]
Sep 15 11:25:55.194983 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:25:55.194959    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b4d2a4_d3d4_42b7_a285_bb8acaebdaa9.slice/crio-656848b16c679468bcf3893b958920b3810b852bc3b13cd500caf32fdbb31835 WatchSource:0}: Error finding container 656848b16c679468bcf3893b958920b3810b852bc3b13cd500caf32fdbb31835: Status 404 returned error can't find the container with id 656848b16c679468bcf3893b958920b3810b852bc3b13cd500caf32fdbb31835
Sep 15 11:25:55.636460 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:55.636431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:56.011205 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:56.011178    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-889s2_71a45129-8300-4e2f-83fc-138206ef4396/node-ca/0.log"
Sep 15 11:25:56.037346 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:56.037308    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-hk4kl" event={"ID":"34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9","Type":"ContainerStarted","Data":"656848b16c679468bcf3893b958920b3810b852bc3b13cd500caf32fdbb31835"}
Sep 15 11:25:56.188749 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:56.188711    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:25:56.188911 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:56.188874    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 11:25:56.188982 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:56.188971    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls podName:d8d50b4f-8b14-4ed7-821f-85f75eb1d70d nodeName:}" failed. No retries permitted until 2026-09-15 11:26:12.188948497 +0000 UTC m=+73.945194869 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-7pqpn" (UID: "d8d50b4f-8b14-4ed7-821f-85f75eb1d70d") : secret "samples-operator-tls" not found
Sep 15 11:25:56.289291 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:56.289214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:25:56.289428 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:56.289361    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 11:25:56.289473 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:56.289439    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert podName:499b0286-0e77-4a9e-b576-9d4b2c224b93 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:12.289420504 +0000 UTC m=+74.045666866 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-q6tjj" (UID: "499b0286-0e77-4a9e-b576-9d4b2c224b93") : secret "networking-console-plugin-cert" not found
Sep 15 11:25:56.591869 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:56.591792    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:56.592007 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:56.591871    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:25:56.592007 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:56.591890    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:25:56.592007 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:56.591964    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm podName:06f38fb1-df45-4e79-982f-0c027386144c nodeName:}" failed. No retries permitted until 2026-09-15 11:26:00.591943357 +0000 UTC m=+62.348189733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-whksv" (UID: "06f38fb1-df45-4e79-982f-0c027386144c") : configmap "kube-rbac-proxy" not found
Sep 15 11:25:56.592142 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:56.592013    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:25:56.592142 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:25:56.592067    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls podName:06f38fb1-df45-4e79-982f-0c027386144c nodeName:}" failed. No retries permitted until 2026-09-15 11:26:00.592052309 +0000 UTC m=+62.348298683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-whksv" (UID: "06f38fb1-df45-4e79-982f-0c027386144c") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:25:57.011766 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:57.011733    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tfnbf_ba9ce9cc-5e32-423e-83cc-a947cdd88641/serve-healthcheck-canary/0.log"
Sep 15 11:25:57.211375 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:57.211345    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-z6mxg_289effb1-ed78-47a8-aa75-176886152757/migrator/0.log"
Sep 15 11:25:57.413745 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:57.413679    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-z6mxg_289effb1-ed78-47a8-aa75-176886152757/graceful-termination/0.log"
Sep 15 11:25:57.969027 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:57.969006    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-psfsv"
Sep 15 11:25:58.044051 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:58.044022    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-hk4kl" event={"ID":"34b4d2a4-d3d4-42b7-a285-bb8acaebdaa9","Type":"ContainerStarted","Data":"cacc6aebd83b26e8f15f0262a6253d748cac9a12d3aa336f068d6dedbc8e06a9"}
Sep 15 11:25:58.059497 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:58.059455    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-hk4kl" podStartSLOduration=1.709877851 podStartE2EDuration="4.059441301s" totalImagesPullingTime="2.34956345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:58.058633148 +0000 UTC m=+59.814879525" watchObservedRunningTime="2026-09-15 11:25:58.059441301 +0000 UTC m=+59.815687726"
Sep 15 11:25:59.025924 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:59.025887    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:59.137130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:59.137097    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:59.235037 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:59.235005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:59.303286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:59.303199    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:59.388493 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:59.388458    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:59.729739 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:59.729660    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:25:59.829659 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:25:59.829620    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:00.277598 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:00.277543    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:00.522988 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:00.522943    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:00.623111 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:00.623046    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:26:00.623111 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:00.623090    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:26:00.623271 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:00.623173    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:26:00.623271 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:00.623193    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:26:00.623271 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:00.623238    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls podName:06f38fb1-df45-4e79-982f-0c027386144c nodeName:}" failed. No retries permitted until 2026-09-15 11:26:08.623224875 +0000 UTC m=+70.379471231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-whksv" (UID: "06f38fb1-df45-4e79-982f-0c027386144c") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:26:00.623271 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:00.623251    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm podName:06f38fb1-df45-4e79-982f-0c027386144c nodeName:}" failed. No retries permitted until 2026-09-15 11:26:08.623243919 +0000 UTC m=+70.379490276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-whksv" (UID: "06f38fb1-df45-4e79-982f-0c027386144c") : configmap "kube-rbac-proxy" not found
Sep 15 11:26:00.757228 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:00.757193    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:01.315732 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:01.315696    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:01.720594 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:01.720488    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:02.119638 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:02.119600    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:02.319724 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:02.319690    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:02.714378 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:02.714340    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:02.819114 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:02.819066    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:02.915517 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:02.915489    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:03.519818 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:03.519770    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:03.720266 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:03.720233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:03.773099 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:03.773004    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:04.118104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.118016    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:04.316116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.316086    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:04.453151 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.453066    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:26:04.456264 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.456241    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:26:04.463587 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:04.463553    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 11:26:04.463683 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:04.463656    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs podName:05b2d78d-4daf-451e-8d23-dfd20c0e8abb nodeName:}" failed. No retries permitted until 2026-09-15 11:27:08.463634917 +0000 UTC m=+130.219881273 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs") pod "network-metrics-daemon-7dh7b" (UID: "05b2d78d-4daf-451e-8d23-dfd20c0e8abb") : secret "metrics-daemon-secret" not found
Sep 15 11:26:04.553954 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.553918    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt549\" (UniqueName: \"kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549\") pod \"network-check-target-clnqp\" (UID: \"eeb30891-2c06-4839-9f72-3aa1b489b8b3\") " pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:26:04.553954 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.553952    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:26:04.556747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.556729    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:26:04.556865 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.556818    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:26:04.567045 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.567016    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89114c8-5946-4fdc-b752-7568f994e251-original-pull-secret\") pod \"global-pull-secret-syncer-2gnj8\" (UID: \"e89114c8-5946-4fdc-b752-7568f994e251\") " pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:26:04.567135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.567089    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:26:04.577149 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.577130    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt549\" (UniqueName: \"kubernetes.io/projected/eeb30891-2c06-4839-9f72-3aa1b489b8b3-kube-api-access-bt549\") pod \"network-check-target-clnqp\" (UID: \"eeb30891-2c06-4839-9f72-3aa1b489b8b3\") " pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:26:04.691965 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.691933    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gnj8"
Sep 15 11:26:04.700749 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.700719    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q47md\""
Sep 15 11:26:04.709120 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.709068    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:26:04.778537 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.778101    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:04.957468 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.957429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:26:04.957649 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.957489    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:26:04.959754 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.959691    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls\") pod \"image-registry-7967fbf76-k4c72\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") " pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:26:04.959754 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.959702    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8f8849-55a5-4213-b482-83f452708e0f-metrics-tls\") pod \"dns-default-qz727\" (UID: \"4a8f8849-55a5-4213-b482-83f452708e0f\") " pod="openshift-dns/dns-default-qz727"
Sep 15 11:26:04.998479 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:04.998450    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2gnj8"]
Sep 15 11:26:05.001276 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:05.001253    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89114c8_5946_4fdc_b752_7568f994e251.slice/crio-962f595045e497761bd5dec6296db07ea9a883101cec5df642e0be1b82a58505 WatchSource:0}: Error finding container 962f595045e497761bd5dec6296db07ea9a883101cec5df642e0be1b82a58505: Status 404 returned error can't find the container with id 962f595045e497761bd5dec6296db07ea9a883101cec5df642e0be1b82a58505
Sep 15 11:26:05.026282 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.026253    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-clnqp"]
Sep 15 11:26:05.028873 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:05.028847    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb30891_2c06_4839_9f72_3aa1b489b8b3.slice/crio-8d6ed514424f88edebeba58c65451e4d6e1e3fc7d20d6197c7ba3e816ba32616 WatchSource:0}: Error finding container 8d6ed514424f88edebeba58c65451e4d6e1e3fc7d20d6197c7ba3e816ba32616: Status 404 returned error can't find the container with id 8d6ed514424f88edebeba58c65451e4d6e1e3fc7d20d6197c7ba3e816ba32616
Sep 15 11:26:05.061089 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.061056    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-clnqp" event={"ID":"eeb30891-2c06-4839-9f72-3aa1b489b8b3","Type":"ContainerStarted","Data":"8d6ed514424f88edebeba58c65451e4d6e1e3fc7d20d6197c7ba3e816ba32616"}
Sep 15 11:26:05.062124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.062101    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2gnj8" event={"ID":"e89114c8-5946-4fdc-b752-7568f994e251","Type":"ContainerStarted","Data":"962f595045e497761bd5dec6296db07ea9a883101cec5df642e0be1b82a58505"}
Sep 15 11:26:05.184325 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.184290    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:05.238918 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.238841    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:05.240192 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.240166    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n56tl\""
Sep 15 11:26:05.245355 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.245338    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2sd6\""
Sep 15 11:26:05.248704 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.248690    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:26:05.253873 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.253852    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz727"
Sep 15 11:26:05.339884 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.334265    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:05.537924 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.537816    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qz727"]
Sep 15 11:26:05.540291 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.540244    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7967fbf76-k4c72"]
Sep 15 11:26:05.540918 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:05.540889    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8f8849_55a5_4213_b482_83f452708e0f.slice/crio-b27a20388065bed3d4f23abf467247b864de7ce11c7db26aaa24aa77e1944933 WatchSource:0}: Error finding container b27a20388065bed3d4f23abf467247b864de7ce11c7db26aaa24aa77e1944933: Status 404 returned error can't find the container with id b27a20388065bed3d4f23abf467247b864de7ce11c7db26aaa24aa77e1944933
Sep 15 11:26:05.543331 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:05.543305    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode395cb69_cd43_4294_bbdc_a0b3a42bcd38.slice/crio-a24a31dbfaf1a2c881501b9a405cfb15fbc58be45afa4c38f785356c0aada4ee WatchSource:0}: Error finding container a24a31dbfaf1a2c881501b9a405cfb15fbc58be45afa4c38f785356c0aada4ee: Status 404 returned error can't find the container with id a24a31dbfaf1a2c881501b9a405cfb15fbc58be45afa4c38f785356c0aada4ee
Sep 15 11:26:05.717577 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:05.717360    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:06.068082 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:06.068040    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7967fbf76-k4c72" event={"ID":"e395cb69-cd43-4294-bbdc-a0b3a42bcd38","Type":"ContainerStarted","Data":"6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b"}
Sep 15 11:26:06.068263 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:06.068101    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7967fbf76-k4c72" event={"ID":"e395cb69-cd43-4294-bbdc-a0b3a42bcd38","Type":"ContainerStarted","Data":"a24a31dbfaf1a2c881501b9a405cfb15fbc58be45afa4c38f785356c0aada4ee"}
Sep 15 11:26:06.068263 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:06.068175    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:26:06.069963 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:06.069940    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz727" event={"ID":"4a8f8849-55a5-4213-b482-83f452708e0f","Type":"ContainerStarted","Data":"b27a20388065bed3d4f23abf467247b864de7ce11c7db26aaa24aa77e1944933"}
Sep 15 11:26:06.090676 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:06.090624    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7967fbf76-k4c72" podStartSLOduration=67.090606686 podStartE2EDuration="1m7.090606686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:06.088991706 +0000 UTC m=+67.845238084" watchObservedRunningTime="2026-09-15 11:26:06.090606686 +0000 UTC m=+67.846853061"
Sep 15 11:26:06.121081 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:06.120994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:06.534274 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:06.534216    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:06.741845 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:06.741719    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:06.934575 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:06.934475    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:07.613054 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:07.613005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:07.720705 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:07.720623    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:08.131975 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:08.131901    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:08.527689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:08.527655    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:08.687526 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:08.687492    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:26:08.687731 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:08.687573    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:26:08.687731 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:08.687723    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:26:08.687851 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:08.687795    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls podName:06f38fb1-df45-4e79-982f-0c027386144c nodeName:}" failed. No retries permitted until 2026-09-15 11:26:24.687773812 +0000 UTC m=+86.444020168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-whksv" (UID: "06f38fb1-df45-4e79-982f-0c027386144c") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:26:08.688174 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:08.688150    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06f38fb1-df45-4e79-982f-0c027386144c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:26:08.742380 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:08.742336    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:09.084520 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:09.084445    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-clnqp" event={"ID":"eeb30891-2c06-4839-9f72-3aa1b489b8b3","Type":"ContainerStarted","Data":"3cd0d7b8ca01bcc6b9ef47a37fd45147ae9475acb96786668a200d513d53094a"}
Sep 15 11:26:09.084705 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:09.084601    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:26:09.099617 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:09.099554    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-clnqp" podStartSLOduration=67.98226875 podStartE2EDuration="1m11.099540044s" totalImagesPullingTime="3.117271294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:09.098852226 +0000 UTC m=+70.855098633" watchObservedRunningTime="2026-09-15 11:26:09.099540044 +0000 UTC m=+70.855786422"
Sep 15 11:26:10.905443 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:10.905354    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:10.962058 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:10.962024    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:11.092849 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:11.092817    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz727" event={"ID":"4a8f8849-55a5-4213-b482-83f452708e0f","Type":"ContainerStarted","Data":"a2650c33c024ab7219dac1131e4a53af76410c9a91d6df5028e157668243d83b"}
Sep 15 11:26:11.093024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:11.092876    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz727" event={"ID":"4a8f8849-55a5-4213-b482-83f452708e0f","Type":"ContainerStarted","Data":"29e0c716c1cd8d77a105650daabf543bba573b6313421c7ab81b48431d029743"}
Sep 15 11:26:11.093024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:11.092906    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qz727"
Sep 15 11:26:11.094332 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:11.094309    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2gnj8" event={"ID":"e89114c8-5946-4fdc-b752-7568f994e251","Type":"ContainerStarted","Data":"c69a00f6ae744be30ccf16a8f3c62ff7e0786b4818dfb75d004eec9aaac7b77d"}
Sep 15 11:26:11.108946 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:11.108894    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qz727" podStartSLOduration=33.049476353 podStartE2EDuration="38.108881144s" totalImagesPullingTime="5.059404791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:11.108111797 +0000 UTC m=+72.864358176" watchObservedRunningTime="2026-09-15 11:26:11.108881144 +0000 UTC m=+72.865127521"
Sep 15 11:26:11.122299 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:11.122260    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2gnj8" podStartSLOduration=66.508588068 podStartE2EDuration="1m12.122247115s" totalImagesPullingTime="5.613659047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:11.121056849 +0000 UTC m=+72.877303227" watchObservedRunningTime="2026-09-15 11:26:11.122247115 +0000 UTC m=+72.878493495"
Sep 15 11:26:12.213724 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:12.213688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:26:12.215941 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:12.215923    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8d50b4f-8b14-4ed7-821f-85f75eb1d70d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7pqpn\" (UID: \"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:26:12.314189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:12.314162    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:26:12.316334 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:12.316310    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/499b0286-0e77-4a9e-b576-9d4b2c224b93-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-q6tjj\" (UID: \"499b0286-0e77-4a9e-b576-9d4b2c224b93\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:26:12.414763 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:12.414732    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2l452\""
Sep 15 11:26:12.422903 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:12.422886    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"
Sep 15 11:26:12.530219 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:12.530194    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zxjst\""
Sep 15 11:26:12.538261 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:12.538242    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"
Sep 15 11:26:12.701405 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:12.701370    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn"]
Sep 15 11:26:12.810868 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:12.810838    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj"]
Sep 15 11:26:12.813133 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:12.813111    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499b0286_0e77_4a9e_b576_9d4b2c224b93.slice/crio-aa7e09bf0a947d29edca6b71e4538a0897b61681656c33874ec11077cdb7f090 WatchSource:0}: Error finding container aa7e09bf0a947d29edca6b71e4538a0897b61681656c33874ec11077cdb7f090: Status 404 returned error can't find the container with id aa7e09bf0a947d29edca6b71e4538a0897b61681656c33874ec11077cdb7f090
Sep 15 11:26:13.102555 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:13.102519    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn" event={"ID":"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d","Type":"ContainerStarted","Data":"a95e86be2f1a1db7b147b42f94f82dde18279289e04f9cea58c1d143662c95a0"}
Sep 15 11:26:13.103637 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:13.103617    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj" event={"ID":"499b0286-0e77-4a9e-b576-9d4b2c224b93","Type":"ContainerStarted","Data":"aa7e09bf0a947d29edca6b71e4538a0897b61681656c33874ec11077cdb7f090"}
Sep 15 11:26:14.535226 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:14.535194    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:14.632830 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:14.632801    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:14.730757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:14.730722    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:15.115694 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.115649    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn" event={"ID":"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d","Type":"ContainerStarted","Data":"1dac6d54dca077e6559367100768b804f12b4f5a2bf42c0ea85afea4ff5b9670"}
Sep 15 11:26:15.115877 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.115713    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn" event={"ID":"d8d50b4f-8b14-4ed7-821f-85f75eb1d70d","Type":"ContainerStarted","Data":"6a5f5876c804beb622579ff767c42fec3d54bd4cba0834ea3fe3f0bcf0d99427"}
Sep 15 11:26:15.303647 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.303612    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:15.487651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.487523    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7pqpn" podStartSLOduration=34.005750975 podStartE2EDuration="35.487498692s" totalImagesPullingTime="1.481747717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:15.133169175 +0000 UTC m=+76.889415554" watchObservedRunningTime="2026-09-15 11:26:15.487498692 +0000 UTC m=+77.243745074"
Sep 15 11:26:15.487868 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.487849    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc"]
Sep 15 11:26:15.494300 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.494281    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc"
Sep 15 11:26:15.498227 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.498205    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 11:26:15.499229 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.499195    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 11:26:15.499361 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.499261    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 11:26:15.500192 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.500170    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-k76t8\""
Sep 15 11:26:15.500395 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.500378    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 15 11:26:15.509690 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.509666    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc"]
Sep 15 11:26:15.538162 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.538124    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0939b62a-93ee-4ef6-87b7-eb16dc4bab14-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-856f7d46d4-7z7fc\" (UID: \"0939b62a-93ee-4ef6-87b7-eb16dc4bab14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc"
Sep 15 11:26:15.538520 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.538261    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf9bh\" (UniqueName: \"kubernetes.io/projected/0939b62a-93ee-4ef6-87b7-eb16dc4bab14-kube-api-access-qf9bh\") pod \"managed-serviceaccount-addon-agent-856f7d46d4-7z7fc\" (UID: \"0939b62a-93ee-4ef6-87b7-eb16dc4bab14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc"
Sep 15 11:26:15.638894 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.638861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0939b62a-93ee-4ef6-87b7-eb16dc4bab14-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-856f7d46d4-7z7fc\" (UID: \"0939b62a-93ee-4ef6-87b7-eb16dc4bab14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc"
Sep 15 11:26:15.639039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.638915    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf9bh\" (UniqueName: \"kubernetes.io/projected/0939b62a-93ee-4ef6-87b7-eb16dc4bab14-kube-api-access-qf9bh\") pod \"managed-serviceaccount-addon-agent-856f7d46d4-7z7fc\" (UID: \"0939b62a-93ee-4ef6-87b7-eb16dc4bab14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc"
Sep 15 11:26:15.641202 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.641182    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0939b62a-93ee-4ef6-87b7-eb16dc4bab14-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-856f7d46d4-7z7fc\" (UID: \"0939b62a-93ee-4ef6-87b7-eb16dc4bab14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc"
Sep 15 11:26:15.653309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.653285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf9bh\" (UniqueName: \"kubernetes.io/projected/0939b62a-93ee-4ef6-87b7-eb16dc4bab14-kube-api-access-qf9bh\") pod \"managed-serviceaccount-addon-agent-856f7d46d4-7z7fc\" (UID: \"0939b62a-93ee-4ef6-87b7-eb16dc4bab14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc"
Sep 15 11:26:15.812040 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:15.812013    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc"
Sep 15 11:26:16.078845 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:16.078777    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc"]
Sep 15 11:26:16.081789 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:16.081758    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0939b62a_93ee_4ef6_87b7_eb16dc4bab14.slice/crio-8b5ad6f31d38a775bab8e65fc3ad2bcf9ef0f659b964dcb4b941c09f1ddba000 WatchSource:0}: Error finding container 8b5ad6f31d38a775bab8e65fc3ad2bcf9ef0f659b964dcb4b941c09f1ddba000: Status 404 returned error can't find the container with id 8b5ad6f31d38a775bab8e65fc3ad2bcf9ef0f659b964dcb4b941c09f1ddba000
Sep 15 11:26:16.119617 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:16.119589    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj" event={"ID":"499b0286-0e77-4a9e-b576-9d4b2c224b93","Type":"ContainerStarted","Data":"78bf740c21dca201fafa0d11bb57353d891ad954c301b05b44730f84e3f25ad9"}
Sep 15 11:26:16.120735 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:16.120716    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc" event={"ID":"0939b62a-93ee-4ef6-87b7-eb16dc4bab14","Type":"ContainerStarted","Data":"8b5ad6f31d38a775bab8e65fc3ad2bcf9ef0f659b964dcb4b941c09f1ddba000"}
Sep 15 11:26:16.137124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:16.137083    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-q6tjj" podStartSLOduration=33.282170257 podStartE2EDuration="36.137072106s" totalImagesPullingTime="2.854901849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:16.136796707 +0000 UTC m=+77.893043086" watchObservedRunningTime="2026-09-15 11:26:16.137072106 +0000 UTC m=+77.893318483"
Sep 15 11:26:17.027748 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:17.027681    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:17.092900 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:17.092868    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:19.800673 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:19.800638    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:19.901233 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:19.901201    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:20.137338 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:20.137264    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc" event={"ID":"0939b62a-93ee-4ef6-87b7-eb16dc4bab14","Type":"ContainerStarted","Data":"4dc07cf40c298d7dc10cc79171eb57dfdb6b23749f86b388ade161fdd8cd0b8b"}
Sep 15 11:26:20.154481 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:20.154431    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856f7d46d4-7z7fc" podStartSLOduration=2.111372707 podStartE2EDuration="5.154417879s" totalImagesPullingTime="3.043045172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:20.153264411 +0000 UTC m=+81.909510788" watchObservedRunningTime="2026-09-15 11:26:20.154417879 +0000 UTC m=+81.910664256"
Sep 15 11:26:21.100213 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:21.100102    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qz727"
Sep 15 11:26:21.453512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:21.453427    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:23.016919 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:23.016886    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:23.081612 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:23.081580    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:24.706097 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:24.706068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:26:24.708249 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:24.708223    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06f38fb1-df45-4e79-982f-0c027386144c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whksv\" (UID: \"06f38fb1-df45-4e79-982f-0c027386144c\") " pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:26:24.950318 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:24.950288    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jd6pn\""
Sep 15 11:26:24.957942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:24.957873    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-whksv"
Sep 15 11:26:25.225639 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:25.225616    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-whksv"]
Sep 15 11:26:25.227895 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:25.227869    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f38fb1_df45_4e79_982f_0c027386144c.slice/crio-4a8baf6e4c59162fa12212b0dd4edfc15695da80a8e268f7dcfef0c5af29b8ce WatchSource:0}: Error finding container 4a8baf6e4c59162fa12212b0dd4edfc15695da80a8e268f7dcfef0c5af29b8ce: Status 404 returned error can't find the container with id 4a8baf6e4c59162fa12212b0dd4edfc15695da80a8e268f7dcfef0c5af29b8ce
Sep 15 11:26:25.238422 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:25.238389    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:25.253250 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:25.253228    2570 patch_prober.go:28] interesting pod/image-registry-7967fbf76-k4c72 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 15 11:26:25.253335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:25.253280    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7967fbf76-k4c72" podUID="e395cb69-cd43-4294-bbdc-a0b3a42bcd38" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 11:26:26.158515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:26.158444    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-whksv" event={"ID":"06f38fb1-df45-4e79-982f-0c027386144c","Type":"ContainerStarted","Data":"9ceb8dc0bfebb3cdd55e4e560026041e2b612806fd264c3c6b6d3715f4fd7aad"}
Sep 15 11:26:26.158515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:26.158503    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-whksv" event={"ID":"06f38fb1-df45-4e79-982f-0c027386144c","Type":"ContainerStarted","Data":"6719e660a9039513527ac303a19b452831e99af3496fbe352cf7b7eddee48bb9"}
Sep 15 11:26:26.158881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:26.158522    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-whksv" event={"ID":"06f38fb1-df45-4e79-982f-0c027386144c","Type":"ContainerStarted","Data":"4a8baf6e4c59162fa12212b0dd4edfc15695da80a8e268f7dcfef0c5af29b8ce"}
Sep 15 11:26:27.078674 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:27.078648    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:26:27.664703 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:27.664669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:27.722521 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:27.722486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:27.940732 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:27.940634    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:28.168081 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.168042    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-whksv" event={"ID":"06f38fb1-df45-4e79-982f-0c027386144c","Type":"ContainerStarted","Data":"4cc1b403a5d5e48994dc0e597dabc0136765e5ebde84ed9691ba66eb45fa8568"}
Sep 15 11:26:28.175274 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.175239    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:28.193735 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.193634    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-whksv" podStartSLOduration=34.404941621 podStartE2EDuration="36.19361881s" totalImagesPullingTime="1.788677189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:28.193019492 +0000 UTC m=+89.949265871" watchObservedRunningTime="2026-09-15 11:26:28.19361881 +0000 UTC m=+89.949865188"
Sep 15 11:26:28.281493 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.281461    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lpktd"]
Sep 15 11:26:28.283075 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.283050    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:28.284780 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.284765    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.287808 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.287790    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 11:26:28.288044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.288026    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 11:26:28.288130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.288049    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 11:26:28.288130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.288064    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hsgvp\""
Sep 15 11:26:28.288130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.288065    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 11:26:28.288335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.288316    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 11:26:28.288936 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.288923    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 11:26:28.346654 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.346617    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:28.435500 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.435464    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.435500 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.435500    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-wtmp\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.435726 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.435521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.435726 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.435624    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79j2p\" (UniqueName: \"kubernetes.io/projected/b2a73114-03e7-4be6-83bb-1107f1290127-kube-api-access-79j2p\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.435726 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.435648    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-textfile\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.435726 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.435666    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2a73114-03e7-4be6-83bb-1107f1290127-root\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.435726 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.435684    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a73114-03e7-4be6-83bb-1107f1290127-sys\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.435726 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.435704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2a73114-03e7-4be6-83bb-1107f1290127-metrics-client-ca\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.435726 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.435725    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-tls\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.536617 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.536590    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.536790 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.536652    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79j2p\" (UniqueName: \"kubernetes.io/projected/b2a73114-03e7-4be6-83bb-1107f1290127-kube-api-access-79j2p\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.536790 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.536687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-textfile\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.536790 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.536711    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2a73114-03e7-4be6-83bb-1107f1290127-root\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.536790 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.536767    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2a73114-03e7-4be6-83bb-1107f1290127-root\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.536990 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.536837    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a73114-03e7-4be6-83bb-1107f1290127-sys\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.536990 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.536891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2a73114-03e7-4be6-83bb-1107f1290127-metrics-client-ca\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.536990 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.536924    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-tls\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.536990 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.536971    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.537175 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.537000    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-wtmp\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.537175 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.537105    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-textfile\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.537175 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.537155    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-wtmp\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.537318 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.537206    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a73114-03e7-4be6-83bb-1107f1290127-sys\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.537620 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.537598    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.537707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.537624    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2a73114-03e7-4be6-83bb-1107f1290127-metrics-client-ca\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.538923 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.538904    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.539512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.539487    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2a73114-03e7-4be6-83bb-1107f1290127-node-exporter-tls\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.546857 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.546838    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79j2p\" (UniqueName: \"kubernetes.io/projected/b2a73114-03e7-4be6-83bb-1107f1290127-kube-api-access-79j2p\") pod \"node-exporter-lpktd\" (UID: \"b2a73114-03e7-4be6-83bb-1107f1290127\") " pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.553146 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.553121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:28.594717 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.594682    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lpktd"
Sep 15 11:26:28.606907 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:28.606879    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a73114_03e7_4be6_83bb_1107f1290127.slice/crio-b3022c0781c54a192b654dc4dc40526208f8995a6ecd225c89fe1d594af60ade WatchSource:0}: Error finding container b3022c0781c54a192b654dc4dc40526208f8995a6ecd225c89fe1d594af60ade: Status 404 returned error can't find the container with id b3022c0781c54a192b654dc4dc40526208f8995a6ecd225c89fe1d594af60ade
Sep 15 11:26:28.682273 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.682231    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:28.830868 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:28.830777    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:29.168721 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.168635    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:29.172460 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.172434    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpktd" event={"ID":"b2a73114-03e7-4be6-83bb-1107f1290127","Type":"ContainerStarted","Data":"b3022c0781c54a192b654dc4dc40526208f8995a6ecd225c89fe1d594af60ade"}
Sep 15 11:26:29.318832 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.318786    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:29.320439 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.320411    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:26:29.324134 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.324113    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.329278 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.328108    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 11:26:29.329532 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.329507    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 11:26:29.329655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.329510    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 11:26:29.329655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.329622    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 11:26:29.329821 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.329772    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 11:26:29.329821 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.329796    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 11:26:29.329890 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.329863    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 11:26:29.330401 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.330375    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 11:26:29.330740 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.330590    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fgwgg\""
Sep 15 11:26:29.330740 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.330646    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 11:26:29.346198 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.346178    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:26:29.445420 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-config-out\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.445588 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.445588 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445478    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh57q\" (UniqueName: \"kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-kube-api-access-sh57q\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.445588 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-web-config\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.445588 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445581    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.445832 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445621    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.445832 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.445832 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445691    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.445832 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445754    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.445832 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445799    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.445832 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445827    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.446062 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445868    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.446062 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.445930    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.546815 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.546778    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh57q\" (UniqueName: \"kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-kube-api-access-sh57q\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.546815 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.546824    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-web-config\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.547067 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.546847    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.547067 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.546880    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.547067 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:29.546989    2570 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 15 11:26:29.547067 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.547051    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.547247 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:29.547086    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-main-tls podName:55aced6a-47b8-490d-a769-9336ddbf02a4 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:30.047063998 +0000 UTC m=+91.803310369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4") : secret "alertmanager-main-tls" not found
Sep 15 11:26:29.547247 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.547126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.547247 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.547157    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.547247 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.547197    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.547247 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.547226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.547483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.547248    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.547483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.547306    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.547483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.547340    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-config-out\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.547483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.547371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.548066 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.547943    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.548066 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.548019    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.548066 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.548021    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.550382 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.550343    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-config-out\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.550473 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.550449    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.550954 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.550930    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.551466 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.551442    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.552356 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.552333    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-web-config\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.552518 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.552491    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.553039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.553001    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.553377 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.553358    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.560084 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.560057    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh57q\" (UniqueName: \"kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-kube-api-access-sh57q\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:29.633685 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.633648    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:29.735551 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:29.735479    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:30.052096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:30.052046    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:30.054376 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:30.054354    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:30.177618 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:30.177583    2570 generic.go:356] "Generic (PLEG): container finished" podID="b2a73114-03e7-4be6-83bb-1107f1290127" containerID="781b1e2ad6d99a49db33307d36cfefd265d508d8256bb63a4090b7affda117f4" exitCode=0
Sep 15 11:26:30.177801 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:30.177655    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpktd" event={"ID":"b2a73114-03e7-4be6-83bb-1107f1290127","Type":"ContainerDied","Data":"781b1e2ad6d99a49db33307d36cfefd265d508d8256bb63a4090b7affda117f4"}
Sep 15 11:26:30.219794 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:30.219767    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:30.238481 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:30.238462    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:30.322233 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:30.322146    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:30.519817 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:30.519791    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:26:30.521695 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:30.521671    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55aced6a_47b8_490d_a769_9336ddbf02a4.slice/crio-d6847b285ff51ef3107f869c7e863161dd0809f397957ca36ea51e30bc439983 WatchSource:0}: Error finding container d6847b285ff51ef3107f869c7e863161dd0809f397957ca36ea51e30bc439983: Status 404 returned error can't find the container with id d6847b285ff51ef3107f869c7e863161dd0809f397957ca36ea51e30bc439983
Sep 15 11:26:31.179471 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:31.179436    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:31.184376 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:31.184343    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpktd" event={"ID":"b2a73114-03e7-4be6-83bb-1107f1290127","Type":"ContainerStarted","Data":"f6c5393be05c6e4358cf1634adc66befd3822985e1502d45103e3ba84d469e09"}
Sep 15 11:26:31.184530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:31.184409    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpktd" event={"ID":"b2a73114-03e7-4be6-83bb-1107f1290127","Type":"ContainerStarted","Data":"ee171fa9e2d1455c5dd94dd4aea043fca454eeeef92f08352728a20c4b57842e"}
Sep 15 11:26:31.185948 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:31.185925    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerStarted","Data":"d6847b285ff51ef3107f869c7e863161dd0809f397957ca36ea51e30bc439983"}
Sep 15 11:26:31.207199 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:31.207150    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lpktd" podStartSLOduration=2.008811444 podStartE2EDuration="3.20713481s" totalImagesPullingTime="1.137258582s" totalInitContainerRuntime="61.064784ms" isStatefulPod=true podCreationTimestamp="2026-09-15 11:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:31.206049249 +0000 UTC m=+92.962295643" watchObservedRunningTime="2026-09-15 11:26:31.20713481 +0000 UTC m=+92.963381186"
Sep 15 11:26:31.281867 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:31.281833    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:31.669984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:31.669948    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:31.773819 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:31.773784    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:32.190992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.190901    2570 generic.go:356] "Generic (PLEG): container finished" podID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerID="5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577" exitCode=0
Sep 15 11:26:32.191354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.190983    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerDied","Data":"5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577"}
Sep 15 11:26:32.585968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.585928    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-74d8658d7b-pn87p"]
Sep 15 11:26:32.590003 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.589980    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.592908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.592882    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-39fsl9aigtng5\""
Sep 15 11:26:32.593058 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.592886    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 15 11:26:32.593883 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.593861    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 15 11:26:32.594038 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.593882    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 15 11:26:32.594038 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.593931    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 15 11:26:32.594038 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.593947    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5n5m5\""
Sep 15 11:26:32.601604 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.601569    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-74d8658d7b-pn87p"]
Sep 15 11:26:32.677238 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.677206    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-audit-log\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.677425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.677255    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-metrics-server-audit-profiles\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.677425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.677285    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-client-ca-bundle\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.677425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.677349    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.677425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.677378    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-secret-metrics-server-client-certs\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.677425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.677395    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-secret-metrics-server-tls\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.677425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.677418    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bxct\" (UniqueName: \"kubernetes.io/projected/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-kube-api-access-8bxct\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.778661 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.778632    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-metrics-server-audit-profiles\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.778855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.778672    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-client-ca-bundle\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.778855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.778795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.778855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.778836    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-secret-metrics-server-client-certs\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.779021 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.778864    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-secret-metrics-server-tls\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.779021 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.778900    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bxct\" (UniqueName: \"kubernetes.io/projected/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-kube-api-access-8bxct\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.779021 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.778995    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-audit-log\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.779458 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.779432    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-audit-log\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.779701 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.779682    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.779823 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.779802    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-metrics-server-audit-profiles\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.781295 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.781273    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-secret-metrics-server-tls\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.781688 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.781673    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-secret-metrics-server-client-certs\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.781735 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.781697    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-client-ca-bundle\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.788435 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.788412    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bxct\" (UniqueName: \"kubernetes.io/projected/7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf-kube-api-access-8bxct\") pod \"metrics-server-74d8658d7b-pn87p\" (UID: \"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf\") " pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.902266 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.901950    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:32.949210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.947926    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"]
Sep 15 11:26:32.949898 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.949710    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:32.952212 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.952192    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"
Sep 15 11:26:32.954766 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.954732    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jzz6s\""
Sep 15 11:26:32.954884 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.954777    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 15 11:26:32.959911 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:32.959593    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"]
Sep 15 11:26:33.081613 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:33.081555    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69bx6\" (UniqueName: \"kubernetes.io/projected/fe721367-3aa6-4aef-9b5f-9c799c93b7f5-kube-api-access-69bx6\") pod \"monitoring-plugin-5d85778b9d-ct48g\" (UID: \"fe721367-3aa6-4aef-9b5f-9c799c93b7f5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"
Sep 15 11:26:33.081803 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:33.081735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe721367-3aa6-4aef-9b5f-9c799c93b7f5-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-ct48g\" (UID: \"fe721367-3aa6-4aef-9b5f-9c799c93b7f5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"
Sep 15 11:26:33.183287 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:33.183200    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe721367-3aa6-4aef-9b5f-9c799c93b7f5-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-ct48g\" (UID: \"fe721367-3aa6-4aef-9b5f-9c799c93b7f5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"
Sep 15 11:26:33.183287 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:33.183273    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69bx6\" (UniqueName: \"kubernetes.io/projected/fe721367-3aa6-4aef-9b5f-9c799c93b7f5-kube-api-access-69bx6\") pod \"monitoring-plugin-5d85778b9d-ct48g\" (UID: \"fe721367-3aa6-4aef-9b5f-9c799c93b7f5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"
Sep 15 11:26:33.183503 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:33.183378    2570 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 15 11:26:33.183503 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:26:33.183455    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe721367-3aa6-4aef-9b5f-9c799c93b7f5-monitoring-plugin-cert podName:fe721367-3aa6-4aef-9b5f-9c799c93b7f5 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:33.683434096 +0000 UTC m=+95.439680465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fe721367-3aa6-4aef-9b5f-9c799c93b7f5-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-ct48g" (UID: "fe721367-3aa6-4aef-9b5f-9c799c93b7f5") : secret "monitoring-plugin-cert" not found
Sep 15 11:26:33.188963 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:33.188933    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-74d8658d7b-pn87p"]
Sep 15 11:26:33.192250 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:33.192231    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69bx6\" (UniqueName: \"kubernetes.io/projected/fe721367-3aa6-4aef-9b5f-9c799c93b7f5-kube-api-access-69bx6\") pod \"monitoring-plugin-5d85778b9d-ct48g\" (UID: \"fe721367-3aa6-4aef-9b5f-9c799c93b7f5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"
Sep 15 11:26:33.275120 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:33.275085    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:33.339375 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:33.339345    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7efc19f9_3b1d_4edf_b86c_7cf8c953eeaf.slice/crio-0c9cf9fa0a1e1fbdea1f9cb23dee87135bb8c26b170138281875ef230f7554c7 WatchSource:0}: Error finding container 0c9cf9fa0a1e1fbdea1f9cb23dee87135bb8c26b170138281875ef230f7554c7: Status 404 returned error can't find the container with id 0c9cf9fa0a1e1fbdea1f9cb23dee87135bb8c26b170138281875ef230f7554c7
Sep 15 11:26:33.688378 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:33.688151    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe721367-3aa6-4aef-9b5f-9c799c93b7f5-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-ct48g\" (UID: \"fe721367-3aa6-4aef-9b5f-9c799c93b7f5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"
Sep 15 11:26:33.690583 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:33.690546    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe721367-3aa6-4aef-9b5f-9c799c93b7f5-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-ct48g\" (UID: \"fe721367-3aa6-4aef-9b5f-9c799c93b7f5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"
Sep 15 11:26:33.866235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:33.866194    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"
Sep 15 11:26:34.146369 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:34.146346    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"]
Sep 15 11:26:34.203386 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:34.203344    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerStarted","Data":"ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf"}
Sep 15 11:26:34.203833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:34.203442    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerStarted","Data":"84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993"}
Sep 15 11:26:34.203833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:34.203497    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerStarted","Data":"d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69"}
Sep 15 11:26:34.203833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:34.203536    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerStarted","Data":"14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78"}
Sep 15 11:26:34.203833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:34.203596    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerStarted","Data":"8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea"}
Sep 15 11:26:34.205003 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:34.204965    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p" event={"ID":"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf","Type":"ContainerStarted","Data":"0c9cf9fa0a1e1fbdea1f9cb23dee87135bb8c26b170138281875ef230f7554c7"}
Sep 15 11:26:34.269199 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:34.269162    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe721367_3aa6_4aef_9b5f_9c799c93b7f5.slice/crio-55e551f2a6c96234e29a77468515ed9bfb6a018677113931ea490fc5e21a51d4 WatchSource:0}: Error finding container 55e551f2a6c96234e29a77468515ed9bfb6a018677113931ea490fc5e21a51d4: Status 404 returned error can't find the container with id 55e551f2a6c96234e29a77468515ed9bfb6a018677113931ea490fc5e21a51d4
Sep 15 11:26:34.493531 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:34.493436    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:34.625731 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:34.625682    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:35.210289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:35.210246    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p" event={"ID":"7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf","Type":"ContainerStarted","Data":"a22c9d3959573f36d06c3d0a8414ae244f2518b03e5b1c22ccdac7656812a5d9"}
Sep 15 11:26:35.213829 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:35.213800    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerStarted","Data":"28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11"}
Sep 15 11:26:35.215067 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:35.215036    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g" event={"ID":"fe721367-3aa6-4aef-9b5f-9c799c93b7f5","Type":"ContainerStarted","Data":"55e551f2a6c96234e29a77468515ed9bfb6a018677113931ea490fc5e21a51d4"}
Sep 15 11:26:35.229746 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:35.229694    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p" podStartSLOduration=1.847238682 podStartE2EDuration="3.229675279s" totalImagesPullingTime="1.382436597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:35.228831152 +0000 UTC m=+96.985077530" watchObservedRunningTime="2026-09-15 11:26:35.229675279 +0000 UTC m=+96.985921659"
Sep 15 11:26:35.260726 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:35.260675    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.472799631 podStartE2EDuration="6.260659761s" totalImagesPullingTime="2.770545953s" totalInitContainerRuntime="17.314177ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:35.259346945 +0000 UTC m=+97.015593345" watchObservedRunningTime="2026-09-15 11:26:35.260659761 +0000 UTC m=+97.016906139"
Sep 15 11:26:36.004628 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:36.004502    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:36.105020 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:36.104990    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:36.642122 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:36.642069    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:37.059932 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:37.059898    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:37.161436 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:37.161345    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:37.226661 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:37.226632    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g" event={"ID":"fe721367-3aa6-4aef-9b5f-9c799c93b7f5","Type":"ContainerStarted","Data":"92539f12cb4e8248d71352168d7ecf8da29338d06a763274eac0498ad01742c8"}
Sep 15 11:26:37.226826 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:37.226793    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"
Sep 15 11:26:37.231419 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:37.231398    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g"
Sep 15 11:26:37.244054 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:37.244009    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-ct48g" podStartSLOduration=2.6099551930000002 podStartE2EDuration="5.243995857s" totalImagesPullingTime="2.634040664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:37.242062965 +0000 UTC m=+98.998309368" watchObservedRunningTime="2026-09-15 11:26:37.243995857 +0000 UTC m=+99.000242234"
Sep 15 11:26:37.432603 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:37.432498    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7967fbf76-k4c72"]
Sep 15 11:26:37.506958 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:37.506930    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:37.609434 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:37.609405    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:37.711015 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:37.710935    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:39.326229 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:39.326189    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:39.423039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:39.423012    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:40.090507 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:40.090478    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-clnqp"
Sep 15 11:26:43.055256 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.055223    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:43.156518 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.156483    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:43.683622 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.683588    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5db4f7469d-v7l6c"]
Sep 15 11:26:43.725696 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.725664    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5db4f7469d-v7l6c"]
Sep 15 11:26:43.725864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.725772    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.728654 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.728629    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 11:26:43.728768 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.728705    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 11:26:43.728768 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.728714    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 11:26:43.728865 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.728839    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 11:26:43.728927 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.728908    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 11:26:43.730086 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.730069    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 11:26:43.730177 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.730093    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 11:26:43.730255 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.730222    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-54lkc\""
Sep 15 11:26:43.877921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.877886    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-oauth-serving-cert\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.877921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.877927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-oauth-config\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.878145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.877946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fndr2\" (UniqueName: \"kubernetes.io/projected/3067ddfc-9032-4c5b-9819-a7357dc47f3e-kube-api-access-fndr2\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.878145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.877967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-config\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.878145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.878048    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-service-ca\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.878145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.878091    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-serving-cert\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.957640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.957544    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:43.978672 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.978625    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-service-ca\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.978823 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.978691    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-serving-cert\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.978823 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.978757    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-oauth-serving-cert\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.978823 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.978795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-oauth-config\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.978823 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.978815    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fndr2\" (UniqueName: \"kubernetes.io/projected/3067ddfc-9032-4c5b-9819-a7357dc47f3e-kube-api-access-fndr2\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.979023 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.978846    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-config\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.979421 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.979398    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-service-ca\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.979526 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.979421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-oauth-serving-cert\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.979591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.979523    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-config\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.981183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.981164    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-serving-cert\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.981604 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.981585    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-oauth-config\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:43.986722 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:43.986698    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fndr2\" (UniqueName: \"kubernetes.io/projected/3067ddfc-9032-4c5b-9819-a7357dc47f3e-kube-api-access-fndr2\") pod \"console-5db4f7469d-v7l6c\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") " pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:44.035319 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:44.035289    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:44.058099 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:44.058057    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:44.158114 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:44.158077    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:44.270861 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:44.270824    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:44.325451 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:44.325420    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5db4f7469d-v7l6c"]
Sep 15 11:26:44.329589 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:44.329532    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3067ddfc_9032_4c5b_9819_a7357dc47f3e.slice/crio-79d261ca9c6a34fef84da71e73cc87f77e240cb9e16ac4249220aa16c1ee96aa WatchSource:0}: Error finding container 79d261ca9c6a34fef84da71e73cc87f77e240cb9e16ac4249220aa16c1ee96aa: Status 404 returned error can't find the container with id 79d261ca9c6a34fef84da71e73cc87f77e240cb9e16ac4249220aa16c1ee96aa
Sep 15 11:26:45.259976 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:45.259935    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db4f7469d-v7l6c" event={"ID":"3067ddfc-9032-4c5b-9819-a7357dc47f3e","Type":"ContainerStarted","Data":"79d261ca9c6a34fef84da71e73cc87f77e240cb9e16ac4249220aa16c1ee96aa"}
Sep 15 11:26:46.469602 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:46.469545    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:46.527308 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:46.527274    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:46.724980 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:46.724894    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:46.804856 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:46.804823    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:47.850244 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:47.850214    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:48.269772 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:48.269741    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:48.272319 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:48.272291    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db4f7469d-v7l6c" event={"ID":"3067ddfc-9032-4c5b-9819-a7357dc47f3e","Type":"ContainerStarted","Data":"737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01"}
Sep 15 11:26:48.293647 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:48.293604    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5db4f7469d-v7l6c" podStartSLOduration=2.195107599 podStartE2EDuration="5.293588218s" totalImagesPullingTime="3.098480619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:48.292729499 +0000 UTC m=+110.048975878" watchObservedRunningTime="2026-09-15 11:26:48.293588218 +0000 UTC m=+110.049834654"
Sep 15 11:26:48.370330 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:48.370299    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:51.044521 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.044480    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79bfc98db5-t62rx"]
Sep 15 11:26:51.047719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.047698    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.056546 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.056526    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 15 11:26:51.060881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.060844    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79bfc98db5-t62rx"]
Sep 15 11:26:51.133881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.133849    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-trusted-ca-bundle\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.134071 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.133892    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-serving-cert\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.134071 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.133916    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-config\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.134071 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.133971    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-service-ca\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.134071 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.134003    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-oauth-serving-cert\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.134071 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.134042    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb88k\" (UniqueName: \"kubernetes.io/projected/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-kube-api-access-hb88k\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.134236 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.134094    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-oauth-config\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.235094 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.235058    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-serving-cert\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.235094 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.235099    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-config\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.235307 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.235115    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-service-ca\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.235307 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.235136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-oauth-serving-cert\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.235307 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.235167    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb88k\" (UniqueName: \"kubernetes.io/projected/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-kube-api-access-hb88k\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.235307 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.235194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-oauth-config\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.235307 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.235253    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-trusted-ca-bundle\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.235968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.235945    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-oauth-serving-cert\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.235968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.235958    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-service-ca\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.236107 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.236010    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-config\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.236322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.236301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-trusted-ca-bundle\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.237701 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.237676    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-serving-cert\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.237701 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.237690    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-oauth-config\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.244099 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.244080    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb88k\" (UniqueName: \"kubernetes.io/projected/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-kube-api-access-hb88k\") pod \"console-79bfc98db5-t62rx\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") " pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.268252 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.268219    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:51.356635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.356571    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:26:51.627606 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:51.627445    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79bfc98db5-t62rx"]
Sep 15 11:26:51.629955 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:26:51.629931    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e4c2f0_3777_4e95_bcdb_8c124473dea8.slice/crio-cb798aedf8b75aba23998fd70d0df184782188e3e1f821915bc24f8c1b86b5c0 WatchSource:0}: Error finding container cb798aedf8b75aba23998fd70d0df184782188e3e1f821915bc24f8c1b86b5c0: Status 404 returned error can't find the container with id cb798aedf8b75aba23998fd70d0df184782188e3e1f821915bc24f8c1b86b5c0
Sep 15 11:26:52.288759 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:52.288724    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bfc98db5-t62rx" event={"ID":"b3e4c2f0-3777-4e95-bcdb-8c124473dea8","Type":"ContainerStarted","Data":"929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856"}
Sep 15 11:26:52.289168 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:52.288768    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bfc98db5-t62rx" event={"ID":"b3e4c2f0-3777-4e95-bcdb-8c124473dea8","Type":"ContainerStarted","Data":"cb798aedf8b75aba23998fd70d0df184782188e3e1f821915bc24f8c1b86b5c0"}
Sep 15 11:26:52.309764 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:52.309720    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79bfc98db5-t62rx" podStartSLOduration=1.309704889 podStartE2EDuration="1.309704889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:52.307847021 +0000 UTC m=+114.064093398" watchObservedRunningTime="2026-09-15 11:26:52.309704889 +0000 UTC m=+114.065951266"
Sep 15 11:26:52.902975 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:52.902940    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:52.903161 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:52.903005    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:26:54.036094 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:54.036048    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:54.036528 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:54.036150    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:54.040895 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:54.040872    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:54.299616 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:54.299525    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:26:56.669325 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:56.669285    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:56.769720 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:56.769683    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:26:57.261098 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:26:57.261061    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:01.356720 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:01.356673    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:27:01.357163 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:01.356763    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:27:01.361145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:01.361125    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:27:01.477743 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:01.477705    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:01.577313 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:01.577285    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:02.335133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.335106    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:27:02.381958 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.381931    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5db4f7469d-v7l6c"]
Sep 15 11:27:02.455972 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.455914    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7967fbf76-k4c72" podUID="e395cb69-cd43-4294-bbdc-a0b3a42bcd38" containerName="registry" containerID="cri-o://6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b" gracePeriod=30
Sep 15 11:27:02.543454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.543426    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:02.643197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.643165    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:02.693525 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.693501    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:27:02.717595 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.717547    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:02.726333 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.726313    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-trusted-ca\") pod \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") "
Sep 15 11:27:02.726440 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.726345    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-installation-pull-secrets\") pod \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") "
Sep 15 11:27:02.726440 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.726367    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-bound-sa-token\") pod \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") "
Sep 15 11:27:02.726440 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.726397    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-image-registry-private-configuration\") pod \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") "
Sep 15 11:27:02.726611 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.726530    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m84ws\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-kube-api-access-m84ws\") pod \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") "
Sep 15 11:27:02.726611 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.726605    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls\") pod \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") "
Sep 15 11:27:02.726717 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.726640    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-certificates\") pod \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") "
Sep 15 11:27:02.726717 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.726685    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-ca-trust-extracted\") pod \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\" (UID: \"e395cb69-cd43-4294-bbdc-a0b3a42bcd38\") "
Sep 15 11:27:02.726830 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.726802    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e395cb69-cd43-4294-bbdc-a0b3a42bcd38" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:02.727102 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.727079    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-trusted-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:02.727267 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.727249    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e395cb69-cd43-4294-bbdc-a0b3a42bcd38" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:02.729204 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.729173    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e395cb69-cd43-4294-bbdc-a0b3a42bcd38" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:02.729204 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.729189    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-kube-api-access-m84ws" (OuterVolumeSpecName: "kube-api-access-m84ws") pod "e395cb69-cd43-4294-bbdc-a0b3a42bcd38" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38"). InnerVolumeSpecName "kube-api-access-m84ws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:27:02.729351 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.729252    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e395cb69-cd43-4294-bbdc-a0b3a42bcd38" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:27:02.729351 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.729297    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e395cb69-cd43-4294-bbdc-a0b3a42bcd38" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:02.729457 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.729438    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e395cb69-cd43-4294-bbdc-a0b3a42bcd38" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:27:02.735991 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.735968    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e395cb69-cd43-4294-bbdc-a0b3a42bcd38" (UID: "e395cb69-cd43-4294-bbdc-a0b3a42bcd38"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:27:02.827648 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.827628    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-ca-trust-extracted\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:02.827648 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.827649    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-installation-pull-secrets\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:02.827776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.827660    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-bound-sa-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:02.827776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.827669    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-image-registry-private-configuration\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:02.827776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.827680    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m84ws\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-kube-api-access-m84ws\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:02.827776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.827688    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-tls\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:02.827776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:02.827696    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e395cb69-cd43-4294-bbdc-a0b3a42bcd38-registry-certificates\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:03.335734 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:03.335701    2570 generic.go:356] "Generic (PLEG): container finished" podID="e395cb69-cd43-4294-bbdc-a0b3a42bcd38" containerID="6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b" exitCode=0
Sep 15 11:27:03.335914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:03.335754    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7967fbf76-k4c72"
Sep 15 11:27:03.335914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:03.335785    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7967fbf76-k4c72" event={"ID":"e395cb69-cd43-4294-bbdc-a0b3a42bcd38","Type":"ContainerDied","Data":"6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b"}
Sep 15 11:27:03.335914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:03.335840    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7967fbf76-k4c72" event={"ID":"e395cb69-cd43-4294-bbdc-a0b3a42bcd38","Type":"ContainerDied","Data":"a24a31dbfaf1a2c881501b9a405cfb15fbc58be45afa4c38f785356c0aada4ee"}
Sep 15 11:27:03.335914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:03.335868    2570 scope.go:117] "RemoveContainer" containerID="6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b"
Sep 15 11:27:03.343695 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:03.343677    2570 scope.go:117] "RemoveContainer" containerID="6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b"
Sep 15 11:27:03.343954 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:27:03.343936    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b\": container with ID starting with 6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b not found: ID does not exist" containerID="6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b"
Sep 15 11:27:03.344017 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:03.343960    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b"} err="failed to get container status \"6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b\": rpc error: code = NotFound desc = could not find container \"6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b\": container with ID starting with 6b56caf2e1c72bf07f174f345df56c964b561045752c161c56c30db292818a4b not found: ID does not exist"
Sep 15 11:27:03.352951 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:03.352926    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7967fbf76-k4c72"]
Sep 15 11:27:03.357696 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:03.357666    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7967fbf76-k4c72"]
Sep 15 11:27:04.779172 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:04.779142    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e395cb69-cd43-4294-bbdc-a0b3a42bcd38" path="/var/lib/kubelet/pods/e395cb69-cd43-4294-bbdc-a0b3a42bcd38/volumes"
Sep 15 11:27:08.475037 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:08.474988    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:27:08.477266 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:08.477248    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05b2d78d-4daf-451e-8d23-dfd20c0e8abb-metrics-certs\") pod \"network-metrics-daemon-7dh7b\" (UID: \"05b2d78d-4daf-451e-8d23-dfd20c0e8abb\") " pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:27:08.605310 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:08.605280    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mvt2n\""
Sep 15 11:27:08.612791 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:08.612768    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dh7b"
Sep 15 11:27:08.881778 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:08.881752    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7dh7b"]
Sep 15 11:27:08.884844 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:27:08.884815    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b2d78d_4daf_451e_8d23_dfd20c0e8abb.slice/crio-8726c758c047dfe73c6de331a26158ab145ebe949099a5a62f87b1570bc95b08 WatchSource:0}: Error finding container 8726c758c047dfe73c6de331a26158ab145ebe949099a5a62f87b1570bc95b08: Status 404 returned error can't find the container with id 8726c758c047dfe73c6de331a26158ab145ebe949099a5a62f87b1570bc95b08
Sep 15 11:27:09.358393 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:09.358361    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dh7b" event={"ID":"05b2d78d-4daf-451e-8d23-dfd20c0e8abb","Type":"ContainerStarted","Data":"8726c758c047dfe73c6de331a26158ab145ebe949099a5a62f87b1570bc95b08"}
Sep 15 11:27:10.363485 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:10.363408    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dh7b" event={"ID":"05b2d78d-4daf-451e-8d23-dfd20c0e8abb","Type":"ContainerStarted","Data":"f83004c9f36e059f62a183364f123c004309743010e540668fad00449248278d"}
Sep 15 11:27:10.363485 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:10.363472    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dh7b" event={"ID":"05b2d78d-4daf-451e-8d23-dfd20c0e8abb","Type":"ContainerStarted","Data":"cebd93e376bf4f649fb0ccf865f3a7eefecc5a34bb69304f9ddcc7809ecad615"}
Sep 15 11:27:10.380284 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:10.380218    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7dh7b" podStartSLOduration=131.231812079 podStartE2EDuration="2m12.380204597s" totalImagesPullingTime="1.148392518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:27:10.379184229 +0000 UTC m=+132.135430608" watchObservedRunningTime="2026-09-15 11:27:10.380204597 +0000 UTC m=+132.136450975"
Sep 15 11:27:10.469419 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:10.469385    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:10.530681 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:10.530641    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:12.907869 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:12.907836    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:27:12.911440 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:12.911418    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-74d8658d7b-pn87p"
Sep 15 11:27:16.465433 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:16.465397    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:16.512632 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:16.512599    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:27.405666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.405600    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5db4f7469d-v7l6c" podUID="3067ddfc-9032-4c5b-9819-a7357dc47f3e" containerName="console" containerID="cri-o://737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01" gracePeriod=15
Sep 15 11:27:27.645120 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.645098    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:27:27.717412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.717333    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-oauth-config\") pod \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") "
Sep 15 11:27:27.717412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.717365    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-serving-cert\") pod \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") "
Sep 15 11:27:27.717412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.717413    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-config\") pod \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") "
Sep 15 11:27:27.717712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.717436    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-service-ca\") pod \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") "
Sep 15 11:27:27.717712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.717462    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fndr2\" (UniqueName: \"kubernetes.io/projected/3067ddfc-9032-4c5b-9819-a7357dc47f3e-kube-api-access-fndr2\") pod \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") "
Sep 15 11:27:27.717712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.717481    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-oauth-serving-cert\") pod \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\" (UID: \"3067ddfc-9032-4c5b-9819-a7357dc47f3e\") "
Sep 15 11:27:27.717923 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.717894    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-config" (OuterVolumeSpecName: "console-config") pod "3067ddfc-9032-4c5b-9819-a7357dc47f3e" (UID: "3067ddfc-9032-4c5b-9819-a7357dc47f3e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:27.718030 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.717908    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3067ddfc-9032-4c5b-9819-a7357dc47f3e" (UID: "3067ddfc-9032-4c5b-9819-a7357dc47f3e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:27.718030 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.717900    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-service-ca" (OuterVolumeSpecName: "service-ca") pod "3067ddfc-9032-4c5b-9819-a7357dc47f3e" (UID: "3067ddfc-9032-4c5b-9819-a7357dc47f3e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:27.719752 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.719720    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3067ddfc-9032-4c5b-9819-a7357dc47f3e" (UID: "3067ddfc-9032-4c5b-9819-a7357dc47f3e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:27.719843 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.719791    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3067ddfc-9032-4c5b-9819-a7357dc47f3e" (UID: "3067ddfc-9032-4c5b-9819-a7357dc47f3e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:27.719843 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.719819    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3067ddfc-9032-4c5b-9819-a7357dc47f3e-kube-api-access-fndr2" (OuterVolumeSpecName: "kube-api-access-fndr2") pod "3067ddfc-9032-4c5b-9819-a7357dc47f3e" (UID: "3067ddfc-9032-4c5b-9819-a7357dc47f3e"). InnerVolumeSpecName "kube-api-access-fndr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:27:27.818666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.818638    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-oauth-config\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:27.818666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.818659    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-serving-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:27.818666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.818669    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-console-config\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:27.818845 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.818679    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:27.818845 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.818687    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fndr2\" (UniqueName: \"kubernetes.io/projected/3067ddfc-9032-4c5b-9819-a7357dc47f3e-kube-api-access-fndr2\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:27.818845 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:27.818695    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3067ddfc-9032-4c5b-9819-a7357dc47f3e-oauth-serving-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:28.429855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:28.429818    2570 generic.go:356] "Generic (PLEG): container finished" podID="3067ddfc-9032-4c5b-9819-a7357dc47f3e" containerID="737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01" exitCode=0
Sep 15 11:27:28.430234 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:28.429922    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db4f7469d-v7l6c"
Sep 15 11:27:28.430234 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:28.429947    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db4f7469d-v7l6c" event={"ID":"3067ddfc-9032-4c5b-9819-a7357dc47f3e","Type":"ContainerDied","Data":"737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01"}
Sep 15 11:27:28.430234 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:28.429997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db4f7469d-v7l6c" event={"ID":"3067ddfc-9032-4c5b-9819-a7357dc47f3e","Type":"ContainerDied","Data":"79d261ca9c6a34fef84da71e73cc87f77e240cb9e16ac4249220aa16c1ee96aa"}
Sep 15 11:27:28.430234 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:28.430017    2570 scope.go:117] "RemoveContainer" containerID="737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01"
Sep 15 11:27:28.439143 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:28.439122    2570 scope.go:117] "RemoveContainer" containerID="737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01"
Sep 15 11:27:28.439445 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:27:28.439425    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01\": container with ID starting with 737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01 not found: ID does not exist" containerID="737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01"
Sep 15 11:27:28.439516 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:28.439454    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01"} err="failed to get container status \"737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01\": rpc error: code = NotFound desc = could not find container \"737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01\": container with ID starting with 737554f96aa2d8dba4eb2b8e3c7b6e77c80b5d72fc8a3fefc8ef988ac7ea4d01 not found: ID does not exist"
Sep 15 11:27:28.451349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:28.451324    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5db4f7469d-v7l6c"]
Sep 15 11:27:28.458739 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:28.456692    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5db4f7469d-v7l6c"]
Sep 15 11:27:28.780323 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:28.780289    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3067ddfc-9032-4c5b-9819-a7357dc47f3e" path="/var/lib/kubelet/pods/3067ddfc-9032-4c5b-9819-a7357dc47f3e/volumes"
Sep 15 11:27:45.279420 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:45.279378    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:47.440550 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:47.440493    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:47.541582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:47.541533    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:48.492182 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:48.492144    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:48.493286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:48.492520    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="alertmanager" containerID="cri-o://8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea" gracePeriod=120
Sep 15 11:27:48.493286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:48.492923    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="prom-label-proxy" containerID="cri-o://28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11" gracePeriod=120
Sep 15 11:27:48.493286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:48.492977    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="config-reloader" containerID="cri-o://14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78" gracePeriod=120
Sep 15 11:27:48.493286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:48.493007    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy-web" containerID="cri-o://d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69" gracePeriod=120
Sep 15 11:27:48.493286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:48.493067    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy-metric" containerID="cri-o://ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf" gracePeriod=120
Sep 15 11:27:48.493286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:48.493131    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy" containerID="cri-o://84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993" gracePeriod=120
Sep 15 11:27:49.516251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.516220    2570 generic.go:356] "Generic (PLEG): container finished" podID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerID="28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11" exitCode=0
Sep 15 11:27:49.516251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.516244    2570 generic.go:356] "Generic (PLEG): container finished" podID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerID="84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993" exitCode=0
Sep 15 11:27:49.516251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.516251    2570 generic.go:356] "Generic (PLEG): container finished" podID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerID="14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78" exitCode=0
Sep 15 11:27:49.516251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.516257    2570 generic.go:356] "Generic (PLEG): container finished" podID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerID="8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea" exitCode=0
Sep 15 11:27:49.516712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.516277    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerDied","Data":"28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11"}
Sep 15 11:27:49.516712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.516328    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerDied","Data":"84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993"}
Sep 15 11:27:49.516712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.516355    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerDied","Data":"14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78"}
Sep 15 11:27:49.516712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.516378    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerDied","Data":"8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea"}
Sep 15 11:27:49.737168 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.737139    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:49.883106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883025    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883064    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-main-db\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883080    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-cluster-tls-config\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883109    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-metrics-client-ca\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883135    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-config-volume\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883173    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh57q\" (UniqueName: \"kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-kube-api-access-sh57q\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883205    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-main-tls\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883231    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-web-config\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883278    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883308    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-tls-assets\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883706 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883356    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-config-out\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883706 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883388    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883706 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883415    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-trusted-ca-bundle\") pod \"55aced6a-47b8-490d-a769-9336ddbf02a4\" (UID: \"55aced6a-47b8-490d-a769-9336ddbf02a4\") "
Sep 15 11:27:49.883706 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883422    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:27:49.883706 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883516    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:49.883968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883782    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-main-db\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.883968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.883804    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-metrics-client-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.885778 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.885750    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:27:49.886085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.886060    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:49.886660 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.886447    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:49.886660 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.886477    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-kube-api-access-sh57q" (OuterVolumeSpecName: "kube-api-access-sh57q") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "kube-api-access-sh57q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:27:49.886660 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.886505    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-config-out" (OuterVolumeSpecName: "config-out") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:27:49.886660 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.886529    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:49.886923 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.886677    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:49.886923 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.886705    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-config-volume" (OuterVolumeSpecName: "config-volume") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:49.888004 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.887980    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:49.889940 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.889917    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:49.896265 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.896244    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-web-config" (OuterVolumeSpecName: "web-config") pod "55aced6a-47b8-490d-a769-9336ddbf02a4" (UID: "55aced6a-47b8-490d-a769-9336ddbf02a4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:49.984900 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.984874    2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-config-volume\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.984900 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.984897    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh57q\" (UniqueName: \"kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-kube-api-access-sh57q\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.985024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.984908    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-main-tls\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.985024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.984916    2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-web-config\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.985024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.984925    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.985024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.984933    2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55aced6a-47b8-490d-a769-9336ddbf02a4-tls-assets\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.985024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.984942    2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55aced6a-47b8-490d-a769-9336ddbf02a4-config-out\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.985024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.984950    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.985024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.984958    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55aced6a-47b8-490d-a769-9336ddbf02a4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.985024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.984967    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:49.985024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:49.984975    2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55aced6a-47b8-490d-a769-9336ddbf02a4-cluster-tls-config\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:27:50.522918 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.522889    2570 generic.go:356] "Generic (PLEG): container finished" podID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerID="ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf" exitCode=0
Sep 15 11:27:50.522918 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.522912    2570 generic.go:356] "Generic (PLEG): container finished" podID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerID="d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69" exitCode=0
Sep 15 11:27:50.523331 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.522973    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerDied","Data":"ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf"}
Sep 15 11:27:50.523331 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.523052    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerDied","Data":"d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69"}
Sep 15 11:27:50.523331 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.522981    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.523331 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.523082    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aced6a-47b8-490d-a769-9336ddbf02a4","Type":"ContainerDied","Data":"d6847b285ff51ef3107f869c7e863161dd0809f397957ca36ea51e30bc439983"}
Sep 15 11:27:50.523331 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.523113    2570 scope.go:117] "RemoveContainer" containerID="28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11"
Sep 15 11:27:50.532316 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.532297    2570 scope.go:117] "RemoveContainer" containerID="ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf"
Sep 15 11:27:50.539654 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.539631    2570 scope.go:117] "RemoveContainer" containerID="84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993"
Sep 15 11:27:50.545946 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.545932    2570 scope.go:117] "RemoveContainer" containerID="d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69"
Sep 15 11:27:50.549734 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.549712    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:50.553428 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.553413    2570 scope.go:117] "RemoveContainer" containerID="14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78"
Sep 15 11:27:50.554374 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.554356    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:50.559690 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.559675    2570 scope.go:117] "RemoveContainer" containerID="8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea"
Sep 15 11:27:50.566069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.566051    2570 scope.go:117] "RemoveContainer" containerID="5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577"
Sep 15 11:27:50.572475 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.572458    2570 scope.go:117] "RemoveContainer" containerID="28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11"
Sep 15 11:27:50.572748 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:27:50.572728    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11\": container with ID starting with 28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11 not found: ID does not exist" containerID="28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11"
Sep 15 11:27:50.572824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.572754    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11"} err="failed to get container status \"28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11\": rpc error: code = NotFound desc = could not find container \"28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11\": container with ID starting with 28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11 not found: ID does not exist"
Sep 15 11:27:50.572824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.572772    2570 scope.go:117] "RemoveContainer" containerID="ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf"
Sep 15 11:27:50.573026 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:27:50.573007    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf\": container with ID starting with ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf not found: ID does not exist" containerID="ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf"
Sep 15 11:27:50.573094 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.573029    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf"} err="failed to get container status \"ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf\": rpc error: code = NotFound desc = could not find container \"ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf\": container with ID starting with ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf not found: ID does not exist"
Sep 15 11:27:50.573094 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.573044    2570 scope.go:117] "RemoveContainer" containerID="84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993"
Sep 15 11:27:50.573296 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:27:50.573278    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993\": container with ID starting with 84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993 not found: ID does not exist" containerID="84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993"
Sep 15 11:27:50.573358 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.573299    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993"} err="failed to get container status \"84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993\": rpc error: code = NotFound desc = could not find container \"84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993\": container with ID starting with 84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993 not found: ID does not exist"
Sep 15 11:27:50.573358 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.573314    2570 scope.go:117] "RemoveContainer" containerID="d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69"
Sep 15 11:27:50.573544 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:27:50.573526    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69\": container with ID starting with d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69 not found: ID does not exist" containerID="d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69"
Sep 15 11:27:50.573647 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.573548    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69"} err="failed to get container status \"d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69\": rpc error: code = NotFound desc = could not find container \"d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69\": container with ID starting with d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69 not found: ID does not exist"
Sep 15 11:27:50.573707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.573648    2570 scope.go:117] "RemoveContainer" containerID="14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78"
Sep 15 11:27:50.573909 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:27:50.573892    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78\": container with ID starting with 14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78 not found: ID does not exist" containerID="14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78"
Sep 15 11:27:50.573968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.573914    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78"} err="failed to get container status \"14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78\": rpc error: code = NotFound desc = could not find container \"14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78\": container with ID starting with 14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78 not found: ID does not exist"
Sep 15 11:27:50.573968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.573929    2570 scope.go:117] "RemoveContainer" containerID="8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea"
Sep 15 11:27:50.574148 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:27:50.574132    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea\": container with ID starting with 8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea not found: ID does not exist" containerID="8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea"
Sep 15 11:27:50.574198 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.574151    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea"} err="failed to get container status \"8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea\": rpc error: code = NotFound desc = could not find container \"8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea\": container with ID starting with 8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea not found: ID does not exist"
Sep 15 11:27:50.574198 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.574164    2570 scope.go:117] "RemoveContainer" containerID="5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577"
Sep 15 11:27:50.574401 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:27:50.574386    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577\": container with ID starting with 5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577 not found: ID does not exist" containerID="5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577"
Sep 15 11:27:50.574455 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.574405    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577"} err="failed to get container status \"5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577\": rpc error: code = NotFound desc = could not find container \"5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577\": container with ID starting with 5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577 not found: ID does not exist"
Sep 15 11:27:50.574455 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.574418    2570 scope.go:117] "RemoveContainer" containerID="28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11"
Sep 15 11:27:50.574655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.574637    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11"} err="failed to get container status \"28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11\": rpc error: code = NotFound desc = could not find container \"28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11\": container with ID starting with 28182d96c340cb86d06af5db8c26091b248d0dc002d1caa1f4cba1a675df4e11 not found: ID does not exist"
Sep 15 11:27:50.574726 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.574655    2570 scope.go:117] "RemoveContainer" containerID="ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf"
Sep 15 11:27:50.574885 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.574868    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf"} err="failed to get container status \"ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf\": rpc error: code = NotFound desc = could not find container \"ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf\": container with ID starting with ad85881d230697e481a5c21c733602428190f67d954efa7991905d7de78183bf not found: ID does not exist"
Sep 15 11:27:50.574937 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.574884    2570 scope.go:117] "RemoveContainer" containerID="84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993"
Sep 15 11:27:50.575123 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.575105    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993"} err="failed to get container status \"84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993\": rpc error: code = NotFound desc = could not find container \"84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993\": container with ID starting with 84037a58ad25b951de0b98f449d4542fd1fc2a18a0ea3eefe796335de4651993 not found: ID does not exist"
Sep 15 11:27:50.575184 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.575122    2570 scope.go:117] "RemoveContainer" containerID="d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69"
Sep 15 11:27:50.575338 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.575322    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69"} err="failed to get container status \"d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69\": rpc error: code = NotFound desc = could not find container \"d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69\": container with ID starting with d4550c6a8cd61cbd5cc7e687814e1d9255446e35ac231a4d01bc861a38e52a69 not found: ID does not exist"
Sep 15 11:27:50.575402 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.575338    2570 scope.go:117] "RemoveContainer" containerID="14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78"
Sep 15 11:27:50.575525 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.575511    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78"} err="failed to get container status \"14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78\": rpc error: code = NotFound desc = could not find container \"14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78\": container with ID starting with 14afeba2c050a53aa1ede37ab36bb7d03d6bcd58ef3d93b6463000637aed5f78 not found: ID does not exist"
Sep 15 11:27:50.575591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.575525    2570 scope.go:117] "RemoveContainer" containerID="8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea"
Sep 15 11:27:50.575991 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.575748    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea"} err="failed to get container status \"8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea\": rpc error: code = NotFound desc = could not find container \"8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea\": container with ID starting with 8b25f102e241d8b7a20e58a83f29756ca48f661c2aaa2f76428b9ea7418562ea not found: ID does not exist"
Sep 15 11:27:50.575991 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.575763    2570 scope.go:117] "RemoveContainer" containerID="5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577"
Sep 15 11:27:50.575991 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.575936    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577"} err="failed to get container status \"5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577\": rpc error: code = NotFound desc = could not find container \"5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577\": container with ID starting with 5bda05acc5b333a44a0878495dd32065a7577b136e945468b2ebe044d3adc577 not found: ID does not exist"
Sep 15 11:27:50.587460 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587440    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:50.587698 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587686    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e395cb69-cd43-4294-bbdc-a0b3a42bcd38" containerName="registry"
Sep 15 11:27:50.587698 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587699    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e395cb69-cd43-4294-bbdc-a0b3a42bcd38" containerName="registry"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587709    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3067ddfc-9032-4c5b-9819-a7357dc47f3e" containerName="console"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587714    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3067ddfc-9032-4c5b-9819-a7357dc47f3e" containerName="console"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587726    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="prom-label-proxy"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587732    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="prom-label-proxy"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587738    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="init-config-reloader"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587743    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="init-config-reloader"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587748    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="alertmanager"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587753    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="alertmanager"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587758    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="config-reloader"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587763    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="config-reloader"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587768    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy-metric"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587772    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy-metric"
Sep 15 11:27:50.587777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587782    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy-web"
Sep 15 11:27:50.588115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587787    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy-web"
Sep 15 11:27:50.588115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587792    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy"
Sep 15 11:27:50.588115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587797    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy"
Sep 15 11:27:50.588115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587837    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="config-reloader"
Sep 15 11:27:50.588115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587844    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="prom-label-proxy"
Sep 15 11:27:50.588115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587850    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e395cb69-cd43-4294-bbdc-a0b3a42bcd38" containerName="registry"
Sep 15 11:27:50.588115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587856    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="alertmanager"
Sep 15 11:27:50.588115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587861    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3067ddfc-9032-4c5b-9819-a7357dc47f3e" containerName="console"
Sep 15 11:27:50.588115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587867    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy-web"
Sep 15 11:27:50.588115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587873    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy-metric"
Sep 15 11:27:50.588115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.587877    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" containerName="kube-rbac-proxy"
Sep 15 11:27:50.592652 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.592637    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.606035 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.606015    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 11:27:50.606132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.606037    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 11:27:50.606132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.606015    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 11:27:50.606132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.606057    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 11:27:50.606260 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.606175    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fgwgg\""
Sep 15 11:27:50.606356 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.606319    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 11:27:50.606411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.606320    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 11:27:50.606632 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.606618    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 11:27:50.606695 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.606650    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 11:27:50.614893 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.614153    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 11:27:50.632868 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.632843    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:50.691445 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691423    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b298d836-ff62-42d8-a730-46ab86a1af23-config-out\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691540 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691455    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2npts\" (UniqueName: \"kubernetes.io/projected/b298d836-ff62-42d8-a730-46ab86a1af23-kube-api-access-2npts\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691540 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691476    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-web-config\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691540 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691492    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691715 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691547    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b298d836-ff62-42d8-a730-46ab86a1af23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691715 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691606    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691715 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691633    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b298d836-ff62-42d8-a730-46ab86a1af23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691715 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691653    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691715 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691680    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691726    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b298d836-ff62-42d8-a730-46ab86a1af23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691743    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-config-volume\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691757    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.691864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.691786    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b298d836-ff62-42d8-a730-46ab86a1af23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.778828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.778768    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55aced6a-47b8-490d-a769-9336ddbf02a4" path="/var/lib/kubelet/pods/55aced6a-47b8-490d-a769-9336ddbf02a4/volumes"
Sep 15 11:27:50.792412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b298d836-ff62-42d8-a730-46ab86a1af23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792463 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-config-volume\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792463 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792439    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792463 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792457    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b298d836-ff62-42d8-a730-46ab86a1af23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792639 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792613    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b298d836-ff62-42d8-a730-46ab86a1af23-config-out\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792686 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2npts\" (UniqueName: \"kubernetes.io/projected/b298d836-ff62-42d8-a730-46ab86a1af23-kube-api-access-2npts\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792731 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792699    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-web-config\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792731 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792721    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792827 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792744    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b298d836-ff62-42d8-a730-46ab86a1af23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792827 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792779    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792827 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792816    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b298d836-ff62-42d8-a730-46ab86a1af23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792839    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.792967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.792861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.793362 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.793337    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b298d836-ff62-42d8-a730-46ab86a1af23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.793488 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.793467    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b298d836-ff62-42d8-a730-46ab86a1af23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.793771 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.793745    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b298d836-ff62-42d8-a730-46ab86a1af23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.795338 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.795315    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-config-volume\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.795740 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.795698    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b298d836-ff62-42d8-a730-46ab86a1af23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.795854 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.795831    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.795982 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.795964    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b298d836-ff62-42d8-a730-46ab86a1af23-config-out\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.796047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.796028    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.796342 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.796326    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.796451 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.796432    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-web-config\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.796880 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.796862    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.797414 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.797393    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b298d836-ff62-42d8-a730-46ab86a1af23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.800502 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.800480    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2npts\" (UniqueName: \"kubernetes.io/projected/b298d836-ff62-42d8-a730-46ab86a1af23-kube-api-access-2npts\") pod \"alertmanager-main-0\" (UID: \"b298d836-ff62-42d8-a730-46ab86a1af23\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:50.900655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:50.900630    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:51.182129 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:51.182099    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:51.183441 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:27:51.183417    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb298d836_ff62_42d8_a730_46ab86a1af23.slice/crio-a55d8b8f48f16c89de316c726e93035866558df75e2ce8a2033f702375d68a0b WatchSource:0}: Error finding container a55d8b8f48f16c89de316c726e93035866558df75e2ce8a2033f702375d68a0b: Status 404 returned error can't find the container with id a55d8b8f48f16c89de316c726e93035866558df75e2ce8a2033f702375d68a0b
Sep 15 11:27:51.528677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:51.528639    2570 generic.go:356] "Generic (PLEG): container finished" podID="b298d836-ff62-42d8-a730-46ab86a1af23" containerID="b19e9dfd3c4ab9e486be70cbf2115bd152c05086b1766ba650a44cfc553fbeb3" exitCode=0
Sep 15 11:27:51.529109 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:51.528733    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b298d836-ff62-42d8-a730-46ab86a1af23","Type":"ContainerDied","Data":"b19e9dfd3c4ab9e486be70cbf2115bd152c05086b1766ba650a44cfc553fbeb3"}
Sep 15 11:27:51.529109 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:51.528793    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b298d836-ff62-42d8-a730-46ab86a1af23","Type":"ContainerStarted","Data":"a55d8b8f48f16c89de316c726e93035866558df75e2ce8a2033f702375d68a0b"}
Sep 15 11:27:52.522481 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.522443    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"]
Sep 15 11:27:52.525789 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.525766    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.529032 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.529009    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 11:27:52.529430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.529413    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 11:27:52.529512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.529494    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qdnjz\""
Sep 15 11:27:52.529512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.529504    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 11:27:52.530210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.530183    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 11:27:52.530442 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.530428    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 11:27:52.539415 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.536831    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 11:27:52.541887 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.541863    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b298d836-ff62-42d8-a730-46ab86a1af23","Type":"ContainerStarted","Data":"cd8da1163cc340a9bcaf1e22ed7eccb4ef59abb09eeee415f90e17b43084eb30"}
Sep 15 11:27:52.541976 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.541963    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b298d836-ff62-42d8-a730-46ab86a1af23","Type":"ContainerStarted","Data":"9fe4c95ac6dbcba1545cdc753ee34c6e637cd41224c57f4a39181203f336779b"}
Sep 15 11:27:52.542015 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.542003    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b298d836-ff62-42d8-a730-46ab86a1af23","Type":"ContainerStarted","Data":"ff72b57943b6847d18ac17ad5c9da7fe4bee8ff993d5d7274c8a3e92815e8254"}
Sep 15 11:27:52.542056 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.542043    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b298d836-ff62-42d8-a730-46ab86a1af23","Type":"ContainerStarted","Data":"72ff3dafbf9266ebef14f2cd7e7fe39bdafb8fc69f638adcdc8bfc1bb25e25ec"}
Sep 15 11:27:52.542090 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.542073    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b298d836-ff62-42d8-a730-46ab86a1af23","Type":"ContainerStarted","Data":"6db395412e831a455750d298280c88f68d9546a57c404d95579592494e28607d"}
Sep 15 11:27:52.542121 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.542096    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b298d836-ff62-42d8-a730-46ab86a1af23","Type":"ContainerStarted","Data":"b7646c82b625999718b4f34b1ec0ac8c675c139568661d67ba0404eebb6e1400"}
Sep 15 11:27:52.552609 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.552587    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"]
Sep 15 11:27:52.621422 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.621374    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6060146680000003 podStartE2EDuration="2.62135968s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.345012ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:27:52.618957663 +0000 UTC m=+174.375204039" watchObservedRunningTime="2026-09-15 11:27:52.62135968 +0000 UTC m=+174.377606058"
Sep 15 11:27:52.709478 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.709446    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7jx9\" (UniqueName: \"kubernetes.io/projected/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-kube-api-access-d7jx9\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.709662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.709487    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.709662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.709589    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-serving-certs-ca-bundle\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.709662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.709626    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-metrics-client-ca\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.709830 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.709775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-federate-client-tls\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.709830 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.709819    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-secret-telemeter-client\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.710076 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.710058    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-telemeter-client-tls\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.710133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.710097    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.811334 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.811273    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7jx9\" (UniqueName: \"kubernetes.io/projected/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-kube-api-access-d7jx9\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.811334 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.811304    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.811334 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.811326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-serving-certs-ca-bundle\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.811516 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.811342    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-metrics-client-ca\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.811591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.811541    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-federate-client-tls\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.811645 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.811619    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-secret-telemeter-client\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.811700 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.811666    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-telemeter-client-tls\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.811748 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.811703    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.812132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.812106    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-metrics-client-ca\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.812367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.812106    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-serving-certs-ca-bundle\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.812629 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.812605    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.813982 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.813962    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-federate-client-tls\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.814105 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.814082    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-telemeter-client-tls\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.814182 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.814167    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.814299 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.814278    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-secret-telemeter-client\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.818765 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.818746    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7jx9\" (UniqueName: \"kubernetes.io/projected/5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798-kube-api-access-d7jx9\") pod \"telemeter-client-6cc4fc9ff6-d6ztx\" (UID: \"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798\") " pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:52.835659 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:52.835643    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"
Sep 15 11:27:53.112947 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:53.112923    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx"]
Sep 15 11:27:53.114754 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:27:53.114736    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f458cdf_1c0c_445a_a4e3_0e2ec5b0a798.slice/crio-bef2e2d7f91bef1a9796f4ea7876dd70fee55d56e0f08a0304b03f2a18cf10db WatchSource:0}: Error finding container bef2e2d7f91bef1a9796f4ea7876dd70fee55d56e0f08a0304b03f2a18cf10db: Status 404 returned error can't find the container with id bef2e2d7f91bef1a9796f4ea7876dd70fee55d56e0f08a0304b03f2a18cf10db
Sep 15 11:27:53.547174 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:53.547142    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx" event={"ID":"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798","Type":"ContainerStarted","Data":"bef2e2d7f91bef1a9796f4ea7876dd70fee55d56e0f08a0304b03f2a18cf10db"}
Sep 15 11:27:55.563379 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.563342    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx" event={"ID":"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798","Type":"ContainerStarted","Data":"bed71e26cc222682eafe6be9a49886988db06a3405bd208d2acc2da0dfc6d962"}
Sep 15 11:27:55.563783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.563419    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx" event={"ID":"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798","Type":"ContainerStarted","Data":"cf91bdfd4ba80db2d330434641aea46f1dec1b5ce2614bac2e4b063fa3f69106"}
Sep 15 11:27:55.563783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.563450    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx" event={"ID":"5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798","Type":"ContainerStarted","Data":"38087038328b1b85b6ba788c03e34f765e6f6cbdae3b1de04a9fe8ec7ed44d2e"}
Sep 15 11:27:55.586464 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.586419    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6cc4fc9ff6-d6ztx" podStartSLOduration=1.9759099839999998 podStartE2EDuration="3.586403046s" totalImagesPullingTime="1.610493062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:27:55.584641253 +0000 UTC m=+177.340887632" watchObservedRunningTime="2026-09-15 11:27:55.586403046 +0000 UTC m=+177.342649448"
Sep 15 11:27:55.674194 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.674166    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9f6c7bd98-kjbpw"]
Sep 15 11:27:55.677270 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.677254    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.687242 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.687217    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9f6c7bd98-kjbpw"]
Sep 15 11:27:55.752811 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.752777    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:55.840085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.839998    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-config\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.840085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.840040    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-service-ca\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.840085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.840064    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-oauth-serving-cert\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.840085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.840085    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-oauth-config\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.840360 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.840154    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-trusted-ca-bundle\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.840360 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.840193    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kt2h\" (UniqueName: \"kubernetes.io/projected/6766883b-10d7-433d-a7bf-7913f2a0a1f3-kube-api-access-4kt2h\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.840360 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.840224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-serving-cert\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.852542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.852510    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:55.941169 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.941137    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-service-ca\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.941320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.941171    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-oauth-serving-cert\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.941320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.941191    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-oauth-config\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.941320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.941218    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-trusted-ca-bundle\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.941320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.941238    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kt2h\" (UniqueName: \"kubernetes.io/projected/6766883b-10d7-433d-a7bf-7913f2a0a1f3-kube-api-access-4kt2h\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.941320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.941269    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-serving-cert\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.941617 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.941343    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-config\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.941983 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.941957    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-oauth-serving-cert\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.942097 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.942066    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-config\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.942145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.942118    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-service-ca\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.942186 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.942178    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-trusted-ca-bundle\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.944199 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.944177    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-serving-cert\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.944356 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.944335    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-oauth-config\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.949378 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.949361    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kt2h\" (UniqueName: \"kubernetes.io/projected/6766883b-10d7-433d-a7bf-7913f2a0a1f3-kube-api-access-4kt2h\") pod \"console-9f6c7bd98-kjbpw\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") " pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:55.953190 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.953161    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:55.986052 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:55.986030    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:27:56.016659 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:56.016625    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:56.256253 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:56.256230    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9f6c7bd98-kjbpw"]
Sep 15 11:27:56.258221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:27:56.258188    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6766883b_10d7_433d_a7bf_7913f2a0a1f3.slice/crio-a083dd69bd5adb6365ab30b437ca5f229e82ba611fb68aa482db753c4ad8b624 WatchSource:0}: Error finding container a083dd69bd5adb6365ab30b437ca5f229e82ba611fb68aa482db753c4ad8b624: Status 404 returned error can't find the container with id a083dd69bd5adb6365ab30b437ca5f229e82ba611fb68aa482db753c4ad8b624
Sep 15 11:27:56.485324 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:56.485280    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:27:56.568816 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:56.568779    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f6c7bd98-kjbpw" event={"ID":"6766883b-10d7-433d-a7bf-7913f2a0a1f3","Type":"ContainerStarted","Data":"447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5"}
Sep 15 11:27:56.569189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:56.568839    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f6c7bd98-kjbpw" event={"ID":"6766883b-10d7-433d-a7bf-7913f2a0a1f3","Type":"ContainerStarted","Data":"a083dd69bd5adb6365ab30b437ca5f229e82ba611fb68aa482db753c4ad8b624"}
Sep 15 11:27:56.591882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:56.591834    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9f6c7bd98-kjbpw" podStartSLOduration=1.5918190779999999 podStartE2EDuration="1.591819078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:27:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:27:56.591384619 +0000 UTC m=+178.347630998" watchObservedRunningTime="2026-09-15 11:27:56.591819078 +0000 UTC m=+178.348065455"
Sep 15 11:27:59.408978 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:27:59.408941    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:28:02.916489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:02.916453    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:28:05.986585 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:05.986516    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:28:05.987000 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:05.986601    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:28:05.991222 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:05.991199    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:28:06.613672 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:06.613642    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:28:06.659601 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:06.659548    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79bfc98db5-t62rx"]
Sep 15 11:28:07.089148 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:07.089111    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:28:07.190416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:07.190385    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:28:31.679865 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:31.679809    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79bfc98db5-t62rx" podUID="b3e4c2f0-3777-4e95-bcdb-8c124473dea8" containerName="console" containerID="cri-o://929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856" gracePeriod=15
Sep 15 11:28:31.913694 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:31.913662    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:28:32.013329 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013297    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-config\") pod \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") "
Sep 15 11:28:32.013483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013341    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-oauth-serving-cert\") pod \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") "
Sep 15 11:28:32.013483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013360    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-oauth-config\") pod \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") "
Sep 15 11:28:32.013483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013395    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-service-ca\") pod \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") "
Sep 15 11:28:32.013611 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013517    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-trusted-ca-bundle\") pod \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") "
Sep 15 11:28:32.013716 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013698    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb88k\" (UniqueName: \"kubernetes.io/projected/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-kube-api-access-hb88k\") pod \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") "
Sep 15 11:28:32.013805 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013738    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-serving-cert\") pod \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\" (UID: \"b3e4c2f0-3777-4e95-bcdb-8c124473dea8\") "
Sep 15 11:28:32.013912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013858    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-config" (OuterVolumeSpecName: "console-config") pod "b3e4c2f0-3777-4e95-bcdb-8c124473dea8" (UID: "b3e4c2f0-3777-4e95-bcdb-8c124473dea8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:28:32.013912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013869    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-service-ca" (OuterVolumeSpecName: "service-ca") pod "b3e4c2f0-3777-4e95-bcdb-8c124473dea8" (UID: "b3e4c2f0-3777-4e95-bcdb-8c124473dea8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:28:32.013912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013886    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b3e4c2f0-3777-4e95-bcdb-8c124473dea8" (UID: "b3e4c2f0-3777-4e95-bcdb-8c124473dea8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:28:32.014110 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013984    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-config\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:28:32.014110 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.014001    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-oauth-serving-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:28:32.014110 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.013994    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b3e4c2f0-3777-4e95-bcdb-8c124473dea8" (UID: "b3e4c2f0-3777-4e95-bcdb-8c124473dea8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:28:32.014110 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.014013    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:28:32.015492 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.015470    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b3e4c2f0-3777-4e95-bcdb-8c124473dea8" (UID: "b3e4c2f0-3777-4e95-bcdb-8c124473dea8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:28:32.015703 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.015674    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-kube-api-access-hb88k" (OuterVolumeSpecName: "kube-api-access-hb88k") pod "b3e4c2f0-3777-4e95-bcdb-8c124473dea8" (UID: "b3e4c2f0-3777-4e95-bcdb-8c124473dea8"). InnerVolumeSpecName "kube-api-access-hb88k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:28:32.015785 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.015718    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b3e4c2f0-3777-4e95-bcdb-8c124473dea8" (UID: "b3e4c2f0-3777-4e95-bcdb-8c124473dea8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:28:32.114397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.114356    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb88k\" (UniqueName: \"kubernetes.io/projected/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-kube-api-access-hb88k\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:28:32.114397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.114387    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-serving-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:28:32.114397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.114396    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-console-oauth-config\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:28:32.114397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.114406    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e4c2f0-3777-4e95-bcdb-8c124473dea8-trusted-ca-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:28:32.706891 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.706853    2570 generic.go:356] "Generic (PLEG): container finished" podID="b3e4c2f0-3777-4e95-bcdb-8c124473dea8" containerID="929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856" exitCode=0
Sep 15 11:28:32.707341 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.706904    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bfc98db5-t62rx"
Sep 15 11:28:32.707341 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.706900    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bfc98db5-t62rx" event={"ID":"b3e4c2f0-3777-4e95-bcdb-8c124473dea8","Type":"ContainerDied","Data":"929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856"}
Sep 15 11:28:32.707341 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.706963    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bfc98db5-t62rx" event={"ID":"b3e4c2f0-3777-4e95-bcdb-8c124473dea8","Type":"ContainerDied","Data":"cb798aedf8b75aba23998fd70d0df184782188e3e1f821915bc24f8c1b86b5c0"}
Sep 15 11:28:32.707341 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.706989    2570 scope.go:117] "RemoveContainer" containerID="929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856"
Sep 15 11:28:32.718423 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.718401    2570 scope.go:117] "RemoveContainer" containerID="929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856"
Sep 15 11:28:32.718745 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:28:32.718727    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856\": container with ID starting with 929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856 not found: ID does not exist" containerID="929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856"
Sep 15 11:28:32.718808 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.718752    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856"} err="failed to get container status \"929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856\": rpc error: code = NotFound desc = could not find container \"929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856\": container with ID starting with 929a88698e30daadc04a4ebb7ce96c8fcd8060d3e1f8dde62eb0abbf2205e856 not found: ID does not exist"
Sep 15 11:28:32.727419 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.727394    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79bfc98db5-t62rx"]
Sep 15 11:28:32.730406 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.730384    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79bfc98db5-t62rx"]
Sep 15 11:28:32.779210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:32.779180    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3e4c2f0-3777-4e95-bcdb-8c124473dea8" path="/var/lib/kubelet/pods/b3e4c2f0-3777-4e95-bcdb-8c124473dea8/volumes"
Sep 15 11:28:48.388995 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:48.388960    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:28:48.493096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:28:48.493050    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:29:02.728847 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:02.728812    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:29:02.813633 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:02.813596    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:29:14.685892 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:14.685851    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:29:14.784303 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:14.784264    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:29:31.568884 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:31.568784    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:29:31.670467 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:31.670434    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:29:34.785651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.785618    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-577fc8c7-pkv8r"]
Sep 15 11:29:34.786129 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.785891    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3e4c2f0-3777-4e95-bcdb-8c124473dea8" containerName="console"
Sep 15 11:29:34.786129 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.785902    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3e4c2f0-3777-4e95-bcdb-8c124473dea8" containerName="console"
Sep 15 11:29:34.786129 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.785960    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3e4c2f0-3777-4e95-bcdb-8c124473dea8" containerName="console"
Sep 15 11:29:34.788773 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.788755    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.807604 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.807578    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577fc8c7-pkv8r"]
Sep 15 11:29:34.856222 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.856187    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:29:34.891571 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.891532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-console-config\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.891703 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.891616    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-oauth-serving-cert\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.891703 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.891643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-serving-cert\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.891703 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.891672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-trusted-ca-bundle\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.891867 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.891708    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hskcp\" (UniqueName: \"kubernetes.io/projected/41c455c2-710f-4d93-96ad-909d303ffdc1-kube-api-access-hskcp\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.891867 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.891747    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-oauth-config\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.891867 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.891799    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-service-ca\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.939703 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.939673    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:29:34.992520 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.992486    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-oauth-serving-cert\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.992520 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.992520    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-serving-cert\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.992745 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.992539    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-trusted-ca-bundle\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.992745 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.992582    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hskcp\" (UniqueName: \"kubernetes.io/projected/41c455c2-710f-4d93-96ad-909d303ffdc1-kube-api-access-hskcp\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.992745 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.992607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-oauth-config\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.992745 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.992629    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-service-ca\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.992745 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.992653    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-console-config\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.993366 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.993312    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-service-ca\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.993366 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.993319    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-oauth-serving-cert\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.993503 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.993421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-trusted-ca-bundle\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.993503 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.993458    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-console-config\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.994986 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.994963    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-oauth-config\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:34.995088 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:34.995052    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-serving-cert\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:35.005915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:35.005889    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hskcp\" (UniqueName: \"kubernetes.io/projected/41c455c2-710f-4d93-96ad-909d303ffdc1-kube-api-access-hskcp\") pod \"console-577fc8c7-pkv8r\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") " pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:35.098032 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:35.097961    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:35.372230 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:35.372203    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577fc8c7-pkv8r"]
Sep 15 11:29:35.374767 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:29:35.374741    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c455c2_710f_4d93_96ad_909d303ffdc1.slice/crio-da28d526f7424f492b49f99189aefe966eb838385724749271954bb325f0ee58 WatchSource:0}: Error finding container da28d526f7424f492b49f99189aefe966eb838385724749271954bb325f0ee58: Status 404 returned error can't find the container with id da28d526f7424f492b49f99189aefe966eb838385724749271954bb325f0ee58
Sep 15 11:29:35.935921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:35.935887    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577fc8c7-pkv8r" event={"ID":"41c455c2-710f-4d93-96ad-909d303ffdc1","Type":"ContainerStarted","Data":"9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6"}
Sep 15 11:29:35.936277 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:35.935931    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577fc8c7-pkv8r" event={"ID":"41c455c2-710f-4d93-96ad-909d303ffdc1","Type":"ContainerStarted","Data":"da28d526f7424f492b49f99189aefe966eb838385724749271954bb325f0ee58"}
Sep 15 11:29:35.974533 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:35.974487    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-577fc8c7-pkv8r" podStartSLOduration=1.9744715419999999 podStartE2EDuration="1.974471542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:29:35.972421395 +0000 UTC m=+277.728667772" watchObservedRunningTime="2026-09-15 11:29:35.974471542 +0000 UTC m=+277.730717919"
Sep 15 11:29:45.098833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:45.098802    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:45.099247 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:45.098848    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:45.103495 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:45.103471    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:45.976164 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:45.976135    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:29:46.032130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:46.032094    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9f6c7bd98-kjbpw"]
Sep 15 11:29:46.197660 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:46.197628    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:29:46.367076 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:46.367037    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:29:58.671829 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:29:58.671799    2570 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 11:30:11.050769 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.050699    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9f6c7bd98-kjbpw" podUID="6766883b-10d7-433d-a7bf-7913f2a0a1f3" containerName="console" containerID="cri-o://447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5" gracePeriod=15
Sep 15 11:30:11.282815 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.282788    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:30:11.284742 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.284719    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-oauth-config\") pod \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") "
Sep 15 11:30:11.284882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.284757    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-config\") pod \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") "
Sep 15 11:30:11.284882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.284786    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-trusted-ca-bundle\") pod \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") "
Sep 15 11:30:11.284882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.284803    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-oauth-serving-cert\") pod \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") "
Sep 15 11:30:11.284882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.284829    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kt2h\" (UniqueName: \"kubernetes.io/projected/6766883b-10d7-433d-a7bf-7913f2a0a1f3-kube-api-access-4kt2h\") pod \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") "
Sep 15 11:30:11.284882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.284860    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-service-ca\") pod \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") "
Sep 15 11:30:11.285153 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.284894    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-serving-cert\") pod \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\" (UID: \"6766883b-10d7-433d-a7bf-7913f2a0a1f3\") "
Sep 15 11:30:11.285241 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.285214    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6766883b-10d7-433d-a7bf-7913f2a0a1f3" (UID: "6766883b-10d7-433d-a7bf-7913f2a0a1f3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:30:11.285363 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.285235    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6766883b-10d7-433d-a7bf-7913f2a0a1f3" (UID: "6766883b-10d7-433d-a7bf-7913f2a0a1f3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:30:11.285363 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.285221    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-config" (OuterVolumeSpecName: "console-config") pod "6766883b-10d7-433d-a7bf-7913f2a0a1f3" (UID: "6766883b-10d7-433d-a7bf-7913f2a0a1f3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:30:11.285363 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.285332    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-service-ca" (OuterVolumeSpecName: "service-ca") pod "6766883b-10d7-433d-a7bf-7913f2a0a1f3" (UID: "6766883b-10d7-433d-a7bf-7913f2a0a1f3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:30:11.286778 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.286750    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6766883b-10d7-433d-a7bf-7913f2a0a1f3" (UID: "6766883b-10d7-433d-a7bf-7913f2a0a1f3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:30:11.286957 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.286942    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6766883b-10d7-433d-a7bf-7913f2a0a1f3" (UID: "6766883b-10d7-433d-a7bf-7913f2a0a1f3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:30:11.287239 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.287215    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6766883b-10d7-433d-a7bf-7913f2a0a1f3-kube-api-access-4kt2h" (OuterVolumeSpecName: "kube-api-access-4kt2h") pod "6766883b-10d7-433d-a7bf-7913f2a0a1f3" (UID: "6766883b-10d7-433d-a7bf-7913f2a0a1f3"). InnerVolumeSpecName "kube-api-access-4kt2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:30:11.385530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.385436    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:11.385530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.385469    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-serving-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:11.385530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.385482    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-oauth-config\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:11.385530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.385495    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-console-config\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:11.385530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.385506    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-trusted-ca-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:11.385530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.385518    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6766883b-10d7-433d-a7bf-7913f2a0a1f3-oauth-serving-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:11.385530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:11.385530    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kt2h\" (UniqueName: \"kubernetes.io/projected/6766883b-10d7-433d-a7bf-7913f2a0a1f3-kube-api-access-4kt2h\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:12.070229 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:12.070192    2570 generic.go:356] "Generic (PLEG): container finished" podID="6766883b-10d7-433d-a7bf-7913f2a0a1f3" containerID="447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5" exitCode=0
Sep 15 11:30:12.070630 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:12.070235    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f6c7bd98-kjbpw"
Sep 15 11:30:12.070630 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:12.070256    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f6c7bd98-kjbpw" event={"ID":"6766883b-10d7-433d-a7bf-7913f2a0a1f3","Type":"ContainerDied","Data":"447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5"}
Sep 15 11:30:12.070630 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:12.070301    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f6c7bd98-kjbpw" event={"ID":"6766883b-10d7-433d-a7bf-7913f2a0a1f3","Type":"ContainerDied","Data":"a083dd69bd5adb6365ab30b437ca5f229e82ba611fb68aa482db753c4ad8b624"}
Sep 15 11:30:12.070630 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:12.070323    2570 scope.go:117] "RemoveContainer" containerID="447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5"
Sep 15 11:30:12.080478 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:12.080458    2570 scope.go:117] "RemoveContainer" containerID="447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5"
Sep 15 11:30:12.081039 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:30:12.081020    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5\": container with ID starting with 447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5 not found: ID does not exist" containerID="447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5"
Sep 15 11:30:12.081105 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:12.081047    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5"} err="failed to get container status \"447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5\": rpc error: code = NotFound desc = could not find container \"447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5\": container with ID starting with 447939a7111714034172be7dda8f348c38784f2d7c5ae353c6ca81b8469309c5 not found: ID does not exist"
Sep 15 11:30:12.096352 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:12.096331    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9f6c7bd98-kjbpw"]
Sep 15 11:30:12.102628 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:12.102602    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9f6c7bd98-kjbpw"]
Sep 15 11:30:12.783646 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:12.781707    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6766883b-10d7-433d-a7bf-7913f2a0a1f3" path="/var/lib/kubelet/pods/6766883b-10d7-433d-a7bf-7913f2a0a1f3/volumes"
Sep 15 11:30:15.237066 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:15.237032    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:16.653626 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.653584    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:16.789724 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.789693    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"]
Sep 15 11:30:16.789981 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.789970    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6766883b-10d7-433d-a7bf-7913f2a0a1f3" containerName="console"
Sep 15 11:30:16.790026 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.789983    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6766883b-10d7-433d-a7bf-7913f2a0a1f3" containerName="console"
Sep 15 11:30:16.790065 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.790040    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6766883b-10d7-433d-a7bf-7913f2a0a1f3" containerName="console"
Sep 15 11:30:16.794359 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.794342    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:16.796934 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.796915    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:30:16.797049 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.796979    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:30:16.797114 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.797097    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vf97c\""
Sep 15 11:30:16.804664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.804637    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"]
Sep 15 11:30:16.817454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.817432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:16.817545 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.817459    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpng2\" (UniqueName: \"kubernetes.io/projected/705d8940-246d-4b26-893c-aa0749c5c313-kube-api-access-wpng2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:16.817545 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.817481    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:16.918655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.918542    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:16.918655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.918601    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpng2\" (UniqueName: \"kubernetes.io/projected/705d8940-246d-4b26-893c-aa0749c5c313-kube-api-access-wpng2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:16.918655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.918633    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:16.918937 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.918870    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:16.918997 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.918979    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:16.927233 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:16.927211    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpng2\" (UniqueName: \"kubernetes.io/projected/705d8940-246d-4b26-893c-aa0749c5c313-kube-api-access-wpng2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:17.103390 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:17.103360    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:17.379022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:17.378998    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"]
Sep 15 11:30:17.381545 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:30:17.381514    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705d8940_246d_4b26_893c_aa0749c5c313.slice/crio-fa0f5694a5d48dcc4097490b1ba3cfb7d7e7b558c1e847ad70b029f999d2a14d WatchSource:0}: Error finding container fa0f5694a5d48dcc4097490b1ba3cfb7d7e7b558c1e847ad70b029f999d2a14d: Status 404 returned error can't find the container with id fa0f5694a5d48dcc4097490b1ba3cfb7d7e7b558c1e847ad70b029f999d2a14d
Sep 15 11:30:17.383411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:17.383394    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:30:18.094832 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:18.094798    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd" event={"ID":"705d8940-246d-4b26-893c-aa0749c5c313","Type":"ContainerStarted","Data":"fa0f5694a5d48dcc4097490b1ba3cfb7d7e7b558c1e847ad70b029f999d2a14d"}
Sep 15 11:30:23.116354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:23.116318    2570 generic.go:356] "Generic (PLEG): container finished" podID="705d8940-246d-4b26-893c-aa0749c5c313" containerID="43f3dc4002dcacf97d1c15cd08d852dcd73457506ccf70047989b4b7ddfda282" exitCode=0
Sep 15 11:30:23.116727 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:23.116399    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd" event={"ID":"705d8940-246d-4b26-893c-aa0749c5c313","Type":"ContainerDied","Data":"43f3dc4002dcacf97d1c15cd08d852dcd73457506ccf70047989b4b7ddfda282"}
Sep 15 11:30:25.125838 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:25.125802    2570 generic.go:356] "Generic (PLEG): container finished" podID="705d8940-246d-4b26-893c-aa0749c5c313" containerID="b3f354aca3d47d15abc224fb6216f85440571fb51a2d028ec0d35595015864c3" exitCode=0
Sep 15 11:30:25.126286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:25.125844    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd" event={"ID":"705d8940-246d-4b26-893c-aa0749c5c313","Type":"ContainerDied","Data":"b3f354aca3d47d15abc224fb6216f85440571fb51a2d028ec0d35595015864c3"}
Sep 15 11:30:32.158648 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:32.158601    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd" event={"ID":"705d8940-246d-4b26-893c-aa0749c5c313","Type":"ContainerStarted","Data":"06623ca3773dffd7dbc37c6e190705bc55c6fb9f4b681a1b5ab8649e0b32fd14"}
Sep 15 11:30:32.178239 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:32.178187    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd" podStartSLOduration=1.930410963 podStartE2EDuration="16.178171694s" totalImagesPullingTime="14.247760731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:30:32.177757213 +0000 UTC m=+333.934003592" watchObservedRunningTime="2026-09-15 11:30:32.178171694 +0000 UTC m=+333.934418116"
Sep 15 11:30:33.164842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:33.164803    2570 generic.go:356] "Generic (PLEG): container finished" podID="705d8940-246d-4b26-893c-aa0749c5c313" containerID="06623ca3773dffd7dbc37c6e190705bc55c6fb9f4b681a1b5ab8649e0b32fd14" exitCode=0
Sep 15 11:30:33.165219 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:33.164884    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd" event={"ID":"705d8940-246d-4b26-893c-aa0749c5c313","Type":"ContainerDied","Data":"06623ca3773dffd7dbc37c6e190705bc55c6fb9f4b681a1b5ab8649e0b32fd14"}
Sep 15 11:30:34.285177 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:34.285153    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:34.354434 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:34.354403    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-bundle\") pod \"705d8940-246d-4b26-893c-aa0749c5c313\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") "
Sep 15 11:30:34.354434 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:34.354432    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpng2\" (UniqueName: \"kubernetes.io/projected/705d8940-246d-4b26-893c-aa0749c5c313-kube-api-access-wpng2\") pod \"705d8940-246d-4b26-893c-aa0749c5c313\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") "
Sep 15 11:30:34.354647 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:34.354459    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-util\") pod \"705d8940-246d-4b26-893c-aa0749c5c313\" (UID: \"705d8940-246d-4b26-893c-aa0749c5c313\") "
Sep 15 11:30:34.355074 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:34.355046    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-bundle" (OuterVolumeSpecName: "bundle") pod "705d8940-246d-4b26-893c-aa0749c5c313" (UID: "705d8940-246d-4b26-893c-aa0749c5c313"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:30:34.356519 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:34.356493    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/705d8940-246d-4b26-893c-aa0749c5c313-kube-api-access-wpng2" (OuterVolumeSpecName: "kube-api-access-wpng2") pod "705d8940-246d-4b26-893c-aa0749c5c313" (UID: "705d8940-246d-4b26-893c-aa0749c5c313"). InnerVolumeSpecName "kube-api-access-wpng2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:30:34.359596 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:34.359569    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-util" (OuterVolumeSpecName: "util") pod "705d8940-246d-4b26-893c-aa0749c5c313" (UID: "705d8940-246d-4b26-893c-aa0749c5c313"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:30:34.456066 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:34.455986    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:34.456066 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:34.456011    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpng2\" (UniqueName: \"kubernetes.io/projected/705d8940-246d-4b26-893c-aa0749c5c313-kube-api-access-wpng2\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:34.456066 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:34.456021    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/705d8940-246d-4b26-893c-aa0749c5c313-util\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:35.174195 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:35.174117    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd" event={"ID":"705d8940-246d-4b26-893c-aa0749c5c313","Type":"ContainerDied","Data":"fa0f5694a5d48dcc4097490b1ba3cfb7d7e7b558c1e847ad70b029f999d2a14d"}
Sep 15 11:30:35.174195 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:35.174155    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c7wzd"
Sep 15 11:30:35.174195 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:35.174163    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa0f5694a5d48dcc4097490b1ba3cfb7d7e7b558c1e847ad70b029f999d2a14d"
Sep 15 11:30:38.091493 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:38.091457    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:38.582723 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:38.582684    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:40.285260 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.285226    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx"]
Sep 15 11:30:40.285637 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.285501    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705d8940-246d-4b26-893c-aa0749c5c313" containerName="pull"
Sep 15 11:30:40.285637 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.285512    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="705d8940-246d-4b26-893c-aa0749c5c313" containerName="pull"
Sep 15 11:30:40.285637 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.285521    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705d8940-246d-4b26-893c-aa0749c5c313" containerName="extract"
Sep 15 11:30:40.285637 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.285527    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="705d8940-246d-4b26-893c-aa0749c5c313" containerName="extract"
Sep 15 11:30:40.285637 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.285534    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705d8940-246d-4b26-893c-aa0749c5c313" containerName="util"
Sep 15 11:30:40.285637 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.285539    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="705d8940-246d-4b26-893c-aa0749c5c313" containerName="util"
Sep 15 11:30:40.285637 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.285600    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="705d8940-246d-4b26-893c-aa0749c5c313" containerName="extract"
Sep 15 11:30:40.325607 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.325574    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx"]
Sep 15 11:30:40.325777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.325696    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx"
Sep 15 11:30:40.330768 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.330744    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-m7fb6\""
Sep 15 11:30:40.330882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.330744    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 15 11:30:40.330882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.330751    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:30:40.405787 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.405752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmclx\" (UniqueName: \"kubernetes.io/projected/955b87cc-6be0-465f-92a1-df8cd2164c70-kube-api-access-lmclx\") pod \"cert-manager-operator-controller-manager-55c444bf86-rdmgx\" (UID: \"955b87cc-6be0-465f-92a1-df8cd2164c70\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx"
Sep 15 11:30:40.405966 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.405813    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/955b87cc-6be0-465f-92a1-df8cd2164c70-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rdmgx\" (UID: \"955b87cc-6be0-465f-92a1-df8cd2164c70\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx"
Sep 15 11:30:40.506880 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.506844    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/955b87cc-6be0-465f-92a1-df8cd2164c70-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rdmgx\" (UID: \"955b87cc-6be0-465f-92a1-df8cd2164c70\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx"
Sep 15 11:30:40.507005 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.506921    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmclx\" (UniqueName: \"kubernetes.io/projected/955b87cc-6be0-465f-92a1-df8cd2164c70-kube-api-access-lmclx\") pod \"cert-manager-operator-controller-manager-55c444bf86-rdmgx\" (UID: \"955b87cc-6be0-465f-92a1-df8cd2164c70\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx"
Sep 15 11:30:40.507247 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.507228    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/955b87cc-6be0-465f-92a1-df8cd2164c70-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rdmgx\" (UID: \"955b87cc-6be0-465f-92a1-df8cd2164c70\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx"
Sep 15 11:30:40.517084 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.517053    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmclx\" (UniqueName: \"kubernetes.io/projected/955b87cc-6be0-465f-92a1-df8cd2164c70-kube-api-access-lmclx\") pod \"cert-manager-operator-controller-manager-55c444bf86-rdmgx\" (UID: \"955b87cc-6be0-465f-92a1-df8cd2164c70\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx"
Sep 15 11:30:40.634950 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.634867    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx"
Sep 15 11:30:40.937874 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:40.937795    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx"]
Sep 15 11:30:40.941212 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:30:40.941179    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955b87cc_6be0_465f_92a1_df8cd2164c70.slice/crio-01c38ad398a5cecccf41676707247284fa50ddcbe3c7185bebefecfaeb36174c WatchSource:0}: Error finding container 01c38ad398a5cecccf41676707247284fa50ddcbe3c7185bebefecfaeb36174c: Status 404 returned error can't find the container with id 01c38ad398a5cecccf41676707247284fa50ddcbe3c7185bebefecfaeb36174c
Sep 15 11:30:41.197896 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:41.197813    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx" event={"ID":"955b87cc-6be0-465f-92a1-df8cd2164c70","Type":"ContainerStarted","Data":"01c38ad398a5cecccf41676707247284fa50ddcbe3c7185bebefecfaeb36174c"}
Sep 15 11:30:42.126939 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:42.126901    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:42.224952 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:42.224914    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:43.208971 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:43.208933    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx" event={"ID":"955b87cc-6be0-465f-92a1-df8cd2164c70","Type":"ContainerStarted","Data":"5e6601e412a2b0050a345cac25af61ce867cdea30db1ad331ea3daea3b49e212"}
Sep 15 11:30:43.249735 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:43.249680    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rdmgx" podStartSLOduration=1.441332209 podStartE2EDuration="3.249663794s" totalImagesPullingTime="1.808331585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:30:43.247503676 +0000 UTC m=+345.003750055" watchObservedRunningTime="2026-09-15 11:30:43.249663794 +0000 UTC m=+345.005910172"
Sep 15 11:30:43.564865 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:43.564836    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:43.658906 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:43.658874    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:44.414375 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.414344    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"]
Sep 15 11:30:44.438715 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.438676    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"]
Sep 15 11:30:44.438888 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.438800    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:44.441896 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.441876    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:30:44.442026 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.441997    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vf97c\""
Sep 15 11:30:44.442916 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.442896    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:30:44.539944 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.539908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:44.540105 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.539948    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:44.540105 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.540035    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhck8\" (UniqueName: \"kubernetes.io/projected/45f6aae6-b700-439f-91cb-fea4a2f39127-kube-api-access-nhck8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:44.640470 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.640430    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhck8\" (UniqueName: \"kubernetes.io/projected/45f6aae6-b700-439f-91cb-fea4a2f39127-kube-api-access-nhck8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:44.640663 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.640505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:44.640707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.640664    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:44.640959 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.640943    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:44.640999 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.640967    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:44.650247 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.650224    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhck8\" (UniqueName: \"kubernetes.io/projected/45f6aae6-b700-439f-91cb-fea4a2f39127-kube-api-access-nhck8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:44.748059 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:44.747980    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:45.050412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:45.050379    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"]
Sep 15 11:30:45.053589 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:30:45.053548    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f6aae6_b700_439f_91cb_fea4a2f39127.slice/crio-0dd0e1220acf13ac44a4c6ad519b8d1e32a89170e9b0a00e396c7e11213078f6 WatchSource:0}: Error finding container 0dd0e1220acf13ac44a4c6ad519b8d1e32a89170e9b0a00e396c7e11213078f6: Status 404 returned error can't find the container with id 0dd0e1220acf13ac44a4c6ad519b8d1e32a89170e9b0a00e396c7e11213078f6
Sep 15 11:30:45.218251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:45.218217    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt" event={"ID":"45f6aae6-b700-439f-91cb-fea4a2f39127","Type":"ContainerStarted","Data":"83049421b6b21cd9fa0f308f2735d34fc67535dcb33003dcf8a3df0e65fb41e2"}
Sep 15 11:30:45.218493 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:45.218282    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt" event={"ID":"45f6aae6-b700-439f-91cb-fea4a2f39127","Type":"ContainerStarted","Data":"0dd0e1220acf13ac44a4c6ad519b8d1e32a89170e9b0a00e396c7e11213078f6"}
Sep 15 11:30:45.574210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:45.574177    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:46.151414 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.151385    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:46.171710 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.171679    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs"]
Sep 15 11:30:46.174243 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.174229    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs"
Sep 15 11:30:46.179679 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.179660    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 11:30:46.180427 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.180366    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dqr8g\""
Sep 15 11:30:46.180427 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.180407    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 11:30:46.186544 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.186523    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs"]
Sep 15 11:30:46.224077 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.224046    2570 generic.go:356] "Generic (PLEG): container finished" podID="45f6aae6-b700-439f-91cb-fea4a2f39127" containerID="83049421b6b21cd9fa0f308f2735d34fc67535dcb33003dcf8a3df0e65fb41e2" exitCode=0
Sep 15 11:30:46.224241 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.224125    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt" event={"ID":"45f6aae6-b700-439f-91cb-fea4a2f39127","Type":"ContainerDied","Data":"83049421b6b21cd9fa0f308f2735d34fc67535dcb33003dcf8a3df0e65fb41e2"}
Sep 15 11:30:46.255296 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.255264    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29zgs\" (UniqueName: \"kubernetes.io/projected/fdc6214c-ea60-447c-911f-5c971f686f85-kube-api-access-29zgs\") pod \"cert-manager-cainjector-559cdd8c87-p2xbs\" (UID: \"fdc6214c-ea60-447c-911f-5c971f686f85\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs"
Sep 15 11:30:46.255475 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.255318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdc6214c-ea60-447c-911f-5c971f686f85-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p2xbs\" (UID: \"fdc6214c-ea60-447c-911f-5c971f686f85\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs"
Sep 15 11:30:46.361083 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.361046    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29zgs\" (UniqueName: \"kubernetes.io/projected/fdc6214c-ea60-447c-911f-5c971f686f85-kube-api-access-29zgs\") pod \"cert-manager-cainjector-559cdd8c87-p2xbs\" (UID: \"fdc6214c-ea60-447c-911f-5c971f686f85\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs"
Sep 15 11:30:46.361260 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.361108    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdc6214c-ea60-447c-911f-5c971f686f85-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p2xbs\" (UID: \"fdc6214c-ea60-447c-911f-5c971f686f85\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs"
Sep 15 11:30:46.372671 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.372647    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdc6214c-ea60-447c-911f-5c971f686f85-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p2xbs\" (UID: \"fdc6214c-ea60-447c-911f-5c971f686f85\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs"
Sep 15 11:30:46.372807 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.372796    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29zgs\" (UniqueName: \"kubernetes.io/projected/fdc6214c-ea60-447c-911f-5c971f686f85-kube-api-access-29zgs\") pod \"cert-manager-cainjector-559cdd8c87-p2xbs\" (UID: \"fdc6214c-ea60-447c-911f-5c971f686f85\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs"
Sep 15 11:30:46.483038 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.482953    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs"
Sep 15 11:30:46.757819 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:46.757793    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs"]
Sep 15 11:30:46.760440 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:30:46.760417    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdc6214c_ea60_447c_911f_5c971f686f85.slice/crio-b60191daced60801566c6ea17c78f023c3daf2907f4ddfc75d8cbc97e1cbdd20 WatchSource:0}: Error finding container b60191daced60801566c6ea17c78f023c3daf2907f4ddfc75d8cbc97e1cbdd20: Status 404 returned error can't find the container with id b60191daced60801566c6ea17c78f023c3daf2907f4ddfc75d8cbc97e1cbdd20
Sep 15 11:30:47.229750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:47.229710    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs" event={"ID":"fdc6214c-ea60-447c-911f-5c971f686f85","Type":"ContainerStarted","Data":"b60191daced60801566c6ea17c78f023c3daf2907f4ddfc75d8cbc97e1cbdd20"}
Sep 15 11:30:49.163251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:49.163173    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:49.630723 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:49.630685    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:50.245412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.245375    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs" event={"ID":"fdc6214c-ea60-447c-911f-5c971f686f85","Type":"ContainerStarted","Data":"6232ed689e401e9aa7373f198cdece9982bba309fd92cacc99c7ab0375edfb14"}
Sep 15 11:30:50.247551 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.247523    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt" event={"ID":"45f6aae6-b700-439f-91cb-fea4a2f39127","Type":"ContainerStarted","Data":"e9459a0638b354a921c1facef4c8e1bb7bb7b988f66e819ac484a15ed9404fad"}
Sep 15 11:30:50.287542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.287491    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p2xbs" podStartSLOduration=0.956244493 podStartE2EDuration="4.287474959s" totalImagesPullingTime="3.331230466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:30:50.287231378 +0000 UTC m=+352.043477756" watchObservedRunningTime="2026-09-15 11:30:50.287474959 +0000 UTC m=+352.043721336"
Sep 15 11:30:50.547235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.547201    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pthl4"]
Sep 15 11:30:50.551164 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.551142    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4"
Sep 15 11:30:50.556303 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.556282    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-c9kjm\""
Sep 15 11:30:50.588531 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.588490    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pthl4"]
Sep 15 11:30:50.696774 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.696732    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c07fc8d0-6895-4bc2-8355-b19244f6d9fd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pthl4\" (UID: \"c07fc8d0-6895-4bc2-8355-b19244f6d9fd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4"
Sep 15 11:30:50.696950 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.696870    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkgv6\" (UniqueName: \"kubernetes.io/projected/c07fc8d0-6895-4bc2-8355-b19244f6d9fd-kube-api-access-mkgv6\") pod \"cert-manager-webhook-6486ffd997-pthl4\" (UID: \"c07fc8d0-6895-4bc2-8355-b19244f6d9fd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4"
Sep 15 11:30:50.797793 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.797714    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c07fc8d0-6895-4bc2-8355-b19244f6d9fd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pthl4\" (UID: \"c07fc8d0-6895-4bc2-8355-b19244f6d9fd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4"
Sep 15 11:30:50.797793 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.797777    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkgv6\" (UniqueName: \"kubernetes.io/projected/c07fc8d0-6895-4bc2-8355-b19244f6d9fd-kube-api-access-mkgv6\") pod \"cert-manager-webhook-6486ffd997-pthl4\" (UID: \"c07fc8d0-6895-4bc2-8355-b19244f6d9fd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4"
Sep 15 11:30:50.812251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.812215    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkgv6\" (UniqueName: \"kubernetes.io/projected/c07fc8d0-6895-4bc2-8355-b19244f6d9fd-kube-api-access-mkgv6\") pod \"cert-manager-webhook-6486ffd997-pthl4\" (UID: \"c07fc8d0-6895-4bc2-8355-b19244f6d9fd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4"
Sep 15 11:30:50.832185 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.832159    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c07fc8d0-6895-4bc2-8355-b19244f6d9fd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pthl4\" (UID: \"c07fc8d0-6895-4bc2-8355-b19244f6d9fd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4"
Sep 15 11:30:50.861214 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:50.861184    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4"
Sep 15 11:30:51.172450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:51.172348    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pthl4"]
Sep 15 11:30:51.176109 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:30:51.176076    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc07fc8d0_6895_4bc2_8355_b19244f6d9fd.slice/crio-78250b013f4ba123b91acf05f4bd79e536d1e779d6aeb228e027951ff3e57766 WatchSource:0}: Error finding container 78250b013f4ba123b91acf05f4bd79e536d1e779d6aeb228e027951ff3e57766: Status 404 returned error can't find the container with id 78250b013f4ba123b91acf05f4bd79e536d1e779d6aeb228e027951ff3e57766
Sep 15 11:30:51.254690 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:51.254654    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4" event={"ID":"c07fc8d0-6895-4bc2-8355-b19244f6d9fd","Type":"ContainerStarted","Data":"75b585ba41920e9c83efa96438a0370611af8695e316349cd7cf21b8c5e9a567"}
Sep 15 11:30:51.255085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:51.254705    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4" event={"ID":"c07fc8d0-6895-4bc2-8355-b19244f6d9fd","Type":"ContainerStarted","Data":"78250b013f4ba123b91acf05f4bd79e536d1e779d6aeb228e027951ff3e57766"}
Sep 15 11:30:51.255085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:51.254746    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4"
Sep 15 11:30:51.257100 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:51.257071    2570 generic.go:356] "Generic (PLEG): container finished" podID="45f6aae6-b700-439f-91cb-fea4a2f39127" containerID="e9459a0638b354a921c1facef4c8e1bb7bb7b988f66e819ac484a15ed9404fad" exitCode=0
Sep 15 11:30:51.257227 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:51.257156    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt" event={"ID":"45f6aae6-b700-439f-91cb-fea4a2f39127","Type":"ContainerDied","Data":"e9459a0638b354a921c1facef4c8e1bb7bb7b988f66e819ac484a15ed9404fad"}
Sep 15 11:30:51.286625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:51.286580    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4" podStartSLOduration=1.286547881 podStartE2EDuration="1.286547881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:30:51.28530117 +0000 UTC m=+353.041547548" watchObservedRunningTime="2026-09-15 11:30:51.286547881 +0000 UTC m=+353.042794258"
Sep 15 11:30:51.533247 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:51.533213    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:51.724975 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:51.724933    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:52.263979 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:52.263943    2570 generic.go:356] "Generic (PLEG): container finished" podID="45f6aae6-b700-439f-91cb-fea4a2f39127" containerID="8b19f0c9ccbe8f7dd1f771f791d1599325df52b341ab58bde2708553d1c236c7" exitCode=0
Sep 15 11:30:52.264437 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:52.264013    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt" event={"ID":"45f6aae6-b700-439f-91cb-fea4a2f39127","Type":"ContainerDied","Data":"8b19f0c9ccbe8f7dd1f771f791d1599325df52b341ab58bde2708553d1c236c7"}
Sep 15 11:30:53.391519 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:53.391497    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:53.522845 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:53.522754    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-util\") pod \"45f6aae6-b700-439f-91cb-fea4a2f39127\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") "
Sep 15 11:30:53.522845 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:53.522792    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhck8\" (UniqueName: \"kubernetes.io/projected/45f6aae6-b700-439f-91cb-fea4a2f39127-kube-api-access-nhck8\") pod \"45f6aae6-b700-439f-91cb-fea4a2f39127\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") "
Sep 15 11:30:53.522845 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:53.522824    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-bundle\") pod \"45f6aae6-b700-439f-91cb-fea4a2f39127\" (UID: \"45f6aae6-b700-439f-91cb-fea4a2f39127\") "
Sep 15 11:30:53.523219 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:53.523196    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-bundle" (OuterVolumeSpecName: "bundle") pod "45f6aae6-b700-439f-91cb-fea4a2f39127" (UID: "45f6aae6-b700-439f-91cb-fea4a2f39127"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:30:53.524849 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:53.524829    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45f6aae6-b700-439f-91cb-fea4a2f39127-kube-api-access-nhck8" (OuterVolumeSpecName: "kube-api-access-nhck8") pod "45f6aae6-b700-439f-91cb-fea4a2f39127" (UID: "45f6aae6-b700-439f-91cb-fea4a2f39127"). InnerVolumeSpecName "kube-api-access-nhck8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:30:53.527411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:53.527372    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-util" (OuterVolumeSpecName: "util") pod "45f6aae6-b700-439f-91cb-fea4a2f39127" (UID: "45f6aae6-b700-439f-91cb-fea4a2f39127"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:30:53.623515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:53.623477    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-util\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:53.623515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:53.623506    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhck8\" (UniqueName: \"kubernetes.io/projected/45f6aae6-b700-439f-91cb-fea4a2f39127-kube-api-access-nhck8\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:53.623515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:53.623521    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45f6aae6-b700-439f-91cb-fea4a2f39127-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:30:54.152479 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:54.152450    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:54.274150 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:54.274123    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt"
Sep 15 11:30:54.274150 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:54.274141    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcz9gt" event={"ID":"45f6aae6-b700-439f-91cb-fea4a2f39127","Type":"ContainerDied","Data":"0dd0e1220acf13ac44a4c6ad519b8d1e32a89170e9b0a00e396c7e11213078f6"}
Sep 15 11:30:54.274397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:54.274183    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dd0e1220acf13ac44a4c6ad519b8d1e32a89170e9b0a00e396c7e11213078f6"
Sep 15 11:30:56.310259 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:56.310227    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:56.440514 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:56.440480    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:30:57.266335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:30:57.266305    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pthl4"
Sep 15 11:31:01.024135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:01.024092    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:01.098684 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:01.098647    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:02.123760 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:02.123725    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:02.230481 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:02.230446    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:03.827885 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.827846    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"]
Sep 15 11:31:03.828335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.828266    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f6aae6-b700-439f-91cb-fea4a2f39127" containerName="pull"
Sep 15 11:31:03.828335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.828284    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f6aae6-b700-439f-91cb-fea4a2f39127" containerName="pull"
Sep 15 11:31:03.828335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.828295    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f6aae6-b700-439f-91cb-fea4a2f39127" containerName="extract"
Sep 15 11:31:03.828335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.828302    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f6aae6-b700-439f-91cb-fea4a2f39127" containerName="extract"
Sep 15 11:31:03.828335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.828316    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f6aae6-b700-439f-91cb-fea4a2f39127" containerName="util"
Sep 15 11:31:03.828335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.828323    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f6aae6-b700-439f-91cb-fea4a2f39127" containerName="util"
Sep 15 11:31:03.828645 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.828418    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="45f6aae6-b700-439f-91cb-fea4a2f39127" containerName="extract"
Sep 15 11:31:03.832934 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.832912    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:03.835895 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.835874    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:31:03.836008 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.835895    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:31:03.836008 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.835916    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vf97c\""
Sep 15 11:31:03.841383 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:03.841363    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"]
Sep 15 11:31:04.016422 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.016371    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qd8q\" (UniqueName: \"kubernetes.io/projected/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-kube-api-access-8qd8q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:04.016635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.016462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:04.016635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.016518    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:04.117344 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.117254    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:04.117344 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.117326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:04.117551 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.117418    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qd8q\" (UniqueName: \"kubernetes.io/projected/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-kube-api-access-8qd8q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:04.117659 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.117636    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:04.117712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.117657    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:04.126206 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.126181    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qd8q\" (UniqueName: \"kubernetes.io/projected/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-kube-api-access-8qd8q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:04.142101 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.142078    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:04.167431 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.167392    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:04.175574 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.175535    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-npf9g"]
Sep 15 11:31:04.178871 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.178853    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-npf9g"
Sep 15 11:31:04.183874 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.183855    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k66rv\""
Sep 15 11:31:04.193169 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.193110    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-npf9g"]
Sep 15 11:31:04.319129 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.319100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da576127-6f5f-4864-a68f-e0ad553ee911-bound-sa-token\") pod \"cert-manager-55b4d954d5-npf9g\" (UID: \"da576127-6f5f-4864-a68f-e0ad553ee911\") " pod="cert-manager/cert-manager-55b4d954d5-npf9g"
Sep 15 11:31:04.319306 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.319144    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk6cm\" (UniqueName: \"kubernetes.io/projected/da576127-6f5f-4864-a68f-e0ad553ee911-kube-api-access-kk6cm\") pod \"cert-manager-55b4d954d5-npf9g\" (UID: \"da576127-6f5f-4864-a68f-e0ad553ee911\") " pod="cert-manager/cert-manager-55b4d954d5-npf9g"
Sep 15 11:31:04.420431 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.420294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da576127-6f5f-4864-a68f-e0ad553ee911-bound-sa-token\") pod \"cert-manager-55b4d954d5-npf9g\" (UID: \"da576127-6f5f-4864-a68f-e0ad553ee911\") " pod="cert-manager/cert-manager-55b4d954d5-npf9g"
Sep 15 11:31:04.420431 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.420357    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk6cm\" (UniqueName: \"kubernetes.io/projected/da576127-6f5f-4864-a68f-e0ad553ee911-kube-api-access-kk6cm\") pod \"cert-manager-55b4d954d5-npf9g\" (UID: \"da576127-6f5f-4864-a68f-e0ad553ee911\") " pod="cert-manager/cert-manager-55b4d954d5-npf9g"
Sep 15 11:31:04.422105 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.422087    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"]
Sep 15 11:31:04.424226 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:31:04.424202    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4de2d1b_65a2_4d85_955a_34010a8c5e1a.slice/crio-07cc2fade8cf0434c77add017abfa5168606acb495b156c56fe61c664bc2c136 WatchSource:0}: Error finding container 07cc2fade8cf0434c77add017abfa5168606acb495b156c56fe61c664bc2c136: Status 404 returned error can't find the container with id 07cc2fade8cf0434c77add017abfa5168606acb495b156c56fe61c664bc2c136
Sep 15 11:31:04.429052 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.429028    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da576127-6f5f-4864-a68f-e0ad553ee911-bound-sa-token\") pod \"cert-manager-55b4d954d5-npf9g\" (UID: \"da576127-6f5f-4864-a68f-e0ad553ee911\") " pod="cert-manager/cert-manager-55b4d954d5-npf9g"
Sep 15 11:31:04.429320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.429304    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk6cm\" (UniqueName: \"kubernetes.io/projected/da576127-6f5f-4864-a68f-e0ad553ee911-kube-api-access-kk6cm\") pod \"cert-manager-55b4d954d5-npf9g\" (UID: \"da576127-6f5f-4864-a68f-e0ad553ee911\") " pod="cert-manager/cert-manager-55b4d954d5-npf9g"
Sep 15 11:31:04.489623 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.489598    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-npf9g"
Sep 15 11:31:04.782670 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:04.782643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-npf9g"]
Sep 15 11:31:04.782963 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:31:04.782943    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda576127_6f5f_4864_a68f_e0ad553ee911.slice/crio-194ecb57c26045a91c76777a5da9d214c75518f1abf17fd07df8d46cf9305435 WatchSource:0}: Error finding container 194ecb57c26045a91c76777a5da9d214c75518f1abf17fd07df8d46cf9305435: Status 404 returned error can't find the container with id 194ecb57c26045a91c76777a5da9d214c75518f1abf17fd07df8d46cf9305435
Sep 15 11:31:05.327061 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:05.327027    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-npf9g" event={"ID":"da576127-6f5f-4864-a68f-e0ad553ee911","Type":"ContainerStarted","Data":"f6eaa82879f5028803372929bd948d00a5ea4ddb1158100e816f7a10681e3157"}
Sep 15 11:31:05.327470 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:05.327072    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-npf9g" event={"ID":"da576127-6f5f-4864-a68f-e0ad553ee911","Type":"ContainerStarted","Data":"194ecb57c26045a91c76777a5da9d214c75518f1abf17fd07df8d46cf9305435"}
Sep 15 11:31:05.328464 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:05.328436    2570 generic.go:356] "Generic (PLEG): container finished" podID="d4de2d1b-65a2-4d85-955a-34010a8c5e1a" containerID="4bdca72c9a62019081efb929075faefa6a7ba9eed51890c7ad6f9eaedb3d0e1e" exitCode=0
Sep 15 11:31:05.328574 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:05.328485    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk" event={"ID":"d4de2d1b-65a2-4d85-955a-34010a8c5e1a","Type":"ContainerDied","Data":"4bdca72c9a62019081efb929075faefa6a7ba9eed51890c7ad6f9eaedb3d0e1e"}
Sep 15 11:31:05.328574 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:05.328522    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk" event={"ID":"d4de2d1b-65a2-4d85-955a-34010a8c5e1a","Type":"ContainerStarted","Data":"07cc2fade8cf0434c77add017abfa5168606acb495b156c56fe61c664bc2c136"}
Sep 15 11:31:05.362712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:05.362669    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-npf9g" podStartSLOduration=1.3626531339999999 podStartE2EDuration="1.362653134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:05.362489049 +0000 UTC m=+367.118735432" watchObservedRunningTime="2026-09-15 11:31:05.362653134 +0000 UTC m=+367.118899512"
Sep 15 11:31:06.334642 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:06.334607    2570 generic.go:356] "Generic (PLEG): container finished" podID="d4de2d1b-65a2-4d85-955a-34010a8c5e1a" containerID="0b7e8c7eb615eae19627d31caa235ac724156e29feda92d8d21ed84bbaba0d0d" exitCode=0
Sep 15 11:31:06.335034 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:06.334689    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk" event={"ID":"d4de2d1b-65a2-4d85-955a-34010a8c5e1a","Type":"ContainerDied","Data":"0b7e8c7eb615eae19627d31caa235ac724156e29feda92d8d21ed84bbaba0d0d"}
Sep 15 11:31:07.341336 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:07.341301    2570 generic.go:356] "Generic (PLEG): container finished" podID="d4de2d1b-65a2-4d85-955a-34010a8c5e1a" containerID="19c9ad9fb07d6c3d0928a2e63c18333bf3232fe9f4d49bf4d6a887763696202a" exitCode=0
Sep 15 11:31:07.341732 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:07.341379    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk" event={"ID":"d4de2d1b-65a2-4d85-955a-34010a8c5e1a","Type":"ContainerDied","Data":"19c9ad9fb07d6c3d0928a2e63c18333bf3232fe9f4d49bf4d6a887763696202a"}
Sep 15 11:31:08.467110 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:08.467088    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:08.654688 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:08.654602    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-bundle\") pod \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") "
Sep 15 11:31:08.654688 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:08.654658    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qd8q\" (UniqueName: \"kubernetes.io/projected/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-kube-api-access-8qd8q\") pod \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") "
Sep 15 11:31:08.654881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:08.654698    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-util\") pod \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\" (UID: \"d4de2d1b-65a2-4d85-955a-34010a8c5e1a\") "
Sep 15 11:31:08.655338 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:08.655309    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-bundle" (OuterVolumeSpecName: "bundle") pod "d4de2d1b-65a2-4d85-955a-34010a8c5e1a" (UID: "d4de2d1b-65a2-4d85-955a-34010a8c5e1a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:31:08.656699 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:08.656673    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-kube-api-access-8qd8q" (OuterVolumeSpecName: "kube-api-access-8qd8q") pod "d4de2d1b-65a2-4d85-955a-34010a8c5e1a" (UID: "d4de2d1b-65a2-4d85-955a-34010a8c5e1a"). InnerVolumeSpecName "kube-api-access-8qd8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:31:08.660509 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:08.660482    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-util" (OuterVolumeSpecName: "util") pod "d4de2d1b-65a2-4d85-955a-34010a8c5e1a" (UID: "d4de2d1b-65a2-4d85-955a-34010a8c5e1a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:31:08.755182 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:08.755152    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-util\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:31:08.755182 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:08.755177    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:31:08.755182 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:08.755187    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qd8q\" (UniqueName: \"kubernetes.io/projected/d4de2d1b-65a2-4d85-955a-34010a8c5e1a-kube-api-access-8qd8q\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:31:09.352683 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:09.352655    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk"
Sep 15 11:31:09.352824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:09.352682    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwphgk" event={"ID":"d4de2d1b-65a2-4d85-955a-34010a8c5e1a","Type":"ContainerDied","Data":"07cc2fade8cf0434c77add017abfa5168606acb495b156c56fe61c664bc2c136"}
Sep 15 11:31:09.352824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:09.352723    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07cc2fade8cf0434c77add017abfa5168606acb495b156c56fe61c664bc2c136"
Sep 15 11:31:15.021132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.021093    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"]
Sep 15 11:31:15.021649 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.021385    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4de2d1b-65a2-4d85-955a-34010a8c5e1a" containerName="pull"
Sep 15 11:31:15.021649 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.021396    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4de2d1b-65a2-4d85-955a-34010a8c5e1a" containerName="pull"
Sep 15 11:31:15.021649 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.021413    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4de2d1b-65a2-4d85-955a-34010a8c5e1a" containerName="util"
Sep 15 11:31:15.021649 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.021418    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4de2d1b-65a2-4d85-955a-34010a8c5e1a" containerName="util"
Sep 15 11:31:15.021649 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.021427    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4de2d1b-65a2-4d85-955a-34010a8c5e1a" containerName="extract"
Sep 15 11:31:15.021649 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.021434    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4de2d1b-65a2-4d85-955a-34010a8c5e1a" containerName="extract"
Sep 15 11:31:15.021649 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.021488    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4de2d1b-65a2-4d85-955a-34010a8c5e1a" containerName="extract"
Sep 15 11:31:15.025947 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.025930    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:15.029456 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.029424    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:31:15.029603 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.029517    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vf97c\""
Sep 15 11:31:15.030339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.030324    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:31:15.036151 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.036128    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"]
Sep 15 11:31:15.105260 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.105229    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:15.105488 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.105273    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs4qj\" (UniqueName: \"kubernetes.io/projected/2a1d7e07-7599-4a59-b3d1-438a27378183-kube-api-access-rs4qj\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:15.105488 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.105374    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:15.206633 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.206595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:15.206783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.206647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs4qj\" (UniqueName: \"kubernetes.io/projected/2a1d7e07-7599-4a59-b3d1-438a27378183-kube-api-access-rs4qj\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:15.206783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.206696    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:15.206971 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.206953    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:15.207015 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.206984    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:15.235171 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.235134    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs4qj\" (UniqueName: \"kubernetes.io/projected/2a1d7e07-7599-4a59-b3d1-438a27378183-kube-api-access-rs4qj\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:15.335800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.335706    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:15.635526 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.635441    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"]
Sep 15 11:31:15.639335 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:31:15.639309    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a1d7e07_7599_4a59_b3d1_438a27378183.slice/crio-f8c59090fc25588027021f0f75a8f606192cc528ff55b9457e7f27a787143fad WatchSource:0}: Error finding container f8c59090fc25588027021f0f75a8f606192cc528ff55b9457e7f27a787143fad: Status 404 returned error can't find the container with id f8c59090fc25588027021f0f75a8f606192cc528ff55b9457e7f27a787143fad
Sep 15 11:31:15.830309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.830274    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:15.937646 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:15.937535    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:16.386506 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:16.386471    2570 generic.go:356] "Generic (PLEG): container finished" podID="2a1d7e07-7599-4a59-b3d1-438a27378183" containerID="45f7f49a34bee46f54c50f19c19bf49114f3fc85cf321fbe34e1569a567e9f74" exitCode=0
Sep 15 11:31:16.386924 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:16.386551    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578" event={"ID":"2a1d7e07-7599-4a59-b3d1-438a27378183","Type":"ContainerDied","Data":"45f7f49a34bee46f54c50f19c19bf49114f3fc85cf321fbe34e1569a567e9f74"}
Sep 15 11:31:16.386924 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:16.386620    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578" event={"ID":"2a1d7e07-7599-4a59-b3d1-438a27378183","Type":"ContainerStarted","Data":"f8c59090fc25588027021f0f75a8f606192cc528ff55b9457e7f27a787143fad"}
Sep 15 11:31:16.400426 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:16.400399    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:17.063242 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.063157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:17.184166 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.184129    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:17.223875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.223839    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"]
Sep 15 11:31:17.227240 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.227218    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.254425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.254387    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 11:31:17.254594 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.254472    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 11:31:17.256605 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.256591    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 11:31:17.262422 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.262403    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 11:31:17.277761 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.277726    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"]
Sep 15 11:31:17.279997 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.279980    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7mtn4\""
Sep 15 11:31:17.320908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.320813    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjjth\" (UniqueName: \"kubernetes.io/projected/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-kube-api-access-wjjth\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.320908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.320859    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.320908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.320891    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-manifests\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.321133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.320922    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-tmp\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.321133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.320940    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.392399 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.392366    2570 generic.go:356] "Generic (PLEG): container finished" podID="2a1d7e07-7599-4a59-b3d1-438a27378183" containerID="eeb5a67be329e8674b064e39b4bbe5aea3c421798443f8de51390616da4263b3" exitCode=0
Sep 15 11:31:17.392790 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.392428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578" event={"ID":"2a1d7e07-7599-4a59-b3d1-438a27378183","Type":"ContainerDied","Data":"eeb5a67be329e8674b064e39b4bbe5aea3c421798443f8de51390616da4263b3"}
Sep 15 11:31:17.421436 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.421409    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-manifests\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.421586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.421447    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-tmp\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.421586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.421468    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.421586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.421517    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjth\" (UniqueName: \"kubernetes.io/projected/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-kube-api-access-wjjth\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.421586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.421537    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.421914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.421869    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-manifests\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.423742 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.423719    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-tmp\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.423942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.423926    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.423986 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.423949    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.432547 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.432517    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjjth\" (UniqueName: \"kubernetes.io/projected/897c21f2-2e72-4eb7-b254-d5f8c61ea0fe-kube-api-access-wjjth\") pod \"opendatahub-operator-controller-manager-99f4658c8-z47gb\" (UID: \"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.502341 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.502293    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:17.542407 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.542376    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:17.603341 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.603308    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:17.739815 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.739781    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:17.831051 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.831023    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"]
Sep 15 11:31:17.833758 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:31:17.833727    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897c21f2_2e72_4eb7_b254_d5f8c61ea0fe.slice/crio-d5ca249810b08c7cca2ff4a2d5c9291354069226b696e938969eebfa566a4a7b WatchSource:0}: Error finding container d5ca249810b08c7cca2ff4a2d5c9291354069226b696e938969eebfa566a4a7b: Status 404 returned error can't find the container with id d5ca249810b08c7cca2ff4a2d5c9291354069226b696e938969eebfa566a4a7b
Sep 15 11:31:17.845068 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.844964    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:17.943475 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:17.943443    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:18.060127 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:18.060099    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:18.400736 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:18.400681    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb" event={"ID":"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe","Type":"ContainerStarted","Data":"d5ca249810b08c7cca2ff4a2d5c9291354069226b696e938969eebfa566a4a7b"}
Sep 15 11:31:18.403599 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:18.403549    2570 generic.go:356] "Generic (PLEG): container finished" podID="2a1d7e07-7599-4a59-b3d1-438a27378183" containerID="e7a2ddd4b4b17699fc9d5ad041abc990bff3c1d275c152771096515e38d0cab8" exitCode=0
Sep 15 11:31:18.403734 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:18.403656    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578" event={"ID":"2a1d7e07-7599-4a59-b3d1-438a27378183","Type":"ContainerDied","Data":"e7a2ddd4b4b17699fc9d5ad041abc990bff3c1d275c152771096515e38d0cab8"}
Sep 15 11:31:20.624098 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:20.624075    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:20.645049 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:20.645009    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-bundle\") pod \"2a1d7e07-7599-4a59-b3d1-438a27378183\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") "
Sep 15 11:31:20.645219 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:20.645075    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs4qj\" (UniqueName: \"kubernetes.io/projected/2a1d7e07-7599-4a59-b3d1-438a27378183-kube-api-access-rs4qj\") pod \"2a1d7e07-7599-4a59-b3d1-438a27378183\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") "
Sep 15 11:31:20.645219 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:20.645105    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-util\") pod \"2a1d7e07-7599-4a59-b3d1-438a27378183\" (UID: \"2a1d7e07-7599-4a59-b3d1-438a27378183\") "
Sep 15 11:31:20.645661 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:20.645628    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-bundle" (OuterVolumeSpecName: "bundle") pod "2a1d7e07-7599-4a59-b3d1-438a27378183" (UID: "2a1d7e07-7599-4a59-b3d1-438a27378183"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:31:20.647186 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:20.647150    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a1d7e07-7599-4a59-b3d1-438a27378183-kube-api-access-rs4qj" (OuterVolumeSpecName: "kube-api-access-rs4qj") pod "2a1d7e07-7599-4a59-b3d1-438a27378183" (UID: "2a1d7e07-7599-4a59-b3d1-438a27378183"). InnerVolumeSpecName "kube-api-access-rs4qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:31:20.650286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:20.650263    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-util" (OuterVolumeSpecName: "util") pod "2a1d7e07-7599-4a59-b3d1-438a27378183" (UID: "2a1d7e07-7599-4a59-b3d1-438a27378183"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:31:20.745900 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:20.745871    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs4qj\" (UniqueName: \"kubernetes.io/projected/2a1d7e07-7599-4a59-b3d1-438a27378183-kube-api-access-rs4qj\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:31:20.745900 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:20.745901    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-util\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:31:20.746052 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:20.745914    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a1d7e07-7599-4a59-b3d1-438a27378183-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:31:21.420623 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:21.420586    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb" event={"ID":"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe","Type":"ContainerStarted","Data":"5cfbede05d7017652060387e351d4229b7d1a3d577c7c521ef1fee399da8d444"}
Sep 15 11:31:21.422459 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:21.422432    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578" event={"ID":"2a1d7e07-7599-4a59-b3d1-438a27378183","Type":"ContainerDied","Data":"f8c59090fc25588027021f0f75a8f606192cc528ff55b9457e7f27a787143fad"}
Sep 15 11:31:21.422459 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:21.422457    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0c2578"
Sep 15 11:31:21.422632 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:21.422470    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8c59090fc25588027021f0f75a8f606192cc528ff55b9457e7f27a787143fad"
Sep 15 11:31:22.429144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:22.429110    2570 generic.go:356] "Generic (PLEG): container finished" podID="897c21f2-2e72-4eb7-b254-d5f8c61ea0fe" containerID="5cfbede05d7017652060387e351d4229b7d1a3d577c7c521ef1fee399da8d444" exitCode=0
Sep 15 11:31:22.429540 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:22.429197    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb" event={"ID":"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe","Type":"ContainerDied","Data":"5cfbede05d7017652060387e351d4229b7d1a3d577c7c521ef1fee399da8d444"}
Sep 15 11:31:23.436828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:23.436736    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb" event={"ID":"897c21f2-2e72-4eb7-b254-d5f8c61ea0fe","Type":"ContainerStarted","Data":"73705b8a205ab1767587427a0e5c82d096e4b5a9dea238ce7ddf46d2e57f10ce"}
Sep 15 11:31:23.436828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:23.436818    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:23.460239 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:23.460192    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb" podStartSLOduration=1.934168209 podStartE2EDuration="6.460178905s" totalImagesPullingTime="3.526963214s" totalInitContainerRuntime="999.047482ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:23.457417177 +0000 UTC m=+385.213663555" watchObservedRunningTime="2026-09-15 11:31:23.460178905 +0000 UTC m=+385.216425282"
Sep 15 11:31:32.692082 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:32.692046    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:32.792554 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:32.792520    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:34.443707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.443675    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-z47gb"
Sep 15 11:31:34.710224 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.710141    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"]
Sep 15 11:31:34.710461 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.710449    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a1d7e07-7599-4a59-b3d1-438a27378183" containerName="util"
Sep 15 11:31:34.710508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.710463    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a1d7e07-7599-4a59-b3d1-438a27378183" containerName="util"
Sep 15 11:31:34.710508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.710474    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a1d7e07-7599-4a59-b3d1-438a27378183" containerName="pull"
Sep 15 11:31:34.710508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.710480    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a1d7e07-7599-4a59-b3d1-438a27378183" containerName="pull"
Sep 15 11:31:34.710508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.710488    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a1d7e07-7599-4a59-b3d1-438a27378183" containerName="extract"
Sep 15 11:31:34.710508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.710494    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a1d7e07-7599-4a59-b3d1-438a27378183" containerName="extract"
Sep 15 11:31:34.710679 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.710571    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a1d7e07-7599-4a59-b3d1-438a27378183" containerName="extract"
Sep 15 11:31:34.718360 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.718339    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.721847 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.721825    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 11:31:34.722417 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.722380    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 11:31:34.722664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.722643    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:31:34.722755 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.722684    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 11:31:34.722755 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.722687    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qwmrt\""
Sep 15 11:31:34.722868 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.722651    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 11:31:34.725796 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.725776    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"]
Sep 15 11:31:34.759055 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.759020    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hsfk\" (UniqueName: \"kubernetes.io/projected/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-kube-api-access-6hsfk\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.759229 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.759073    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-metrics-cert\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.759229 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.759157    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-cert\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.759229 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.759189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-manager-config\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.860293 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.860256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-cert\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.860293 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.860305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-manager-config\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.860596 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.860364    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hsfk\" (UniqueName: \"kubernetes.io/projected/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-kube-api-access-6hsfk\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.860596 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.860418    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-metrics-cert\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.861274 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.861252    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-manager-config\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.862943 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.862918    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-metrics-cert\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.863037 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.862944    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-cert\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:34.870377 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:34.870352    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hsfk\" (UniqueName: \"kubernetes.io/projected/a6dc0392-0914-4ccf-a71d-4c233ebc0f74-kube-api-access-6hsfk\") pod \"lws-controller-manager-f6db84f6f-xjp8c\" (UID: \"a6dc0392-0914-4ccf-a71d-4c233ebc0f74\") " pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:35.028480 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:35.028435    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:35.303112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:35.303082    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"]
Sep 15 11:31:35.305346 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:31:35.305317    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6dc0392_0914_4ccf_a71d_4c233ebc0f74.slice/crio-c2a4141592bc487339318ddf7cd97de90049adf607c2148f99b41c0d6e2d6960 WatchSource:0}: Error finding container c2a4141592bc487339318ddf7cd97de90049adf607c2148f99b41c0d6e2d6960: Status 404 returned error can't find the container with id c2a4141592bc487339318ddf7cd97de90049adf607c2148f99b41c0d6e2d6960
Sep 15 11:31:35.495087 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:35.495047    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c" event={"ID":"a6dc0392-0914-4ccf-a71d-4c233ebc0f74","Type":"ContainerStarted","Data":"c2a4141592bc487339318ddf7cd97de90049adf607c2148f99b41c0d6e2d6960"}
Sep 15 11:31:36.342784 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:36.342738    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:36.467680 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:36.467642    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:37.507262 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:37.507223    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c" event={"ID":"a6dc0392-0914-4ccf-a71d-4c233ebc0f74","Type":"ContainerStarted","Data":"e8038b2fba5a1f55884e02ee3ec10d391a4d3f8f8c6519bf5543b7a3b345890b"}
Sep 15 11:31:37.507741 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:37.507284    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:37.529126 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:37.529057    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c" podStartSLOduration=2.100691636 podStartE2EDuration="3.529032484s" totalImagesPullingTime="1.428340848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:37.527797524 +0000 UTC m=+399.284043906" watchObservedRunningTime="2026-09-15 11:31:37.529032484 +0000 UTC m=+399.285278859"
Sep 15 11:31:38.112419 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:38.112382    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:38.415992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:38.415907    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:39.590705 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:39.590658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:39.662131 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:39.662093    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:40.653337 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:40.653299    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:44.668341 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:44.668308    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:44.828169 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:44.828136    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:45.692456 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.692421    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"]
Sep 15 11:31:45.697580 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.697539    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.700222 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.700199    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 11:31:45.701135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.701109    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-54jtt\""
Sep 15 11:31:45.701271 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.701237    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 11:31:45.701390 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.701284    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 11:31:45.706924 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.706898    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"]
Sep 15 11:31:45.725260 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.725221    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:45.755810 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.755780    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.755993 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.755824    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6781897f-e47d-4691-a433-3c0cb776eb42-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.755993 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.755843    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhf9h\" (UniqueName: \"kubernetes.io/projected/6781897f-e47d-4691-a433-3c0cb776eb42-kube-api-access-vhf9h\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.755993 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.755925    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6781897f-e47d-4691-a433-3c0cb776eb42-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.756165 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.755994    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.756165 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.756067    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.756165 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.756101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6781897f-e47d-4691-a433-3c0cb776eb42-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.756311 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.756175    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.756311 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.756201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.855107 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.855062    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dddc58d6-6mgwx"]
Sep 15 11:31:45.857078 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857054    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.857199 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.857265 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6781897f-e47d-4691-a433-3c0cb776eb42-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.857318 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857276    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.857429 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857407    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.857538 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857513    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.857627 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857600    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.857686 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857638    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.857686 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857653    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6781897f-e47d-4691-a433-3c0cb776eb42-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.857789 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857694    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhf9h\" (UniqueName: \"kubernetes.io/projected/6781897f-e47d-4691-a433-3c0cb776eb42-kube-api-access-vhf9h\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.857789 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857733    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6781897f-e47d-4691-a433-3c0cb776eb42-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.857890 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857800    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.858168 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.857908    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.858653 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.858631    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6781897f-e47d-4691-a433-3c0cb776eb42-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.858873 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.858857    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:45.859794 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.859763    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6781897f-e47d-4691-a433-3c0cb776eb42-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.860370 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.860342    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6781897f-e47d-4691-a433-3c0cb776eb42-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.886714 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.885322    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6781897f-e47d-4691-a433-3c0cb776eb42-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.886714 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.885322    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhf9h\" (UniqueName: \"kubernetes.io/projected/6781897f-e47d-4691-a433-3c0cb776eb42-kube-api-access-vhf9h\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb\" (UID: \"6781897f-e47d-4691-a433-3c0cb776eb42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:45.886714 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.886639    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dddc58d6-6mgwx"]
Sep 15 11:31:45.943865 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.943757    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:45.958328 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.958301    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-console-config\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:45.958328 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.958331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qt82\" (UniqueName: \"kubernetes.io/projected/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-kube-api-access-6qt82\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:45.958525 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.958351    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-oauth-serving-cert\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:45.958525 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.958367    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-console-serving-cert\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:45.958525 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.958472    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-trusted-ca-bundle\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:45.958525 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.958511    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-service-ca\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:45.958679 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:45.958610    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-console-oauth-config\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.009203 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.009171    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:46.045513 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.045471    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:46.059427 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.059396    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-oauth-serving-cert\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.059640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.059441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-console-serving-cert\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.059640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.059506    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-trusted-ca-bundle\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.059640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.059549    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-service-ca\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.059640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.059636    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-console-oauth-config\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.059880 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.059686    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-console-config\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.059880 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.059710    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qt82\" (UniqueName: \"kubernetes.io/projected/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-kube-api-access-6qt82\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.060222 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.060199    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-oauth-serving-cert\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.062778 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.060825    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-service-ca\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.062778 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.061452    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-console-config\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.062778 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.062736    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-trusted-ca-bundle\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.063267 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.063245    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-console-oauth-config\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.063929 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.063909    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-console-serving-cert\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.073766 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.073293    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qt82\" (UniqueName: \"kubernetes.io/projected/fe4e12a7-6b6c-4e4c-b14f-874bcd4814af-kube-api-access-6qt82\") pod \"console-5dddc58d6-6mgwx\" (UID: \"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af\") " pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.196495 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.196390    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:46.286442 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.286414    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"]
Sep 15 11:31:46.288234 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:31:46.288208    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6781897f_e47d_4691_a433_3c0cb776eb42.slice/crio-98c3b5fec68db980610d6dc98b15344add8534098099da1f6df42ed968532198 WatchSource:0}: Error finding container 98c3b5fec68db980610d6dc98b15344add8534098099da1f6df42ed968532198: Status 404 returned error can't find the container with id 98c3b5fec68db980610d6dc98b15344add8534098099da1f6df42ed968532198
Sep 15 11:31:46.471091 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.471063    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dddc58d6-6mgwx"]
Sep 15 11:31:46.472735 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:31:46.472706    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4e12a7_6b6c_4e4c_b14f_874bcd4814af.slice/crio-2088b721178fc60a26431d6a943b2adaece3b7c00585ff3c07d7e70cbf7ea1d5 WatchSource:0}: Error finding container 2088b721178fc60a26431d6a943b2adaece3b7c00585ff3c07d7e70cbf7ea1d5: Status 404 returned error can't find the container with id 2088b721178fc60a26431d6a943b2adaece3b7c00585ff3c07d7e70cbf7ea1d5
Sep 15 11:31:46.553078 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.553024    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dddc58d6-6mgwx" event={"ID":"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af","Type":"ContainerStarted","Data":"fc477604630f1e76e2517e5d0bfb8891c8dba33ec0d237bbdb795843e0aec8fc"}
Sep 15 11:31:46.553268 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.553107    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dddc58d6-6mgwx" event={"ID":"fe4e12a7-6b6c-4e4c-b14f-874bcd4814af","Type":"ContainerStarted","Data":"2088b721178fc60a26431d6a943b2adaece3b7c00585ff3c07d7e70cbf7ea1d5"}
Sep 15 11:31:46.554414 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.554388    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb" event={"ID":"6781897f-e47d-4691-a433-3c0cb776eb42","Type":"ContainerStarted","Data":"98c3b5fec68db980610d6dc98b15344add8534098099da1f6df42ed968532198"}
Sep 15 11:31:46.576602 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:46.576531    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dddc58d6-6mgwx" podStartSLOduration=1.5765133850000002 podStartE2EDuration="1.576513385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:46.575686197 +0000 UTC m=+408.331932576" watchObservedRunningTime="2026-09-15 11:31:46.576513385 +0000 UTC m=+408.332759763"
Sep 15 11:31:47.249229 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.249196    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8c5dw"]
Sep 15 11:31:47.252927 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.252903    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw"
Sep 15 11:31:47.257213 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.257185    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 15 11:31:47.259483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.259456    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-r6jc9\""
Sep 15 11:31:47.272442 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.272271    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8c5dw"]
Sep 15 11:31:47.296913 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.296511    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:47.374080 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.374039    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h95v\" (UniqueName: \"kubernetes.io/projected/3ee0fd7b-968e-48d9-af30-4253db5991f8-kube-api-access-7h95v\") pod \"odh-model-controller-7998c67dc4-8c5dw\" (UID: \"3ee0fd7b-968e-48d9-af30-4253db5991f8\") " pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw"
Sep 15 11:31:47.374266 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.374098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ee0fd7b-968e-48d9-af30-4253db5991f8-cert\") pod \"odh-model-controller-7998c67dc4-8c5dw\" (UID: \"3ee0fd7b-968e-48d9-af30-4253db5991f8\") " pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw"
Sep 15 11:31:47.384683 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.384646    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:47.475694 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.475648    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h95v\" (UniqueName: \"kubernetes.io/projected/3ee0fd7b-968e-48d9-af30-4253db5991f8-kube-api-access-7h95v\") pod \"odh-model-controller-7998c67dc4-8c5dw\" (UID: \"3ee0fd7b-968e-48d9-af30-4253db5991f8\") " pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw"
Sep 15 11:31:47.475893 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.475709    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ee0fd7b-968e-48d9-af30-4253db5991f8-cert\") pod \"odh-model-controller-7998c67dc4-8c5dw\" (UID: \"3ee0fd7b-968e-48d9-af30-4253db5991f8\") " pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw"
Sep 15 11:31:47.475960 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:31:47.475895    2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 15 11:31:47.476021 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:31:47.475966    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee0fd7b-968e-48d9-af30-4253db5991f8-cert podName:3ee0fd7b-968e-48d9-af30-4253db5991f8 nodeName:}" failed. No retries permitted until 2026-09-15 11:31:47.975943893 +0000 UTC m=+409.732190265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3ee0fd7b-968e-48d9-af30-4253db5991f8-cert") pod "odh-model-controller-7998c67dc4-8c5dw" (UID: "3ee0fd7b-968e-48d9-af30-4253db5991f8") : secret "odh-model-controller-webhook-cert" not found
Sep 15 11:31:47.488357 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.488323    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h95v\" (UniqueName: \"kubernetes.io/projected/3ee0fd7b-968e-48d9-af30-4253db5991f8-kube-api-access-7h95v\") pod \"odh-model-controller-7998c67dc4-8c5dw\" (UID: \"3ee0fd7b-968e-48d9-af30-4253db5991f8\") " pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw"
Sep 15 11:31:47.625270 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.625233    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7mrqd"]
Sep 15 11:31:47.629144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.629122    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd"
Sep 15 11:31:47.632022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.631937    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 15 11:31:47.644252 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.644223    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7mrqd"]
Sep 15 11:31:47.649763 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.649716    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:47.777039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.776993    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:47.779027 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.778996    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9qw5\" (UniqueName: \"kubernetes.io/projected/72ca6670-4a3b-4bb3-83b4-bb35006cd56c-kube-api-access-w9qw5\") pod \"model-serving-api-54d89bd5fc-7mrqd\" (UID: \"72ca6670-4a3b-4bb3-83b4-bb35006cd56c\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd"
Sep 15 11:31:47.779169 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.779054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ca6670-4a3b-4bb3-83b4-bb35006cd56c-tls-certs\") pod \"model-serving-api-54d89bd5fc-7mrqd\" (UID: \"72ca6670-4a3b-4bb3-83b4-bb35006cd56c\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd"
Sep 15 11:31:47.832328 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.832273    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:47.880281 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.880199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ca6670-4a3b-4bb3-83b4-bb35006cd56c-tls-certs\") pod \"model-serving-api-54d89bd5fc-7mrqd\" (UID: \"72ca6670-4a3b-4bb3-83b4-bb35006cd56c\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd"
Sep 15 11:31:47.880448 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.880349    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9qw5\" (UniqueName: \"kubernetes.io/projected/72ca6670-4a3b-4bb3-83b4-bb35006cd56c-kube-api-access-w9qw5\") pod \"model-serving-api-54d89bd5fc-7mrqd\" (UID: \"72ca6670-4a3b-4bb3-83b4-bb35006cd56c\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd"
Sep 15 11:31:47.883193 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.883163    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ca6670-4a3b-4bb3-83b4-bb35006cd56c-tls-certs\") pod \"model-serving-api-54d89bd5fc-7mrqd\" (UID: \"72ca6670-4a3b-4bb3-83b4-bb35006cd56c\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd"
Sep 15 11:31:47.889627 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.889601    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9qw5\" (UniqueName: \"kubernetes.io/projected/72ca6670-4a3b-4bb3-83b4-bb35006cd56c-kube-api-access-w9qw5\") pod \"model-serving-api-54d89bd5fc-7mrqd\" (UID: \"72ca6670-4a3b-4bb3-83b4-bb35006cd56c\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd"
Sep 15 11:31:47.945107 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.945072    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd"
Sep 15 11:31:47.981884 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.981847    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ee0fd7b-968e-48d9-af30-4253db5991f8-cert\") pod \"odh-model-controller-7998c67dc4-8c5dw\" (UID: \"3ee0fd7b-968e-48d9-af30-4253db5991f8\") " pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw"
Sep 15 11:31:47.984645 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:47.984618    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ee0fd7b-968e-48d9-af30-4253db5991f8-cert\") pod \"odh-model-controller-7998c67dc4-8c5dw\" (UID: \"3ee0fd7b-968e-48d9-af30-4253db5991f8\") " pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw"
Sep 15 11:31:48.173681 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:48.173581    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw"
Sep 15 11:31:48.228261 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:48.228233    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7mrqd"]
Sep 15 11:31:48.518818 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:48.518791    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f6db84f6f-xjp8c"
Sep 15 11:31:49.024663 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:31:49.024629    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ca6670_4a3b_4bb3_83b4_bb35006cd56c.slice/crio-34e02a0d2f8cf94eae776007a6a05960f27ae97a549a79854777e33b9d09c02e WatchSource:0}: Error finding container 34e02a0d2f8cf94eae776007a6a05960f27ae97a549a79854777e33b9d09c02e: Status 404 returned error can't find the container with id 34e02a0d2f8cf94eae776007a6a05960f27ae97a549a79854777e33b9d09c02e
Sep 15 11:31:49.094426 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:49.094381    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:31:49.094522 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:49.094476    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:31:49.094578 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:49.094519    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:31:49.297019 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:49.296984    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8c5dw"]
Sep 15 11:31:49.302264 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:31:49.302233    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee0fd7b_968e_48d9_af30_4253db5991f8.slice/crio-8ba7e92e6988db3139322629cf21891e8cef2a7137471355042e63d0cba3c4e9 WatchSource:0}: Error finding container 8ba7e92e6988db3139322629cf21891e8cef2a7137471355042e63d0cba3c4e9: Status 404 returned error can't find the container with id 8ba7e92e6988db3139322629cf21891e8cef2a7137471355042e63d0cba3c4e9
Sep 15 11:31:49.581962 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:49.581850    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd" event={"ID":"72ca6670-4a3b-4bb3-83b4-bb35006cd56c","Type":"ContainerStarted","Data":"34e02a0d2f8cf94eae776007a6a05960f27ae97a549a79854777e33b9d09c02e"}
Sep 15 11:31:49.584017 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:49.583984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb" event={"ID":"6781897f-e47d-4691-a433-3c0cb776eb42","Type":"ContainerStarted","Data":"3719a5b141102054ee0645c13563aaef17320a0f6889d3a7f23a6bdd319040f8"}
Sep 15 11:31:49.585774 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:49.585742    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw" event={"ID":"3ee0fd7b-968e-48d9-af30-4253db5991f8","Type":"ContainerStarted","Data":"8ba7e92e6988db3139322629cf21891e8cef2a7137471355042e63d0cba3c4e9"}
Sep 15 11:31:49.607439 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:49.607372    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb" podStartSLOduration=1.803422842 podStartE2EDuration="4.607348076s" totalImagesPullingTime="2.803925234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:49.604370412 +0000 UTC m=+411.360616794" watchObservedRunningTime="2026-09-15 11:31:49.607348076 +0000 UTC m=+411.363594457"
Sep 15 11:31:50.011900 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:50.010350    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:50.194527 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:50.194491    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:50.591992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:50.591957    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:50.593153 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:50.593131    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb"
Sep 15 11:31:53.610822 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:53.610788    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw" event={"ID":"3ee0fd7b-968e-48d9-af30-4253db5991f8","Type":"ContainerStarted","Data":"c4546deb6964e05bf4ce1a033733d022dddec9c5393d8ee80fd5a07a3c88ec4a"}
Sep 15 11:31:53.611290 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:53.610901    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw"
Sep 15 11:31:53.612345 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:53.612320    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd" event={"ID":"72ca6670-4a3b-4bb3-83b4-bb35006cd56c","Type":"ContainerStarted","Data":"622c2808c6ef5257cd21c05af0000421041c9f676dd8d5e79e189776eaf21b78"}
Sep 15 11:31:53.612451 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:53.612380    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd"
Sep 15 11:31:53.630266 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:53.630197    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw" podStartSLOduration=3.183889856 podStartE2EDuration="6.630183518s" totalImagesPullingTime="3.446293662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:53.629034279 +0000 UTC m=+415.385280655" watchObservedRunningTime="2026-09-15 11:31:53.630183518 +0000 UTC m=+415.386429896"
Sep 15 11:31:53.647508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:53.647447    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd" podStartSLOduration=2.970024656 podStartE2EDuration="6.64743191s" totalImagesPullingTime="3.677407254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:53.646034264 +0000 UTC m=+415.402280644" watchObservedRunningTime="2026-09-15 11:31:53.64743191 +0000 UTC m=+415.403678290"
Sep 15 11:31:56.197069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:56.197020    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:56.197069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:56.197087    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:56.202063 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:56.202039    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:56.631396 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:56.631363    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dddc58d6-6mgwx"
Sep 15 11:31:56.738903 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:56.738872    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-577fc8c7-pkv8r"]
Sep 15 11:31:57.089070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:57.089003    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:57.215941 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:57.215909    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:57.580721 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:57.580685    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:57.721402 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:57.721365    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:58.117888 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:58.117854    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:58.443047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:58.442950    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:58.903367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:58.903323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:59.003820 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:59.003784    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:31:59.129450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:31:59.129414    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:32:04.619709 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:04.619679    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-8c5dw"
Sep 15 11:32:04.621613 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:04.621594    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7mrqd"
Sep 15 11:32:21.757517 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:21.757413    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-577fc8c7-pkv8r" podUID="41c455c2-710f-4d93-96ad-909d303ffdc1" containerName="console" containerID="cri-o://9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6" gracePeriod=15
Sep 15 11:32:22.005438 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.005414    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:32:22.103352 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.103310    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-console-config\") pod \"41c455c2-710f-4d93-96ad-909d303ffdc1\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") "
Sep 15 11:32:22.103532 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.103373    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-service-ca\") pod \"41c455c2-710f-4d93-96ad-909d303ffdc1\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") "
Sep 15 11:32:22.103532 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.103419    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-oauth-serving-cert\") pod \"41c455c2-710f-4d93-96ad-909d303ffdc1\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") "
Sep 15 11:32:22.103532 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.103451    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-oauth-config\") pod \"41c455c2-710f-4d93-96ad-909d303ffdc1\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") "
Sep 15 11:32:22.103532 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.103502    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-serving-cert\") pod \"41c455c2-710f-4d93-96ad-909d303ffdc1\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") "
Sep 15 11:32:22.103759 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.103549    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-trusted-ca-bundle\") pod \"41c455c2-710f-4d93-96ad-909d303ffdc1\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") "
Sep 15 11:32:22.103759 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.103595    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hskcp\" (UniqueName: \"kubernetes.io/projected/41c455c2-710f-4d93-96ad-909d303ffdc1-kube-api-access-hskcp\") pod \"41c455c2-710f-4d93-96ad-909d303ffdc1\" (UID: \"41c455c2-710f-4d93-96ad-909d303ffdc1\") "
Sep 15 11:32:22.103907 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.103878    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-console-config" (OuterVolumeSpecName: "console-config") pod "41c455c2-710f-4d93-96ad-909d303ffdc1" (UID: "41c455c2-710f-4d93-96ad-909d303ffdc1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:32:22.104028 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.103896    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "41c455c2-710f-4d93-96ad-909d303ffdc1" (UID: "41c455c2-710f-4d93-96ad-909d303ffdc1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:32:22.104028 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.103920    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-service-ca" (OuterVolumeSpecName: "service-ca") pod "41c455c2-710f-4d93-96ad-909d303ffdc1" (UID: "41c455c2-710f-4d93-96ad-909d303ffdc1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:32:22.104028 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.104009    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "41c455c2-710f-4d93-96ad-909d303ffdc1" (UID: "41c455c2-710f-4d93-96ad-909d303ffdc1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:32:22.105873 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.105846    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41c455c2-710f-4d93-96ad-909d303ffdc1-kube-api-access-hskcp" (OuterVolumeSpecName: "kube-api-access-hskcp") pod "41c455c2-710f-4d93-96ad-909d303ffdc1" (UID: "41c455c2-710f-4d93-96ad-909d303ffdc1"). InnerVolumeSpecName "kube-api-access-hskcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:32:22.105981 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.105953    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "41c455c2-710f-4d93-96ad-909d303ffdc1" (UID: "41c455c2-710f-4d93-96ad-909d303ffdc1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:32:22.106073 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.106000    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "41c455c2-710f-4d93-96ad-909d303ffdc1" (UID: "41c455c2-710f-4d93-96ad-909d303ffdc1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:32:22.204882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.204845    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-trusted-ca-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:22.204882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.204878    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hskcp\" (UniqueName: \"kubernetes.io/projected/41c455c2-710f-4d93-96ad-909d303ffdc1-kube-api-access-hskcp\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:22.204882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.204889    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-console-config\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:22.205132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.204898    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:22.205132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.204907    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41c455c2-710f-4d93-96ad-909d303ffdc1-oauth-serving-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:22.205132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.204916    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-oauth-config\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:22.205132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.204924    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41c455c2-710f-4d93-96ad-909d303ffdc1-console-serving-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:22.759243 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.759207    2570 generic.go:356] "Generic (PLEG): container finished" podID="41c455c2-710f-4d93-96ad-909d303ffdc1" containerID="9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6" exitCode=0
Sep 15 11:32:22.759708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.759260    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577fc8c7-pkv8r"
Sep 15 11:32:22.759708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.759267    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577fc8c7-pkv8r" event={"ID":"41c455c2-710f-4d93-96ad-909d303ffdc1","Type":"ContainerDied","Data":"9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6"}
Sep 15 11:32:22.759708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.759307    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577fc8c7-pkv8r" event={"ID":"41c455c2-710f-4d93-96ad-909d303ffdc1","Type":"ContainerDied","Data":"da28d526f7424f492b49f99189aefe966eb838385724749271954bb325f0ee58"}
Sep 15 11:32:22.759708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.759326    2570 scope.go:117] "RemoveContainer" containerID="9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6"
Sep 15 11:32:22.768450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.768431    2570 scope.go:117] "RemoveContainer" containerID="9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6"
Sep 15 11:32:22.768764 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:32:22.768745    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6\": container with ID starting with 9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6 not found: ID does not exist" containerID="9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6"
Sep 15 11:32:22.768813 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.768773    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6"} err="failed to get container status \"9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6\": rpc error: code = NotFound desc = could not find container \"9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6\": container with ID starting with 9f345996f5731e9cac11cdfde9162571245f0728a8516e4171ebb25631ee4bb6 not found: ID does not exist"
Sep 15 11:32:22.781465 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.781434    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-577fc8c7-pkv8r"]
Sep 15 11:32:22.783636 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:22.783613    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-577fc8c7-pkv8r"]
Sep 15 11:32:24.780386 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:24.780349    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41c455c2-710f-4d93-96ad-909d303ffdc1" path="/var/lib/kubelet/pods/41c455c2-710f-4d93-96ad-909d303ffdc1/volumes"
Sep 15 11:32:48.487540 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:48.487499    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:32:48.593520 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:48.593477    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:32:53.255335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.255300    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"]
Sep 15 11:32:53.255924 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.255835    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41c455c2-710f-4d93-96ad-909d303ffdc1" containerName="console"
Sep 15 11:32:53.255924 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.255855    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="41c455c2-710f-4d93-96ad-909d303ffdc1" containerName="console"
Sep 15 11:32:53.256049 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.255945    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="41c455c2-710f-4d93-96ad-909d303ffdc1" containerName="console"
Sep 15 11:32:53.258992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.258970    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:53.261489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.261464    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vf97c\""
Sep 15 11:32:53.261489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.261475    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:32:53.262466 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.262447    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:32:53.271031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.270719    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"]
Sep 15 11:32:53.271531 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.271506    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:53.271655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.271574    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vghb4\" (UniqueName: \"kubernetes.io/projected/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-kube-api-access-vghb4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:53.271731 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.271704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:53.360110 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.360070    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"]
Sep 15 11:32:53.363636 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.363618    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:53.372193 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.372170    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"]
Sep 15 11:32:53.372624 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.372597    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:53.372731 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.372677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:53.372731 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.372708    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghb4\" (UniqueName: \"kubernetes.io/projected/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-kube-api-access-vghb4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:53.372836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.372749    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:53.372836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.372773    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7vhb\" (UniqueName: \"kubernetes.io/projected/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-kube-api-access-x7vhb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:53.372836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.372791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:53.373051 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.373031    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:53.373114 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.373070    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:53.388262 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.388238    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vghb4\" (UniqueName: \"kubernetes.io/projected/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-kube-api-access-vghb4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:53.464919 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.464888    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"]
Sep 15 11:32:53.468635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.468618    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:53.473303 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.473274    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:53.473423 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.473383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:53.473423 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.473415    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7vhb\" (UniqueName: \"kubernetes.io/projected/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-kube-api-access-x7vhb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:53.473506 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.473489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:53.473576 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.473520    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsvzd\" (UniqueName: \"kubernetes.io/projected/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-kube-api-access-nsvzd\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:53.473639 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.473578    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:53.473690 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.473655    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:53.473756 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.473701    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:53.477737 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.477710    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"]
Sep 15 11:32:53.482354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.482334    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7vhb\" (UniqueName: \"kubernetes.io/projected/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-kube-api-access-x7vhb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:53.559976 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.559935    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"]
Sep 15 11:32:53.563761 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.563740    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:32:53.570708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.570684    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:53.572343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.572319    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"]
Sep 15 11:32:53.574836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.574810    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:53.574949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.574849    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsvzd\" (UniqueName: \"kubernetes.io/projected/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-kube-api-access-nsvzd\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:53.574949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.574881    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:53.574949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.574905    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn864\" (UniqueName: \"kubernetes.io/projected/d8350b43-9409-45ea-ac79-f84593928257-kube-api-access-gn864\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:32:53.574949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.574927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:32:53.575182 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.574971    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:32:53.575241 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.575222    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:53.575293 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.575231    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:53.586266 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.586237    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsvzd\" (UniqueName: \"kubernetes.io/projected/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-kube-api-access-nsvzd\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:53.673176 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.673140    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:53.675496 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.675473    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn864\" (UniqueName: \"kubernetes.io/projected/d8350b43-9409-45ea-ac79-f84593928257-kube-api-access-gn864\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:32:53.675578 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.675510    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:32:53.675670 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.675649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:32:53.675881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.675863    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:32:53.675984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.675967    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:32:53.685203 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.685180    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn864\" (UniqueName: \"kubernetes.io/projected/d8350b43-9409-45ea-ac79-f84593928257-kube-api-access-gn864\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:32:53.778336 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.778306    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:53.850862 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.850836    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"]
Sep 15 11:32:53.852545 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:32:53.852518    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d8a80c8_1a32_419f_aa6b_77fcd2253bd4.slice/crio-2335808d1ee4ff7e22eec83366e0918774e9b6710429e2e7c64013f06e710d0c WatchSource:0}: Error finding container 2335808d1ee4ff7e22eec83366e0918774e9b6710429e2e7c64013f06e710d0c: Status 404 returned error can't find the container with id 2335808d1ee4ff7e22eec83366e0918774e9b6710429e2e7c64013f06e710d0c
Sep 15 11:32:53.873960 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.873936    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:32:53.909914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.909885    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb" event={"ID":"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4","Type":"ContainerStarted","Data":"2335808d1ee4ff7e22eec83366e0918774e9b6710429e2e7c64013f06e710d0c"}
Sep 15 11:32:53.948747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:53.948711    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"]
Sep 15 11:32:53.949350 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:32:53.949318    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef68685_0d8d_420f_a0a7_d5450fdf6bb3.slice/crio-e75d49a7fa2cbeca24f7e09fcff3375e3b342d4db496f1a62c739916ab2048fd WatchSource:0}: Error finding container e75d49a7fa2cbeca24f7e09fcff3375e3b342d4db496f1a62c739916ab2048fd: Status 404 returned error can't find the container with id e75d49a7fa2cbeca24f7e09fcff3375e3b342d4db496f1a62c739916ab2048fd
Sep 15 11:32:54.059930 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.059900    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"]
Sep 15 11:32:54.060459 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:32:54.060432    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d6a09a_ca34_4712_9c5f_4be8a2a72b3b.slice/crio-a7cc09fced0896d9b62c74a88e8b47e053fd54e207fa79cd88c615e72b5652c9 WatchSource:0}: Error finding container a7cc09fced0896d9b62c74a88e8b47e053fd54e207fa79cd88c615e72b5652c9: Status 404 returned error can't find the container with id a7cc09fced0896d9b62c74a88e8b47e053fd54e207fa79cd88c615e72b5652c9
Sep 15 11:32:54.148086 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.148065    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"]
Sep 15 11:32:54.152148 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:32:54.152122    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8350b43_9409_45ea_ac79_f84593928257.slice/crio-6b0941eb5750ca4e488e3b65aad790375b7df3b7bd8d2044238a4886307831bb WatchSource:0}: Error finding container 6b0941eb5750ca4e488e3b65aad790375b7df3b7bd8d2044238a4886307831bb: Status 404 returned error can't find the container with id 6b0941eb5750ca4e488e3b65aad790375b7df3b7bd8d2044238a4886307831bb
Sep 15 11:32:54.916915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.916878    2570 generic.go:356] "Generic (PLEG): container finished" podID="d8350b43-9409-45ea-ac79-f84593928257" containerID="0c95e4570cb0d144cba2a67c14e6308fa50a7bebaf35043e3e917c7b8d481767" exitCode=0
Sep 15 11:32:54.917334 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.916966    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d" event={"ID":"d8350b43-9409-45ea-ac79-f84593928257","Type":"ContainerDied","Data":"0c95e4570cb0d144cba2a67c14e6308fa50a7bebaf35043e3e917c7b8d481767"}
Sep 15 11:32:54.917334 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.917030    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d" event={"ID":"d8350b43-9409-45ea-ac79-f84593928257","Type":"ContainerStarted","Data":"6b0941eb5750ca4e488e3b65aad790375b7df3b7bd8d2044238a4886307831bb"}
Sep 15 11:32:54.918680 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.918656    2570 generic.go:356] "Generic (PLEG): container finished" podID="a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" containerID="ca388acdb8ebb2d13feeb8e626d1512207a444ecea66bd3f0e4897ccce8ec1a9" exitCode=0
Sep 15 11:32:54.918762 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.918726    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4" event={"ID":"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b","Type":"ContainerDied","Data":"ca388acdb8ebb2d13feeb8e626d1512207a444ecea66bd3f0e4897ccce8ec1a9"}
Sep 15 11:32:54.918835 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.918791    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4" event={"ID":"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b","Type":"ContainerStarted","Data":"a7cc09fced0896d9b62c74a88e8b47e053fd54e207fa79cd88c615e72b5652c9"}
Sep 15 11:32:54.920413 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.920387    2570 generic.go:356] "Generic (PLEG): container finished" podID="6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" containerID="d6a0d4a06a8c89722ff86dd0831fa2ceb89a5ccab078e61fb58c0ec64d58fd57" exitCode=0
Sep 15 11:32:54.920525 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.920470    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb" event={"ID":"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4","Type":"ContainerDied","Data":"d6a0d4a06a8c89722ff86dd0831fa2ceb89a5ccab078e61fb58c0ec64d58fd57"}
Sep 15 11:32:54.922458 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.922436    2570 generic.go:356] "Generic (PLEG): container finished" podID="2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" containerID="6a1efe5562162a1fa01a373dca642a231bd41d444a83e2d418713a269e33b47a" exitCode=0
Sep 15 11:32:54.922579 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.922532    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh" event={"ID":"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3","Type":"ContainerDied","Data":"6a1efe5562162a1fa01a373dca642a231bd41d444a83e2d418713a269e33b47a"}
Sep 15 11:32:54.922652 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:54.922593    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh" event={"ID":"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3","Type":"ContainerStarted","Data":"e75d49a7fa2cbeca24f7e09fcff3375e3b342d4db496f1a62c739916ab2048fd"}
Sep 15 11:32:55.932171 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:55.932083    2570 generic.go:356] "Generic (PLEG): container finished" podID="a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" containerID="3b1e737e14af7baa01b5f786cb2d5d76321dba53751a179806516e999b7d401b" exitCode=0
Sep 15 11:32:55.932171 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:55.932158    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4" event={"ID":"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b","Type":"ContainerDied","Data":"3b1e737e14af7baa01b5f786cb2d5d76321dba53751a179806516e999b7d401b"}
Sep 15 11:32:55.934287 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:55.934267    2570 generic.go:356] "Generic (PLEG): container finished" podID="6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" containerID="2574361ecc654b2a48be444f0f313aa34ded48d7d1c1137a1a89f4bca7b5ce46" exitCode=0
Sep 15 11:32:55.934364 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:55.934334    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb" event={"ID":"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4","Type":"ContainerDied","Data":"2574361ecc654b2a48be444f0f313aa34ded48d7d1c1137a1a89f4bca7b5ce46"}
Sep 15 11:32:55.936319 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:55.936296    2570 generic.go:356] "Generic (PLEG): container finished" podID="2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" containerID="89deeaaab97728929ecd4990d9bbf5463ae0b50ea9a11610ac65833e54c0a569" exitCode=0
Sep 15 11:32:55.936409 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:55.936326    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh" event={"ID":"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3","Type":"ContainerDied","Data":"89deeaaab97728929ecd4990d9bbf5463ae0b50ea9a11610ac65833e54c0a569"}
Sep 15 11:32:56.943977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:56.943946    2570 generic.go:356] "Generic (PLEG): container finished" podID="a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" containerID="e2e7dfd8132db20835fef76fc464693133108b05406f1f37a2aa429960df1f27" exitCode=0
Sep 15 11:32:56.944425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:56.944028    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4" event={"ID":"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b","Type":"ContainerDied","Data":"e2e7dfd8132db20835fef76fc464693133108b05406f1f37a2aa429960df1f27"}
Sep 15 11:32:56.946243 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:56.946222    2570 generic.go:356] "Generic (PLEG): container finished" podID="6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" containerID="eb0df4d9def5c6b45af7ca9f3a8e83ba8d33ab0d8d483fa2707e316ddd28c6c8" exitCode=0
Sep 15 11:32:56.946331 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:56.946282    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb" event={"ID":"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4","Type":"ContainerDied","Data":"eb0df4d9def5c6b45af7ca9f3a8e83ba8d33ab0d8d483fa2707e316ddd28c6c8"}
Sep 15 11:32:56.948243 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:56.948222    2570 generic.go:356] "Generic (PLEG): container finished" podID="2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" containerID="3c1b82af9a20a251173f476164c4f93d0ffdccbd626e4d75664268a4b1ba2c5d" exitCode=0
Sep 15 11:32:56.948333 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:56.948259    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh" event={"ID":"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3","Type":"ContainerDied","Data":"3c1b82af9a20a251173f476164c4f93d0ffdccbd626e4d75664268a4b1ba2c5d"}
Sep 15 11:32:58.106432 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.106402    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:32:58.146333 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.146311    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:58.149458 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.149434    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:58.216760 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.216681    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-bundle\") pod \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") "
Sep 15 11:32:58.216760 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.216741    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-bundle\") pod \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") "
Sep 15 11:32:58.216968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.216773    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-util\") pod \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") "
Sep 15 11:32:58.216968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.216820    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsvzd\" (UniqueName: \"kubernetes.io/projected/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-kube-api-access-nsvzd\") pod \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") "
Sep 15 11:32:58.216968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.216865    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-util\") pod \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") "
Sep 15 11:32:58.216968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.216893    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-util\") pod \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\" (UID: \"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b\") "
Sep 15 11:32:58.216968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.216931    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7vhb\" (UniqueName: \"kubernetes.io/projected/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-kube-api-access-x7vhb\") pod \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\" (UID: \"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3\") "
Sep 15 11:32:58.216968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.216963    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vghb4\" (UniqueName: \"kubernetes.io/projected/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-kube-api-access-vghb4\") pod \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") "
Sep 15 11:32:58.217289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.216993    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-bundle\") pod \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\" (UID: \"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4\") "
Sep 15 11:32:58.217687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.217589    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-bundle" (OuterVolumeSpecName: "bundle") pod "a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" (UID: "a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:58.217808 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.217761    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-bundle" (OuterVolumeSpecName: "bundle") pod "2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" (UID: "2ef68685-0d8d-420f-a0a7-d5450fdf6bb3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:58.217873 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.217850    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-bundle" (OuterVolumeSpecName: "bundle") pod "6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" (UID: "6d8a80c8-1a32-419f-aa6b-77fcd2253bd4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:58.219499 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.219466    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-kube-api-access-nsvzd" (OuterVolumeSpecName: "kube-api-access-nsvzd") pod "a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" (UID: "a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b"). InnerVolumeSpecName "kube-api-access-nsvzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:32:58.219619 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.219499    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-kube-api-access-vghb4" (OuterVolumeSpecName: "kube-api-access-vghb4") pod "6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" (UID: "6d8a80c8-1a32-419f-aa6b-77fcd2253bd4"). InnerVolumeSpecName "kube-api-access-vghb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:32:58.219673 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.219610    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-kube-api-access-x7vhb" (OuterVolumeSpecName: "kube-api-access-x7vhb") pod "2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" (UID: "2ef68685-0d8d-420f-a0a7-d5450fdf6bb3"). InnerVolumeSpecName "kube-api-access-x7vhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:32:58.223074 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.223048    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-util" (OuterVolumeSpecName: "util") pod "a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" (UID: "a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:58.224600 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.224546    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-util" (OuterVolumeSpecName: "util") pod "2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" (UID: "2ef68685-0d8d-420f-a0a7-d5450fdf6bb3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:58.225932 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.225906    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-util" (OuterVolumeSpecName: "util") pod "6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" (UID: "6d8a80c8-1a32-419f-aa6b-77fcd2253bd4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:58.318747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.318718    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsvzd\" (UniqueName: \"kubernetes.io/projected/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-kube-api-access-nsvzd\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:58.318747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.318743    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-util\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:58.318747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.318752    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-util\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:58.318952 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.318760    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7vhb\" (UniqueName: \"kubernetes.io/projected/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-kube-api-access-x7vhb\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:58.318952 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.318769    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vghb4\" (UniqueName: \"kubernetes.io/projected/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-kube-api-access-vghb4\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:58.318952 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.318778    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d8a80c8-1a32-419f-aa6b-77fcd2253bd4-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:58.318952 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.318786    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:58.318952 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.318793    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:58.318952 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.318800    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef68685-0d8d-420f-a0a7-d5450fdf6bb3-util\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:32:58.961349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.961272    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4"
Sep 15 11:32:58.961506 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.961268    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6m5rj4" event={"ID":"a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b","Type":"ContainerDied","Data":"a7cc09fced0896d9b62c74a88e8b47e053fd54e207fa79cd88c615e72b5652c9"}
Sep 15 11:32:58.961506 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.961412    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7cc09fced0896d9b62c74a88e8b47e053fd54e207fa79cd88c615e72b5652c9"
Sep 15 11:32:58.963342 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.963298    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb" event={"ID":"6d8a80c8-1a32-419f-aa6b-77fcd2253bd4","Type":"ContainerDied","Data":"2335808d1ee4ff7e22eec83366e0918774e9b6710429e2e7c64013f06e710d0c"}
Sep 15 11:32:58.963342 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.963341    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2335808d1ee4ff7e22eec83366e0918774e9b6710429e2e7c64013f06e710d0c"
Sep 15 11:32:58.963583 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.963414    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z4jqb"
Sep 15 11:32:58.968960 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.968936    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh" event={"ID":"2ef68685-0d8d-420f-a0a7-d5450fdf6bb3","Type":"ContainerDied","Data":"e75d49a7fa2cbeca24f7e09fcff3375e3b342d4db496f1a62c739916ab2048fd"}
Sep 15 11:32:58.969118 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.968976    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e75d49a7fa2cbeca24f7e09fcff3375e3b342d4db496f1a62c739916ab2048fd"
Sep 15 11:32:58.969118 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:32:58.969002    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahqzhh"
Sep 15 11:33:00.982914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:00.982879    2570 generic.go:356] "Generic (PLEG): container finished" podID="d8350b43-9409-45ea-ac79-f84593928257" containerID="eb54cf22f88f9d6e7366bea7cfa7f51e37279c957ebb297494330c3585ddee3e" exitCode=0
Sep 15 11:33:00.983381 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:00.982923    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d" event={"ID":"d8350b43-9409-45ea-ac79-f84593928257","Type":"ContainerDied","Data":"eb54cf22f88f9d6e7366bea7cfa7f51e37279c957ebb297494330c3585ddee3e"}
Sep 15 11:33:01.990983 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:01.990943    2570 generic.go:356] "Generic (PLEG): container finished" podID="d8350b43-9409-45ea-ac79-f84593928257" containerID="11c4b4b827f030271c0b6245d211e16529eccc8a46e6eec0d4fb39264dd10514" exitCode=0
Sep 15 11:33:01.991368 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:01.991016    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d" event={"ID":"d8350b43-9409-45ea-ac79-f84593928257","Type":"ContainerDied","Data":"11c4b4b827f030271c0b6245d211e16529eccc8a46e6eec0d4fb39264dd10514"}
Sep 15 11:33:03.126699 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:03.126672    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:33:03.161488 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:03.161458    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn864\" (UniqueName: \"kubernetes.io/projected/d8350b43-9409-45ea-ac79-f84593928257-kube-api-access-gn864\") pod \"d8350b43-9409-45ea-ac79-f84593928257\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") "
Sep 15 11:33:03.161648 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:03.161574    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-bundle\") pod \"d8350b43-9409-45ea-ac79-f84593928257\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") "
Sep 15 11:33:03.161712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:03.161648    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-util\") pod \"d8350b43-9409-45ea-ac79-f84593928257\" (UID: \"d8350b43-9409-45ea-ac79-f84593928257\") "
Sep 15 11:33:03.162184 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:03.162160    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-bundle" (OuterVolumeSpecName: "bundle") pod "d8350b43-9409-45ea-ac79-f84593928257" (UID: "d8350b43-9409-45ea-ac79-f84593928257"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:33:03.163768 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:03.163737    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8350b43-9409-45ea-ac79-f84593928257-kube-api-access-gn864" (OuterVolumeSpecName: "kube-api-access-gn864") pod "d8350b43-9409-45ea-ac79-f84593928257" (UID: "d8350b43-9409-45ea-ac79-f84593928257"). InnerVolumeSpecName "kube-api-access-gn864". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:33:03.166739 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:03.166701    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-util" (OuterVolumeSpecName: "util") pod "d8350b43-9409-45ea-ac79-f84593928257" (UID: "d8350b43-9409-45ea-ac79-f84593928257"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:33:03.263254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:03.263214    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn864\" (UniqueName: \"kubernetes.io/projected/d8350b43-9409-45ea-ac79-f84593928257-kube-api-access-gn864\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:33:03.263254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:03.263247    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-bundle\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:33:03.263254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:03.263258    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8350b43-9409-45ea-ac79-f84593928257-util\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:33:04.004549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:04.004512    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d" event={"ID":"d8350b43-9409-45ea-ac79-f84593928257","Type":"ContainerDied","Data":"6b0941eb5750ca4e488e3b65aad790375b7df3b7bd8d2044238a4886307831bb"}
Sep 15 11:33:04.004718 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:04.004577    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b0941eb5750ca4e488e3b65aad790375b7df3b7bd8d2044238a4886307831bb"
Sep 15 11:33:04.004718 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:04.004525    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cdhx9d"
Sep 15 11:33:09.519361 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:09.519313    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:10.285705 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:10.285667    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:11.095154 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:11.095119    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:12.954898 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:12.954865    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:13.753078 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753037    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"]
Sep 15 11:33:13.753523 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753507    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" containerName="util"
Sep 15 11:33:13.753582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753525    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" containerName="util"
Sep 15 11:33:13.753582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753536    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" containerName="extract"
Sep 15 11:33:13.753582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753541    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" containerName="extract"
Sep 15 11:33:13.753582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753550    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8350b43-9409-45ea-ac79-f84593928257" containerName="util"
Sep 15 11:33:13.753582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753576    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8350b43-9409-45ea-ac79-f84593928257" containerName="util"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753584    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" containerName="pull"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753592    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" containerName="pull"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753604    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" containerName="util"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753610    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" containerName="util"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753620    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" containerName="util"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753625    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" containerName="util"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753652    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" containerName="extract"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753658    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" containerName="extract"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753666    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8350b43-9409-45ea-ac79-f84593928257" containerName="extract"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753675    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8350b43-9409-45ea-ac79-f84593928257" containerName="extract"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753685    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" containerName="pull"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753691    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" containerName="pull"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753698    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" containerName="extract"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753703    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" containerName="extract"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753709    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" containerName="pull"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753714    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" containerName="pull"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753722    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8350b43-9409-45ea-ac79-f84593928257" containerName="pull"
Sep 15 11:33:13.753757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753727    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8350b43-9409-45ea-ac79-f84593928257" containerName="pull"
Sep 15 11:33:13.754251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753789    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d8a80c8-1a32-419f-aa6b-77fcd2253bd4" containerName="extract"
Sep 15 11:33:13.754251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753796    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef68685-0d8d-420f-a0a7-d5450fdf6bb3" containerName="extract"
Sep 15 11:33:13.754251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753803    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6d6a09a-ca34-4712-9c5f-4be8a2a72b3b" containerName="extract"
Sep 15 11:33:13.754251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.753809    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8350b43-9409-45ea-ac79-f84593928257" containerName="extract"
Sep 15 11:33:13.757011 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.756996    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:13.759986 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.759964    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-d7k7z\""
Sep 15 11:33:13.760431 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.760412    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 11:33:13.760668 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.760653    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 11:33:13.787568 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.787527    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"]
Sep 15 11:33:13.854375 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.854341    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n266k\" (UID: \"06c8a538-a3c5-49e1-9211-ebf5387a0b6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:13.854375 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.854376    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8lxl\" (UniqueName: \"kubernetes.io/projected/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-kube-api-access-b8lxl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n266k\" (UID: \"06c8a538-a3c5-49e1-9211-ebf5387a0b6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:13.955773 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.955736    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n266k\" (UID: \"06c8a538-a3c5-49e1-9211-ebf5387a0b6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:13.955773 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.955778    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8lxl\" (UniqueName: \"kubernetes.io/projected/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-kube-api-access-b8lxl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n266k\" (UID: \"06c8a538-a3c5-49e1-9211-ebf5387a0b6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:13.956203 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.956182    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n266k\" (UID: \"06c8a538-a3c5-49e1-9211-ebf5387a0b6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:13.967211 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:13.967186    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8lxl\" (UniqueName: \"kubernetes.io/projected/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-kube-api-access-b8lxl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n266k\" (UID: \"06c8a538-a3c5-49e1-9211-ebf5387a0b6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:14.067171 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:14.067141    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:14.313334 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:14.313298    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:14.347576 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:14.347537    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"]
Sep 15 11:33:14.350161 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:33:14.350124    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c8a538_a3c5_49e1_9211_ebf5387a0b6b.slice/crio-2391f81b7058e8f2c62fe53c9a99d09176fc7ad288cefa6028668cebdd0cb8c2 WatchSource:0}: Error finding container 2391f81b7058e8f2c62fe53c9a99d09176fc7ad288cefa6028668cebdd0cb8c2: Status 404 returned error can't find the container with id 2391f81b7058e8f2c62fe53c9a99d09176fc7ad288cefa6028668cebdd0cb8c2
Sep 15 11:33:15.067077 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:15.067040    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k" event={"ID":"06c8a538-a3c5-49e1-9211-ebf5387a0b6b","Type":"ContainerStarted","Data":"2391f81b7058e8f2c62fe53c9a99d09176fc7ad288cefa6028668cebdd0cb8c2"}
Sep 15 11:33:15.430586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:15.430466    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:16.521142 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:16.521098    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:16.753347 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:16.753300    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:18.312454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:18.312422    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:18.718665 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:18.718619    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:19.046415 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:19.046378    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:19.095989 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:19.095958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k" event={"ID":"06c8a538-a3c5-49e1-9211-ebf5387a0b6b","Type":"ContainerStarted","Data":"3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8"}
Sep 15 11:33:19.096162 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:19.096094    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:19.142488 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:19.142426    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k" podStartSLOduration=2.38385229 podStartE2EDuration="6.142408918s" totalImagesPullingTime="3.758556628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:33:19.135867469 +0000 UTC m=+500.892113847" watchObservedRunningTime="2026-09-15 11:33:19.142408918 +0000 UTC m=+500.898655297"
Sep 15 11:33:20.860980 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:20.860925    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:20.890517 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:20.890485    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"]
Sep 15 11:33:20.894151 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:20.894127    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"
Sep 15 11:33:20.898599 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:20.898578    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 15 11:33:20.898865 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:20.898827    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bvzzp\""
Sep 15 11:33:20.898991 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:20.898972    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 15 11:33:20.918239 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:20.918215    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"]
Sep 15 11:33:21.010052 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.010000    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:21.025862 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.025838    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7833c826-98b0-4bd5-8e61-03e27d1c6691-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-hhzmf\" (UID: \"7833c826-98b0-4bd5-8e61-03e27d1c6691\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"
Sep 15 11:33:21.025998 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.025872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7833c826-98b0-4bd5-8e61-03e27d1c6691-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-hhzmf\" (UID: \"7833c826-98b0-4bd5-8e61-03e27d1c6691\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"
Sep 15 11:33:21.025998 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.025902    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhxtj\" (UniqueName: \"kubernetes.io/projected/7833c826-98b0-4bd5-8e61-03e27d1c6691-kube-api-access-hhxtj\") pod \"kuadrant-console-plugin-fbdd4f445-hhzmf\" (UID: \"7833c826-98b0-4bd5-8e61-03e27d1c6691\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"
Sep 15 11:33:21.127289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.127205    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7833c826-98b0-4bd5-8e61-03e27d1c6691-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-hhzmf\" (UID: \"7833c826-98b0-4bd5-8e61-03e27d1c6691\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"
Sep 15 11:33:21.127289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.127251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7833c826-98b0-4bd5-8e61-03e27d1c6691-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-hhzmf\" (UID: \"7833c826-98b0-4bd5-8e61-03e27d1c6691\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"
Sep 15 11:33:21.127289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.127282    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhxtj\" (UniqueName: \"kubernetes.io/projected/7833c826-98b0-4bd5-8e61-03e27d1c6691-kube-api-access-hhxtj\") pod \"kuadrant-console-plugin-fbdd4f445-hhzmf\" (UID: \"7833c826-98b0-4bd5-8e61-03e27d1c6691\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"
Sep 15 11:33:21.128037 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.128019    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7833c826-98b0-4bd5-8e61-03e27d1c6691-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-hhzmf\" (UID: \"7833c826-98b0-4bd5-8e61-03e27d1c6691\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"
Sep 15 11:33:21.129674 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.129646    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7833c826-98b0-4bd5-8e61-03e27d1c6691-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-hhzmf\" (UID: \"7833c826-98b0-4bd5-8e61-03e27d1c6691\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"
Sep 15 11:33:21.146115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.146094    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhxtj\" (UniqueName: \"kubernetes.io/projected/7833c826-98b0-4bd5-8e61-03e27d1c6691-kube-api-access-hhxtj\") pod \"kuadrant-console-plugin-fbdd4f445-hhzmf\" (UID: \"7833c826-98b0-4bd5-8e61-03e27d1c6691\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"
Sep 15 11:33:21.204685 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.204659    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"
Sep 15 11:33:21.481412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:21.481386    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf"]
Sep 15 11:33:21.483066 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:33:21.483040    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7833c826_98b0_4bd5_8e61_03e27d1c6691.slice/crio-36b587db27a569a7865879ecc83affa0395b9f99e06c88192687c46d802c463e WatchSource:0}: Error finding container 36b587db27a569a7865879ecc83affa0395b9f99e06c88192687c46d802c463e: Status 404 returned error can't find the container with id 36b587db27a569a7865879ecc83affa0395b9f99e06c88192687c46d802c463e
Sep 15 11:33:22.115542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:22.115505    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf" event={"ID":"7833c826-98b0-4bd5-8e61-03e27d1c6691","Type":"ContainerStarted","Data":"36b587db27a569a7865879ecc83affa0395b9f99e06c88192687c46d802c463e"}
Sep 15 11:33:23.918518 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:23.918462    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:23.980443 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:23.980388    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:24.302298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:24.302260    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:24.402971 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:24.402931    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:24.713942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:24.713853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:24.815510 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:24.815462    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:26.141416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:26.141380    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf" event={"ID":"7833c826-98b0-4bd5-8e61-03e27d1c6691","Type":"ContainerStarted","Data":"4a16fa06058858f2e784149bdde88b5fdfc9bc53a8ef4a8140d045f1005bf599"}
Sep 15 11:33:26.159139 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:26.159090    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hhzmf" podStartSLOduration=1.630602293 podStartE2EDuration="6.159072853s" totalImagesPullingTime="4.52847056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:33:26.156593306 +0000 UTC m=+507.912839687" watchObservedRunningTime="2026-09-15 11:33:26.159072853 +0000 UTC m=+507.915319234"
Sep 15 11:33:30.103796 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:30.103766    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:30.416914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:30.416812    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:30.527811 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:30.527773    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:32.355078 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.355045    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cms5x"]
Sep 15 11:33:32.359984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.359966    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cms5x"
Sep 15 11:33:32.390048 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.390021    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cms5x"]
Sep 15 11:33:32.390304 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:33:32.390286    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-rtq4s], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-rtq4s]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cms5x" podUID="aa1c3ece-5488-4ebb-a6ea-4914c115d55a"
Sep 15 11:33:32.399736 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.399705    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cms5x"]
Sep 15 11:33:32.421083 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.421054    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"]
Sep 15 11:33:32.421256 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.421231    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k" podUID="06c8a538-a3c5-49e1-9211-ebf5387a0b6b" containerName="manager" containerID="cri-o://3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8" gracePeriod=2
Sep 15 11:33:32.431825 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.431799    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"]
Sep 15 11:33:32.449984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.449950    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"]
Sep 15 11:33:32.450364 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.450345    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c8a538-a3c5-49e1-9211-ebf5387a0b6b" containerName="manager"
Sep 15 11:33:32.450455 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.450367    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c8a538-a3c5-49e1-9211-ebf5387a0b6b" containerName="manager"
Sep 15 11:33:32.450520 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.450464    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c8a538-a3c5-49e1-9211-ebf5387a0b6b" containerName="manager"
Sep 15 11:33:32.453892 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.453866    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:33:32.462620 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.462589    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"]
Sep 15 11:33:32.466003 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.465978    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:32.484902 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.484868    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"]
Sep 15 11:33:32.491290 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.491255    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"]
Sep 15 11:33:32.514370 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:33:32.514329    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n266k\" is forbidden: User \"system:node:ip-10-0-139-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-116.ec2.internal' and this object" podUID="06c8a538-a3c5-49e1-9211-ebf5387a0b6b" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:32.516394 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:33:32.516355    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n266k\" is forbidden: User \"system:node:ip-10-0-139-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-116.ec2.internal' and this object" podUID="06c8a538-a3c5-49e1-9211-ebf5387a0b6b" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:32.636349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.636310    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fa13815-c567-406f-b3e7-368753cf3eb0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fjc44\" (UID: \"3fa13815-c567-406f-b3e7-368753cf3eb0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:33:32.636530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.636365    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37a5d58-576b-4daf-a1c4-f1dab177389e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cgkd\" (UID: \"c37a5d58-576b-4daf-a1c4-f1dab177389e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:32.636530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.636433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wfp5\" (UniqueName: \"kubernetes.io/projected/c37a5d58-576b-4daf-a1c4-f1dab177389e-kube-api-access-9wfp5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cgkd\" (UID: \"c37a5d58-576b-4daf-a1c4-f1dab177389e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:32.636530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.636499    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dbnr\" (UniqueName: \"kubernetes.io/projected/3fa13815-c567-406f-b3e7-368753cf3eb0-kube-api-access-6dbnr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fjc44\" (UID: \"3fa13815-c567-406f-b3e7-368753cf3eb0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:33:32.678977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.678946    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:32.681333 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:33:32.681307    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n266k\" is forbidden: User \"system:node:ip-10-0-139-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-116.ec2.internal' and this object" podUID="06c8a538-a3c5-49e1-9211-ebf5387a0b6b" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:32.737377 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.737335    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wfp5\" (UniqueName: \"kubernetes.io/projected/c37a5d58-576b-4daf-a1c4-f1dab177389e-kube-api-access-9wfp5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cgkd\" (UID: \"c37a5d58-576b-4daf-a1c4-f1dab177389e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:32.737553 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.737399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dbnr\" (UniqueName: \"kubernetes.io/projected/3fa13815-c567-406f-b3e7-368753cf3eb0-kube-api-access-6dbnr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fjc44\" (UID: \"3fa13815-c567-406f-b3e7-368753cf3eb0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:33:32.737553 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.737485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fa13815-c567-406f-b3e7-368753cf3eb0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fjc44\" (UID: \"3fa13815-c567-406f-b3e7-368753cf3eb0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:33:32.737553 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.737509    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37a5d58-576b-4daf-a1c4-f1dab177389e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cgkd\" (UID: \"c37a5d58-576b-4daf-a1c4-f1dab177389e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:32.737908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.737889    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37a5d58-576b-4daf-a1c4-f1dab177389e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cgkd\" (UID: \"c37a5d58-576b-4daf-a1c4-f1dab177389e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:32.737975 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.737891    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fa13815-c567-406f-b3e7-368753cf3eb0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fjc44\" (UID: \"3fa13815-c567-406f-b3e7-368753cf3eb0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:33:32.746349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.746310    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wfp5\" (UniqueName: \"kubernetes.io/projected/c37a5d58-576b-4daf-a1c4-f1dab177389e-kube-api-access-9wfp5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cgkd\" (UID: \"c37a5d58-576b-4daf-a1c4-f1dab177389e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:32.746490 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.746410    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dbnr\" (UniqueName: \"kubernetes.io/projected/3fa13815-c567-406f-b3e7-368753cf3eb0-kube-api-access-6dbnr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fjc44\" (UID: \"3fa13815-c567-406f-b3e7-368753cf3eb0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:33:32.780364 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.780329    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa1c3ece-5488-4ebb-a6ea-4914c115d55a" path="/var/lib/kubelet/pods/aa1c3ece-5488-4ebb-a6ea-4914c115d55a/volumes"
Sep 15 11:33:32.809664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.809614    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:33:32.817915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.817884    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:32.838160 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.838120    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8lxl\" (UniqueName: \"kubernetes.io/projected/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-kube-api-access-b8lxl\") pod \"06c8a538-a3c5-49e1-9211-ebf5387a0b6b\" (UID: \"06c8a538-a3c5-49e1-9211-ebf5387a0b6b\") "
Sep 15 11:33:32.838339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.838216    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-extensions-socket-volume\") pod \"06c8a538-a3c5-49e1-9211-ebf5387a0b6b\" (UID: \"06c8a538-a3c5-49e1-9211-ebf5387a0b6b\") "
Sep 15 11:33:32.838879 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.838834    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "06c8a538-a3c5-49e1-9211-ebf5387a0b6b" (UID: "06c8a538-a3c5-49e1-9211-ebf5387a0b6b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:33:32.840469 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.840440    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-kube-api-access-b8lxl" (OuterVolumeSpecName: "kube-api-access-b8lxl") pod "06c8a538-a3c5-49e1-9211-ebf5387a0b6b" (UID: "06c8a538-a3c5-49e1-9211-ebf5387a0b6b"). InnerVolumeSpecName "kube-api-access-b8lxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:33:32.939151 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.939114    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8lxl\" (UniqueName: \"kubernetes.io/projected/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-kube-api-access-b8lxl\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:33:32.939151 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:32.939147    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06c8a538-a3c5-49e1-9211-ebf5387a0b6b-extensions-socket-volume\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:33:33.095984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.095953    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"]
Sep 15 11:33:33.097075 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:33:33.097050    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa13815_c567_406f_b3e7_368753cf3eb0.slice/crio-1e4b874a501554f070dd2abe97dc7e40c7feb6b6ae559143e8a5775db3a74d5c WatchSource:0}: Error finding container 1e4b874a501554f070dd2abe97dc7e40c7feb6b6ae559143e8a5775db3a74d5c: Status 404 returned error can't find the container with id 1e4b874a501554f070dd2abe97dc7e40c7feb6b6ae559143e8a5775db3a74d5c
Sep 15 11:33:33.104026 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.103994    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"]
Sep 15 11:33:33.106217 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:33:33.106197    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37a5d58_576b_4daf_a1c4_f1dab177389e.slice/crio-8e2f7c3dc346b2cb2edd9d30a4a0342e1c495d02b0a01b94acac9add47bae2e7 WatchSource:0}: Error finding container 8e2f7c3dc346b2cb2edd9d30a4a0342e1c495d02b0a01b94acac9add47bae2e7: Status 404 returned error can't find the container with id 8e2f7c3dc346b2cb2edd9d30a4a0342e1c495d02b0a01b94acac9add47bae2e7
Sep 15 11:33:33.180262 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.180225    2570 generic.go:356] "Generic (PLEG): container finished" podID="06c8a538-a3c5-49e1-9211-ebf5387a0b6b" containerID="3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8" exitCode=0
Sep 15 11:33:33.180455 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.180268    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n266k"
Sep 15 11:33:33.180455 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.180321    2570 scope.go:117] "RemoveContainer" containerID="3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8"
Sep 15 11:33:33.182391 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.182360    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd" event={"ID":"c37a5d58-576b-4daf-a1c4-f1dab177389e","Type":"ContainerStarted","Data":"8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279"}
Sep 15 11:33:33.182531 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.182427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd" event={"ID":"c37a5d58-576b-4daf-a1c4-f1dab177389e","Type":"ContainerStarted","Data":"8e2f7c3dc346b2cb2edd9d30a4a0342e1c495d02b0a01b94acac9add47bae2e7"}
Sep 15 11:33:33.182531 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.182459    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:33.184251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.184228    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44" event={"ID":"3fa13815-c567-406f-b3e7-368753cf3eb0","Type":"ContainerStarted","Data":"794e0616b82ba62b8f1054ba046f4c9b063068422954189fb67e5aee67c66e67"}
Sep 15 11:33:33.184347 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.184267    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cms5x"
Sep 15 11:33:33.184347 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.184275    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44" event={"ID":"3fa13815-c567-406f-b3e7-368753cf3eb0","Type":"ContainerStarted","Data":"1e4b874a501554f070dd2abe97dc7e40c7feb6b6ae559143e8a5775db3a74d5c"}
Sep 15 11:33:33.184347 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.184340    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:33:33.191728 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.191706    2570 scope.go:117] "RemoveContainer" containerID="3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8"
Sep 15 11:33:33.191993 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:33:33.191974    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8\": container with ID starting with 3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8 not found: ID does not exist" containerID="3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8"
Sep 15 11:33:33.192063 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.192007    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8"} err="failed to get container status \"3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8\": rpc error: code = NotFound desc = could not find container \"3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8\": container with ID starting with 3939149aef89f1b7f82c24d6e78dce4923f0768471df06441f26610ea771e1c8 not found: ID does not exist"
Sep 15 11:33:33.193768 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.193748    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cms5x"
Sep 15 11:33:33.201436 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.201387    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd" podStartSLOduration=1.201371701 podStartE2EDuration="1.201371701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:33:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:33:33.199734479 +0000 UTC m=+514.955980858" watchObservedRunningTime="2026-09-15 11:33:33.201371701 +0000 UTC m=+514.957618079"
Sep 15 11:33:33.201903 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:33:33.201878    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-cms5x\" is forbidden: User \"system:node:ip-10-0-139-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-116.ec2.internal' and this object" podUID="aa1c3ece-5488-4ebb-a6ea-4914c115d55a" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cms5x"
Sep 15 11:33:33.223942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:33.223885    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44" podStartSLOduration=1.223862645 podStartE2EDuration="1.223862645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:33:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:33:33.222632246 +0000 UTC m=+514.978878627" watchObservedRunningTime="2026-09-15 11:33:33.223862645 +0000 UTC m=+514.980109023"
Sep 15 11:33:34.190238 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:34.190206    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cms5x"
Sep 15 11:33:34.192779 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:33:34.192754    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-cms5x\" is forbidden: User \"system:node:ip-10-0-139-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-116.ec2.internal' and this object" podUID="aa1c3ece-5488-4ebb-a6ea-4914c115d55a" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cms5x"
Sep 15 11:33:34.198471 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:33:34.198446    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-cms5x\" is forbidden: User \"system:node:ip-10-0-139-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-116.ec2.internal' and this object" podUID="aa1c3ece-5488-4ebb-a6ea-4914c115d55a" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cms5x"
Sep 15 11:33:34.654204 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:34.654157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:34.759747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:34.759711    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:34.780884 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:34.780854    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06c8a538-a3c5-49e1-9211-ebf5387a0b6b" path="/var/lib/kubelet/pods/06c8a538-a3c5-49e1-9211-ebf5387a0b6b/volumes"
Sep 15 11:33:35.191329 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:35.191294    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:35.364277 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:35.364242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:39.949384 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:39.949353    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:40.048702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:40.048661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:44.192815 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:44.192781    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:33:44.193183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:44.192952    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:44.262821 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:44.262789    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"]
Sep 15 11:33:44.263027 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:44.262975    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd" podUID="c37a5d58-576b-4daf-a1c4-f1dab177389e" containerName="manager" containerID="cri-o://8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279" gracePeriod=10
Sep 15 11:33:44.505540 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:44.505514    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:44.539050 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:44.539009    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wfp5\" (UniqueName: \"kubernetes.io/projected/c37a5d58-576b-4daf-a1c4-f1dab177389e-kube-api-access-9wfp5\") pod \"c37a5d58-576b-4daf-a1c4-f1dab177389e\" (UID: \"c37a5d58-576b-4daf-a1c4-f1dab177389e\") "
Sep 15 11:33:44.539050 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:44.539050    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37a5d58-576b-4daf-a1c4-f1dab177389e-extensions-socket-volume\") pod \"c37a5d58-576b-4daf-a1c4-f1dab177389e\" (UID: \"c37a5d58-576b-4daf-a1c4-f1dab177389e\") "
Sep 15 11:33:44.539693 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:44.539668    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c37a5d58-576b-4daf-a1c4-f1dab177389e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c37a5d58-576b-4daf-a1c4-f1dab177389e" (UID: "c37a5d58-576b-4daf-a1c4-f1dab177389e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:33:44.541437 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:44.541410    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c37a5d58-576b-4daf-a1c4-f1dab177389e-kube-api-access-9wfp5" (OuterVolumeSpecName: "kube-api-access-9wfp5") pod "c37a5d58-576b-4daf-a1c4-f1dab177389e" (UID: "c37a5d58-576b-4daf-a1c4-f1dab177389e"). InnerVolumeSpecName "kube-api-access-9wfp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:33:44.640242 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:44.640210    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wfp5\" (UniqueName: \"kubernetes.io/projected/c37a5d58-576b-4daf-a1c4-f1dab177389e-kube-api-access-9wfp5\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:33:44.640242 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:44.640237    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37a5d58-576b-4daf-a1c4-f1dab177389e-extensions-socket-volume\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:33:45.147772 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.147676    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:45.253886 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.253848    2570 generic.go:356] "Generic (PLEG): container finished" podID="c37a5d58-576b-4daf-a1c4-f1dab177389e" containerID="8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279" exitCode=0
Sep 15 11:33:45.254282 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.253895    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd" event={"ID":"c37a5d58-576b-4daf-a1c4-f1dab177389e","Type":"ContainerDied","Data":"8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279"}
Sep 15 11:33:45.254282 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.253909    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"
Sep 15 11:33:45.254282 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.253948    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd" event={"ID":"c37a5d58-576b-4daf-a1c4-f1dab177389e","Type":"ContainerDied","Data":"8e2f7c3dc346b2cb2edd9d30a4a0342e1c495d02b0a01b94acac9add47bae2e7"}
Sep 15 11:33:45.254282 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.253978    2570 scope.go:117] "RemoveContainer" containerID="8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279"
Sep 15 11:33:45.260263 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.260229    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:45.262995 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.262972    2570 scope.go:117] "RemoveContainer" containerID="8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279"
Sep 15 11:33:45.263251 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:33:45.263235    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279\": container with ID starting with 8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279 not found: ID does not exist" containerID="8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279"
Sep 15 11:33:45.263295 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.263268    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279"} err="failed to get container status \"8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279\": rpc error: code = NotFound desc = could not find container \"8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279\": container with ID starting with 8fa2dfaa6daf5519b820e9454cee9da0545e6b178a9e2b27813c7ed2ac3cd279 not found: ID does not exist"
Sep 15 11:33:45.290625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.290596    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"]
Sep 15 11:33:45.297722 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.297691    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cgkd"]
Sep 15 11:33:45.568204 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.568164    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:45.676189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.676150    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:45.774571 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.774525    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:45.866146 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:45.866065    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:46.780429 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:46.780396    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c37a5d58-576b-4daf-a1c4-f1dab177389e" path="/var/lib/kubelet/pods/c37a5d58-576b-4daf-a1c4-f1dab177389e/volumes"
Sep 15 11:33:52.183770 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:52.183680    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:52.277234 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:52.277201    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:56.928152 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:56.928089    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:33:57.030246 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:33:57.030208    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:00.562452 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.562417    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"]
Sep 15 11:34:00.562927 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.562779    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c37a5d58-576b-4daf-a1c4-f1dab177389e" containerName="manager"
Sep 15 11:34:00.562927 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.562791    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c37a5d58-576b-4daf-a1c4-f1dab177389e" containerName="manager"
Sep 15 11:34:00.562927 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.562862    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c37a5d58-576b-4daf-a1c4-f1dab177389e" containerName="manager"
Sep 15 11:34:00.584621 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.584593    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.587644 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.587623    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-79x57\""
Sep 15 11:34:00.595985 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.595957    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"]
Sep 15 11:34:00.632142 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.632111    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:00.675903 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.675864    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.676111 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.675921    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbcd7376-fc71-429f-8274-798305714971-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.676111 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.675942    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.676111 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.675959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbcd7376-fc71-429f-8274-798305714971-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.676111 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.676025    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h79q2\" (UniqueName: \"kubernetes.io/projected/cbcd7376-fc71-429f-8274-798305714971-kube-api-access-h79q2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.676320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.676112    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.676320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.676145    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.676320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.676180    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbcd7376-fc71-429f-8274-798305714971-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.676320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.676209    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.777368 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.777335    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.777368 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.777371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.777651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.777388    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbcd7376-fc71-429f-8274-798305714971-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.777651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.777408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.777651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.777436    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.777651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.777488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbcd7376-fc71-429f-8274-798305714971-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.777651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.777522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.777651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.777548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbcd7376-fc71-429f-8274-798305714971-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.777949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.777842    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.777949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.777903    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.778059 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.777964    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h79q2\" (UniqueName: \"kubernetes.io/projected/cbcd7376-fc71-429f-8274-798305714971-kube-api-access-h79q2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.778340 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.778285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.778695 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.778671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.778828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.778723    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbcd7376-fc71-429f-8274-798305714971-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.780241 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.780210    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbcd7376-fc71-429f-8274-798305714971-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.780348 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.780292    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbcd7376-fc71-429f-8274-798305714971-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.786000 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.785980    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbcd7376-fc71-429f-8274-798305714971-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.786153 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.786133    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h79q2\" (UniqueName: \"kubernetes.io/projected/cbcd7376-fc71-429f-8274-798305714971-kube-api-access-h79q2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w6hn5\" (UID: \"cbcd7376-fc71-429f-8274-798305714971\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:00.897186 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:00.897095    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:01.129910 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:01.129869    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:01.183930 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:01.182897    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"]
Sep 15 11:34:01.183930 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:34:01.183486    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbcd7376_fc71_429f_8274_798305714971.slice/crio-5a7e4646c9b0480f5c428f97d8ab9c0a1189ac0f899f2b11542144971fd9619d WatchSource:0}: Error finding container 5a7e4646c9b0480f5c428f97d8ab9c0a1189ac0f899f2b11542144971fd9619d: Status 404 returned error can't find the container with id 5a7e4646c9b0480f5c428f97d8ab9c0a1189ac0f899f2b11542144971fd9619d
Sep 15 11:34:01.188606 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:01.188484    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:34:01.188718 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:01.188615    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:34:01.188718 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:01.188670    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:34:01.342085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:01.342038    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5" event={"ID":"cbcd7376-fc71-429f-8274-798305714971","Type":"ContainerStarted","Data":"8330f5f7f708686811127eecc98c08db53ff735cc758649df7a365eab84c9977"}
Sep 15 11:34:01.342275 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:01.342096    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5" event={"ID":"cbcd7376-fc71-429f-8274-798305714971","Type":"ContainerStarted","Data":"5a7e4646c9b0480f5c428f97d8ab9c0a1189ac0f899f2b11542144971fd9619d"}
Sep 15 11:34:01.363617 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:01.363528    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5" podStartSLOduration=1.363510425 podStartE2EDuration="1.363510425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:34:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:34:01.361623924 +0000 UTC m=+543.117870302" watchObservedRunningTime="2026-09-15 11:34:01.363510425 +0000 UTC m=+543.119756879"
Sep 15 11:34:01.733722 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:01.733670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:01.833514 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:01.833481    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:01.897486 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:01.897448    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:02.324592 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.324545    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:02.424510 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.424473    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:02.525813 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.525625    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:02.582771 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.582686    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:34:02.586572 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.586539    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td"
Sep 15 11:34:02.589050 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.589020    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 11:34:02.596779 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.596755    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:34:02.628258 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.628228    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:34:02.697279 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.697249    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5941d1bb-2a63-47ad-96e8-eba4895095fa-config-file\") pod \"limitador-limitador-84994f7ffc-s65td\" (UID: \"5941d1bb-2a63-47ad-96e8-eba4895095fa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td"
Sep 15 11:34:02.697459 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.697282    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt24g\" (UniqueName: \"kubernetes.io/projected/5941d1bb-2a63-47ad-96e8-eba4895095fa-kube-api-access-nt24g\") pod \"limitador-limitador-84994f7ffc-s65td\" (UID: \"5941d1bb-2a63-47ad-96e8-eba4895095fa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td"
Sep 15 11:34:02.798783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.798748    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5941d1bb-2a63-47ad-96e8-eba4895095fa-config-file\") pod \"limitador-limitador-84994f7ffc-s65td\" (UID: \"5941d1bb-2a63-47ad-96e8-eba4895095fa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td"
Sep 15 11:34:02.798783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.798785    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt24g\" (UniqueName: \"kubernetes.io/projected/5941d1bb-2a63-47ad-96e8-eba4895095fa-kube-api-access-nt24g\") pod \"limitador-limitador-84994f7ffc-s65td\" (UID: \"5941d1bb-2a63-47ad-96e8-eba4895095fa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td"
Sep 15 11:34:02.799364 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.799344    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5941d1bb-2a63-47ad-96e8-eba4895095fa-config-file\") pod \"limitador-limitador-84994f7ffc-s65td\" (UID: \"5941d1bb-2a63-47ad-96e8-eba4895095fa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td"
Sep 15 11:34:02.806715 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.806688    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt24g\" (UniqueName: \"kubernetes.io/projected/5941d1bb-2a63-47ad-96e8-eba4895095fa-kube-api-access-nt24g\") pod \"limitador-limitador-84994f7ffc-s65td\" (UID: \"5941d1bb-2a63-47ad-96e8-eba4895095fa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td"
Sep 15 11:34:02.898800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.898710    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td"
Sep 15 11:34:02.902733 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:02.902699    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:03.176850 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:03.176822    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:34:03.178150 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:34:03.178122    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5941d1bb_2a63_47ad_96e8_eba4895095fa.slice/crio-6bfab5534ce0015f13036c1e597d4504ee97b4713e6e7096cf6614784eb77546 WatchSource:0}: Error finding container 6bfab5534ce0015f13036c1e597d4504ee97b4713e6e7096cf6614784eb77546: Status 404 returned error can't find the container with id 6bfab5534ce0015f13036c1e597d4504ee97b4713e6e7096cf6614784eb77546
Sep 15 11:34:03.288421 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:03.288387    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:03.354404 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:03.354365    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td" event={"ID":"5941d1bb-2a63-47ad-96e8-eba4895095fa","Type":"ContainerStarted","Data":"6bfab5534ce0015f13036c1e597d4504ee97b4713e6e7096cf6614784eb77546"}
Sep 15 11:34:03.354707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:03.354687    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:03.355584 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:03.355537    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:34:03.889850 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:03.889815    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:04.361022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:04.360989    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td" event={"ID":"5941d1bb-2a63-47ad-96e8-eba4895095fa","Type":"ContainerStarted","Data":"3317dc5b3ad5b1c1e25626f3492e2d1f7a72c1fa63be95cd965db2d4ec9e1d4b"}
Sep 15 11:34:04.361292 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:04.361277    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td"
Sep 15 11:34:04.380033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:04.379982    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td" podStartSLOduration=1.5019414210000002 podStartE2EDuration="2.379965094s" totalImagesPullingTime="878.023673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:34:04.379275558 +0000 UTC m=+546.135521937" watchObservedRunningTime="2026-09-15 11:34:04.379965094 +0000 UTC m=+546.136211498"
Sep 15 11:34:15.367767 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:15.367730    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-s65td"
Sep 15 11:34:17.368930 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:17.368900    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:18.456292 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:18.456256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:18.553680 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:18.553647    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:18.923320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:18.923291    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:30.561507 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:30.561472    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:30.771371 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:30.771336    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:31.959598 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:31.959554    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:38.054589 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:38.054523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:38.133382 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:38.133351    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:38.191045 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:38.190992    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:38.404681 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:38.404588    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:38.760177 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:38.760141    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:38.824064 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:38.824025    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:41.519168 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:41.519132    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:34:41.619048 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:34:41.619018    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:00.441489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:00.441451    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:15.342907 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:15.342874    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:15.451328 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:15.451292    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:16.833977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:16.833938    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:17.663689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:17.663645    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:35:18.331482 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:18.331431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:26.813599 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:26.813499    2570 generic.go:356] "Generic (PLEG): container finished" podID="cbcd7376-fc71-429f-8274-798305714971" containerID="8330f5f7f708686811127eecc98c08db53ff735cc758649df7a365eab84c9977" exitCode=0
Sep 15 11:35:26.814108 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:26.813593    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5" event={"ID":"cbcd7376-fc71-429f-8274-798305714971","Type":"ContainerDied","Data":"8330f5f7f708686811127eecc98c08db53ff735cc758649df7a365eab84c9977"}
Sep 15 11:35:26.814108 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:26.814078    2570 scope.go:117] "RemoveContainer" containerID="8330f5f7f708686811127eecc98c08db53ff735cc758649df7a365eab84c9977"
Sep 15 11:35:26.815244 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:26.815214    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:35:26.815319 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:26.815302    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:35:26.815369 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:26.815354    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:35:27.820828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:27.820786    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5" event={"ID":"cbcd7376-fc71-429f-8274-798305714971","Type":"ContainerStarted","Data":"151e92866009244fc495206939e47b7fdda2f230d3111001ca0156e9d5ad1b7f"}
Sep 15 11:35:27.897989 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:27.897946    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:35:27.898202 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:27.898173    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w6hn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 15 11:35:27.898278 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:27.898236    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5" podUID="cbcd7376-fc71-429f-8274-798305714971" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 15 11:35:28.472226 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:28.472195    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:28.581355 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:28.581296    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:28.897959 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:28.897924    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w6hn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 15 11:35:28.898353 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:28.897984    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5" podUID="cbcd7376-fc71-429f-8274-798305714971" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 15 11:35:29.898275 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:29.898235    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w6hn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 15 11:35:29.898673 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:29.898289    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5" podUID="cbcd7376-fc71-429f-8274-798305714971" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 15 11:35:30.897817 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:30.897777    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w6hn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 15 11:35:30.897997 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:30.897841    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5" podUID="cbcd7376-fc71-429f-8274-798305714971" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 15 11:35:31.898201 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:31.898161    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w6hn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 15 11:35:31.898624 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:31.898227    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5" podUID="cbcd7376-fc71-429f-8274-798305714971" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 15 11:35:32.901444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:32.901414    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:35:32.901854 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:32.901766    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:35:32.902515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:32.902498    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5"
Sep 15 11:35:37.211299 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:37.211265    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:37.689897 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:37.689859    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:35:42.136359 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:42.136320    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:42.219418 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:42.219383    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:45.704611 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:45.704575    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:46.384085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:46.384040    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:35:51.192953 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.192921    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"]
Sep 15 11:35:51.196732 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.196713    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.199932 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.199901    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 11:35:51.200900 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.200882    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 15 11:35:51.200900 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.200894    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p4bfm\""
Sep 15 11:35:51.201056 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.200924    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 11:35:51.208749 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.208723    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"]
Sep 15 11:35:51.233854 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.233817    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:51.380413 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.380379    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.380413 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.380422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.380687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.380449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.380687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.380507    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztrpl\" (UniqueName: \"kubernetes.io/projected/505beefd-975e-46e8-bc56-87c7d612b3d8-kube-api-access-ztrpl\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.380687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.380601    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/505beefd-975e-46e8-bc56-87c7d612b3d8-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.380687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.380617    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.481635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.481520    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/505beefd-975e-46e8-bc56-87c7d612b3d8-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.481635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.481583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.481635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.481635    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.481921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.481656    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.481921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.481678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.481921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.481728    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztrpl\" (UniqueName: \"kubernetes.io/projected/505beefd-975e-46e8-bc56-87c7d612b3d8-kube-api-access-ztrpl\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.482123 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.482098    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.482189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.482142    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.482232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.482190    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.483947 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.483925    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/505beefd-975e-46e8-bc56-87c7d612b3d8-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.484041 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.484027    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/505beefd-975e-46e8-bc56-87c7d612b3d8-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.490989 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.490966    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztrpl\" (UniqueName: \"kubernetes.io/projected/505beefd-975e-46e8-bc56-87c7d612b3d8-kube-api-access-ztrpl\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf\" (UID: \"505beefd-975e-46e8-bc56-87c7d612b3d8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.508827 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.508801    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:35:51.789980 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.789951    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"]
Sep 15 11:35:51.791633 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:35:51.791609    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505beefd_975e_46e8_bc56_87c7d612b3d8.slice/crio-aa98412c054382c429c9d0ff566673a6a1b801bb873661ad19ea70aeac81b71b WatchSource:0}: Error finding container aa98412c054382c429c9d0ff566673a6a1b801bb873661ad19ea70aeac81b71b: Status 404 returned error can't find the container with id aa98412c054382c429c9d0ff566673a6a1b801bb873661ad19ea70aeac81b71b
Sep 15 11:35:51.793371 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.793353    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:35:51.963119 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:51.963082    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf" event={"ID":"505beefd-975e-46e8-bc56-87c7d612b3d8","Type":"ContainerStarted","Data":"aa98412c054382c429c9d0ff566673a6a1b801bb873661ad19ea70aeac81b71b"}
Sep 15 11:35:52.065845 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:52.065757    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:52.294728 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:52.294691    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:35:52.971923 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:52.971883    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf" event={"ID":"505beefd-975e-46e8-bc56-87c7d612b3d8","Type":"ContainerStarted","Data":"3c039643148c2476882584fa864282f15dac9bc891053ab95ec997bdf4c515bb"}
Sep 15 11:35:52.996595 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:52.996515    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf" podStartSLOduration=1.007754347 podStartE2EDuration="1.996492303s" totalImagesPullingTime="988.737956ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:35:52.991551912 +0000 UTC m=+654.747798296" watchObservedRunningTime="2026-09-15 11:35:52.996492303 +0000 UTC m=+654.752738683"
Sep 15 11:35:56.596920 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:56.596882    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:35:57.891031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:35:57.890970    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:36:01.509676 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:36:01.509630    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:36:01.510075 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:36:01.509719    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:36:01.522325 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:36:01.522296    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:36:02.032193 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:36:02.032161    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf"
Sep 15 11:36:20.408956 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:36:20.408916    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:36:21.896459 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:36:21.896425    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:36:28.490160 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:36:28.490105    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:36:30.198258 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:36:30.198213    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:36:41.636602 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:36:41.636544    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:36:43.989031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:36:43.988987    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:37:35.184638 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:37:35.184603    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:35.246500 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:37:35.246464    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:18.199567 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:18.199518    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:18.376500 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:18.376461    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:19.599099 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:19.599064    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:19.782426 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:19.782392    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:36.821276 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:36.821243    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:36.921765 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:36.921731    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:37.026126 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.026096    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:37.201106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.201015    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"]
Sep 15 11:38:37.204617 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.204596    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.207173 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.207145    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-2fab1f-openshift-default-dockercfg-2p8c9\""
Sep 15 11:38:37.224239 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.224210    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"]
Sep 15 11:38:37.233023 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.232995    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:37.268974 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.268942    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-certs\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.269156 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.269002    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4z6x\" (UniqueName: \"kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-kube-api-access-p4z6x\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.269156 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.269064    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-istio-token\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.269156 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.269115    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/904a76a3-6f86-4da9-87e1-13761088ba29-istio-podinfo\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.269274 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.269178    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-envoy\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.269274 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.269210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/904a76a3-6f86-4da9-87e1-13761088ba29-istiod-ca-cert\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.269354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.269276    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-data\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.269354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.269309    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-socket\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.269354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.269336    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-credential-socket\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.299224 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.299188    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"]
Sep 15 11:38:37.303688 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.303658    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.306455 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.306424    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-0eb0ef-openshift-default-dockercfg-brvrj\""
Sep 15 11:38:37.325251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.325215    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"]
Sep 15 11:38:37.354945 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.354906    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:37.370476 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370439    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-credential-socket\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.370684 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-certs\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.370684 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370524    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-data\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.370684 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370568    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-certs\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.370684 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370625    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4z6x\" (UniqueName: \"kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-kube-api-access-p4z6x\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.370684 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370672    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-istio-token\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.370977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370702    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/904a76a3-6f86-4da9-87e1-13761088ba29-istiod-ca-cert\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.370977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-socket\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.370977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370759    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-podinfo\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.370977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-socket\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.370977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370824    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istiod-ca-cert\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.370977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370853    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-envoy\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.370977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370891    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-token\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.370977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370920    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr45c\" (UniqueName: \"kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-kube-api-access-jr45c\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.370977 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.370962    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-credential-socket\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.371449 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.371002    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/904a76a3-6f86-4da9-87e1-13761088ba29-istio-podinfo\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.371449 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.371023    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-data\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.371449 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.371033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-envoy\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.371449 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.371110    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-data\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.371449 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.371314    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-socket\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.371757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.371464    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-credential-socket\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.371757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.371550    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/904a76a3-6f86-4da9-87e1-13761088ba29-istiod-ca-cert\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.371757 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.371735    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-certs\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.373741 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.373713    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-envoy\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.373852 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.373770    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/904a76a3-6f86-4da9-87e1-13761088ba29-istio-podinfo\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.393742 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.393717    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-istio-token\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.394948 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.394924    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4z6x\" (UniqueName: \"kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-kube-api-access-p4z6x\") pod \"e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") " pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.419090 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.419055    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"]
Sep 15 11:38:37.424208 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.424190    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.427088 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.427066    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-9bd868-openshift-default-dockercfg-lhfvz\""
Sep 15 11:38:37.446030 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.446003    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"]
Sep 15 11:38:37.456403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.456241    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:37.471861 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.471832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-data\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.471945 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.471888    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-socket\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.471945 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.471921    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-envoy\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.472322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.471953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-certs\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.472322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9hqr\" (UniqueName: \"kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-kube-api-access-q9hqr\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.472322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472070    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-token\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.472322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472161    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-credential-socket\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.472322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-socket\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.472322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472255    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-podinfo\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.472322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472269    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-data\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.472322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472288    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-certs\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.472322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472302    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-certs\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.472322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istiod-ca-cert\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.472904 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-envoy\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.472904 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-token\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.472904 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr45c\" (UniqueName: \"kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-kube-api-access-jr45c\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.472904 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472447    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-data\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.472904 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472478    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-podinfo\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.472904 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472498    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-socket\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.472904 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472506    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/463b5e48-12c2-48b5-8631-8039daa8fabc-istiod-ca-cert\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.472904 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472573    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-credential-socket\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.473704 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.472916    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-credential-socket\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.473704 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.473223    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istiod-ca-cert\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.475226 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.475202    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-podinfo\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.475369 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.475348    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-envoy\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.481461 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.481436    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-token\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.481892 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.481870    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr45c\" (UniqueName: \"kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-kube-api-access-jr45c\") pod \"e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") " pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.515776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.515746    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:37.573309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.573199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-socket\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.573309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.573251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-envoy\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.573309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.573303    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9hqr\" (UniqueName: \"kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-kube-api-access-q9hqr\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.573591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.573335    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-token\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.573591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.573379    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-credential-socket\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.573591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.573465    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-certs\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.573591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.573528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-data\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.573591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.573580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-podinfo\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.573935 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.573608    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/463b5e48-12c2-48b5-8631-8039daa8fabc-istiod-ca-cert\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.573935 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.573677    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-socket\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.574290 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.574064    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-credential-socket\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.574412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.574368    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/463b5e48-12c2-48b5-8631-8039daa8fabc-istiod-ca-cert\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.577201 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.577149    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:37.578037 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.577869    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-data\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.578037 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.577954    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-podinfo\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.578371 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.578340    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-certs\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.580221 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.580198    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-envoy\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.583970 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.583931    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9hqr\" (UniqueName: \"kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-kube-api-access-q9hqr\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.586508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.586470    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-token\") pod \"e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") " pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.616140 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.616021    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:37.737309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.737216    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:37.802293 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.802049    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"]
Sep 15 11:38:37.806330 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:38:37.806295    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904a76a3_6f86_4da9_87e1_13761088ba29.slice/crio-ef8a462a238232927435eb78f70c753177f59134d635fbbee5028f4913d8b5c5 WatchSource:0}: Error finding container ef8a462a238232927435eb78f70c753177f59134d635fbbee5028f4913d8b5c5: Status 404 returned error can't find the container with id ef8a462a238232927435eb78f70c753177f59134d635fbbee5028f4913d8b5c5
Sep 15 11:38:37.810367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.810048    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:37.810367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.810138    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:37.810367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.810185    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:37.869327 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.869302    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" event={"ID":"904a76a3-6f86-4da9-87e1-13761088ba29","Type":"ContainerStarted","Data":"ef8a462a238232927435eb78f70c753177f59134d635fbbee5028f4913d8b5c5"}
Sep 15 11:38:37.916581 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.916480    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"]
Sep 15 11:38:37.917806 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:38:37.917713    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda156e1f7_2c3e_4b8a_ba3d_b18da873ceea.slice/crio-449f41f5e3031fb4760bee4cd8e4f1972c488e6c9a48b3ed0d98180c15f698f2 WatchSource:0}: Error finding container 449f41f5e3031fb4760bee4cd8e4f1972c488e6c9a48b3ed0d98180c15f698f2: Status 404 returned error can't find the container with id 449f41f5e3031fb4760bee4cd8e4f1972c488e6c9a48b3ed0d98180c15f698f2
Sep 15 11:38:37.920643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.920606    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:37.920756 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.920678    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:37.920756 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.920710    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:37.955339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:37.955309    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:38.033393 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.033309    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"]
Sep 15 11:38:38.035863 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.035607    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:38.036173 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:38:38.036126    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463b5e48_12c2_48b5_8631_8039daa8fabc.slice/crio-5393098a2eb144b1976cd986cca201bfc647e3a10396546cc2e0140c4dc61eea WatchSource:0}: Error finding container 5393098a2eb144b1976cd986cca201bfc647e3a10396546cc2e0140c4dc61eea: Status 404 returned error can't find the container with id 5393098a2eb144b1976cd986cca201bfc647e3a10396546cc2e0140c4dc61eea
Sep 15 11:38:38.038925 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.038886    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:38.039046 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.038966    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:38.039046 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.039004    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:38.307775 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.307736    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:38.396588 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.396532    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:38.789245 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.789213    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:38.876962 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.876931    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" event={"ID":"904a76a3-6f86-4da9-87e1-13761088ba29","Type":"ContainerStarted","Data":"4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23"}
Sep 15 11:38:38.878745 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.878722    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" event={"ID":"463b5e48-12c2-48b5-8631-8039daa8fabc","Type":"ContainerStarted","Data":"79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a"}
Sep 15 11:38:38.878877 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.878764    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" event={"ID":"463b5e48-12c2-48b5-8631-8039daa8fabc","Type":"ContainerStarted","Data":"5393098a2eb144b1976cd986cca201bfc647e3a10396546cc2e0140c4dc61eea"}
Sep 15 11:38:38.880343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.880322    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" event={"ID":"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea","Type":"ContainerStarted","Data":"409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265"}
Sep 15 11:38:38.880452 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.880363    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" event={"ID":"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea","Type":"ContainerStarted","Data":"449f41f5e3031fb4760bee4cd8e4f1972c488e6c9a48b3ed0d98180c15f698f2"}
Sep 15 11:38:38.939780 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.939730    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" podStartSLOduration=1.939713046 podStartE2EDuration="1.939713046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:38.937289862 +0000 UTC m=+820.693536240" watchObservedRunningTime="2026-09-15 11:38:38.939713046 +0000 UTC m=+820.695959424"
Sep 15 11:38:38.974520 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:38.974444    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" podStartSLOduration=1.974428701 podStartE2EDuration="1.974428701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:38.972801676 +0000 UTC m=+820.729048057" watchObservedRunningTime="2026-09-15 11:38:38.974428701 +0000 UTC m=+820.730675104"
Sep 15 11:38:39.008911 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.008855    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" podStartSLOduration=2.008833756 podStartE2EDuration="2.008833756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:39.007226019 +0000 UTC m=+820.763472398" watchObservedRunningTime="2026-09-15 11:38:39.008833756 +0000 UTC m=+820.765080137"
Sep 15 11:38:39.516748 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.516713    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:39.521542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.521515    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:39.616864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.616827    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:39.622006 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.621983    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:39.737595 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.737532    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:39.742715 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.742691    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:39.885855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.885759    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:39.885855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.885804    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:39.885855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.885822    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:39.887003 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.886977    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:38:39.887112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.887045    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:38:39.887192 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:39.887179    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:38:41.048927 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:41.048894    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:41.067453 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:41.067420    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:38:41.245336 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:41.245297    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:41.376951 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:41.376860    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:41.512154 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:41.512120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:42.366728 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:42.366687    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:42.440615 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:42.440581    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:42.952864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:42.952829    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:43.090866 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:43.090830    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:43.188260 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:43.188223    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:43.550364 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:43.550328    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:43.617926 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:43.617890    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:44.092318 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:44.092279    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:44.232924 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:44.232892    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:44.466615 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:44.466509    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:44.817155 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:44.817121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:44.921519 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:44.921486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:45.021720 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:45.021680    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:45.430389 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:45.430349    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:45.571065 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:45.571032    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:46.042743 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:46.042703    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:46.904878 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:46.904843    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:47.007289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.007253    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:47.169416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.169320    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:47.233973 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.233944    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7488-6be158"]
Sep 15 11:38:47.237780 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.237760    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7488-6be158"
Sep 15 11:38:47.241461 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.241436    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lrtt7\""
Sep 15 11:38:47.244612 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.244584    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7488-6be158"]
Sep 15 11:38:47.376600 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.376541    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn7tj\" (UniqueName: \"kubernetes.io/projected/66a21e5c-3101-4f8e-bd14-01deae212fba-kube-api-access-fn7tj\") pod \"test-curl-7488-6be158\" (UID: \"66a21e5c-3101-4f8e-bd14-01deae212fba\") " pod="opendatahub/test-curl-7488-6be158"
Sep 15 11:38:47.478266 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.478172    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn7tj\" (UniqueName: \"kubernetes.io/projected/66a21e5c-3101-4f8e-bd14-01deae212fba-kube-api-access-fn7tj\") pod \"test-curl-7488-6be158\" (UID: \"66a21e5c-3101-4f8e-bd14-01deae212fba\") " pod="opendatahub/test-curl-7488-6be158"
Sep 15 11:38:47.494247 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.494217    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn7tj\" (UniqueName: \"kubernetes.io/projected/66a21e5c-3101-4f8e-bd14-01deae212fba-kube-api-access-fn7tj\") pod \"test-curl-7488-6be158\" (UID: \"66a21e5c-3101-4f8e-bd14-01deae212fba\") " pod="opendatahub/test-curl-7488-6be158"
Sep 15 11:38:47.494819 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.494794    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"]
Sep 15 11:38:47.499082 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.499058    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.503311 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.503284    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9f77ab79-openshift-default-dockercfg-mlwws\""
Sep 15 11:38:47.514211 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.514184    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"]
Sep 15 11:38:47.525322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.525289    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:47.549421 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.549388    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7488-6be158"
Sep 15 11:38:47.583677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.579234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-socket\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.583677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.579284    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istiod-ca-cert\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.583677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.579393    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-certs\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.583677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.579493    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-credential-socket\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.583677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.579526    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-token\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.583677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.579623    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-podinfo\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.583677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.579679    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-data\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.583677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.579705    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr9hl\" (UniqueName: \"kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-kube-api-access-kr9hl\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.583677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.579758    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-envoy\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.680983 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.680945    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-envoy\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681002    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-socket\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681030    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istiod-ca-cert\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681076    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-certs\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681127    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-credential-socket\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681153    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-token\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681473 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-podinfo\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681473 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-data\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681473 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681302    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr9hl\" (UniqueName: \"kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-kube-api-access-kr9hl\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681672 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681479    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-socket\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681672 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681599    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-credential-socket\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681790 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681735    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-data\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.681918 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681891    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istiod-ca-cert\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.682036 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.681931    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-certs\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.683773 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.683748    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-envoy\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.683965 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.683941    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-podinfo\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.689527 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.689503    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-token\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.689793 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.689770    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr9hl\" (UniqueName: \"kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-kube-api-access-kr9hl\") pod \"e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") " pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.814131 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.814087    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:47.841104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.841070    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7488-6be158"]
Sep 15 11:38:47.842769 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:38:47.842736    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66a21e5c_3101_4f8e_bd14_01deae212fba.slice/crio-c76621671df59264f2476eeb9b0c41ab31c051a0dd820a3f10efd6c4d9bae016 WatchSource:0}: Error finding container c76621671df59264f2476eeb9b0c41ab31c051a0dd820a3f10efd6c4d9bae016: Status 404 returned error can't find the container with id c76621671df59264f2476eeb9b0c41ab31c051a0dd820a3f10efd6c4d9bae016
Sep 15 11:38:47.845328 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.845226    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:47.932701 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.932663    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7488-6be158" event={"ID":"66a21e5c-3101-4f8e-bd14-01deae212fba","Type":"ContainerStarted","Data":"c76621671df59264f2476eeb9b0c41ab31c051a0dd820a3f10efd6c4d9bae016"}
Sep 15 11:38:47.954193 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:47.954157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:48.099399 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:48.099365    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"]
Sep 15 11:38:48.100226 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:38:48.100198    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3475e39_2a09_491c_9bce_2cef7c3ac6f5.slice/crio-c7d903f861f6a9cdb60acc36254137a4b0ba11b462fa9edf67fdfa2221e50288 WatchSource:0}: Error finding container c7d903f861f6a9cdb60acc36254137a4b0ba11b462fa9edf67fdfa2221e50288: Status 404 returned error can't find the container with id c7d903f861f6a9cdb60acc36254137a4b0ba11b462fa9edf67fdfa2221e50288
Sep 15 11:38:48.102642 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:48.102608    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:48.102709 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:48.102677    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:48.102753 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:48.102704    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:48.940406 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:48.940370    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" event={"ID":"a3475e39-2a09-491c-9bce-2cef7c3ac6f5","Type":"ContainerStarted","Data":"ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e"}
Sep 15 11:38:48.940883 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:48.940433    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" event={"ID":"a3475e39-2a09-491c-9bce-2cef7c3ac6f5","Type":"ContainerStarted","Data":"c7d903f861f6a9cdb60acc36254137a4b0ba11b462fa9edf67fdfa2221e50288"}
Sep 15 11:38:48.942091 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:48.942060    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7488-6be158" event={"ID":"66a21e5c-3101-4f8e-bd14-01deae212fba","Type":"ContainerStarted","Data":"fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8"}
Sep 15 11:38:48.968413 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:48.968361    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" podStartSLOduration=1.968345411 podStartE2EDuration="1.968345411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:48.965615102 +0000 UTC m=+830.721861480" watchObservedRunningTime="2026-09-15 11:38:48.968345411 +0000 UTC m=+830.724591868"
Sep 15 11:38:48.983880 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:48.983832    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7488-6be158" podStartSLOduration=1.389693439 podStartE2EDuration="1.983817936s" totalImagesPullingTime="594.124497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:48.982968098 +0000 UTC m=+830.739214480" watchObservedRunningTime="2026-09-15 11:38:48.983817936 +0000 UTC m=+830.740064316"
Sep 15 11:38:49.754261 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:49.754155    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7488-6be158"]
Sep 15 11:38:49.765961 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:49.765788    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7488-6be158"]
Sep 15 11:38:49.814382 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:49.814349    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:49.817879 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:49.817841    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:49.819680 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:49.819657    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:49.951699 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:38:49.951665    2570 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7488-6be158" container="test-curl-7488-6be158"
Sep 15 11:38:49.952185 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:49.951667    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:49.953365 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:49.953338    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:38:50.421361 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:50.421323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:50.529598 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:50.523287    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:50.627990 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:50.627945    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:50.973489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:50.973448    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"]
Sep 15 11:38:50.973990 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:50.973768    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7488-6be158" podUID="66a21e5c-3101-4f8e-bd14-01deae212fba" containerName="test-curl-7488-6be158" containerID="cri-o://fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8" gracePeriod=2
Sep 15 11:38:50.974064 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:50.974044    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66a21e5c-3101-4f8e-bd14-01deae212fba" containerName="test-curl-7488-6be158"
Sep 15 11:38:50.974064 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:50.974061    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="66a21e5c-3101-4f8e-bd14-01deae212fba" containerName="test-curl-7488-6be158"
Sep 15 11:38:50.984958 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:50.984722    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="66a21e5c-3101-4f8e-bd14-01deae212fba" containerName="test-curl-7488-6be158"
Sep 15 11:38:51.037664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.030756    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"]
Sep 15 11:38:51.037664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.030885    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.037664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.036856    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-e114ba-openshift-default-dockercfg-hp9rp\""
Sep 15 11:38:51.103775 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.102007    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:51.138333 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.138291    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-envoy\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.139381 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.139356    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f58bc28e-af73-405e-ae20-622a64f1891b-istio-podinfo\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.139553 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.139536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8827\" (UniqueName: \"kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-kube-api-access-b8827\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.139711 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.139696    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-socket\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.139848 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.139834    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f58bc28e-af73-405e-ae20-622a64f1891b-istiod-ca-cert\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.140018 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.140004    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-certs\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.140217 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.140202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-istio-token\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.140606 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.140588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-data\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.140750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.140736    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-credential-socket\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.245208 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.245099    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-credential-socket\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.245596 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.245550    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-envoy\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.245740 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.245725    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f58bc28e-af73-405e-ae20-622a64f1891b-istio-podinfo\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.245865 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.245850    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8827\" (UniqueName: \"kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-kube-api-access-b8827\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.245967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.245955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-socket\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.246069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.246055    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f58bc28e-af73-405e-ae20-622a64f1891b-istiod-ca-cert\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.246202 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.246188    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-certs\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.246347 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.246334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-istio-token\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.246455 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.246441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-data\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.247019 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.246989    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-data\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.247400 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.247383    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-credential-socket\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.248105 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.248084    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-socket\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.248945 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.248917    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-certs\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.249639 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.249588    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f58bc28e-af73-405e-ae20-622a64f1891b-istiod-ca-cert\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.250166 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.250137    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:51.255586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.252118    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-envoy\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.265152 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.265122    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-istio-token\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.268581 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.266052    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f58bc28e-af73-405e-ae20-622a64f1891b-istio-podinfo\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.278293 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.278264    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8827\" (UniqueName: \"kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-kube-api-access-b8827\") pod \"e2e-autores-e114ba-openshift-default-844c8bc678-gzphs\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") " pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.402501 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.402459    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:51.902693 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.902655    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"]
Sep 15 11:38:51.913747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.912549    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:51.913747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.912665    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:51.913747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.912710    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:51.990583 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:51.988764    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" event={"ID":"f58bc28e-af73-405e-ae20-622a64f1891b","Type":"ContainerStarted","Data":"b4050c841e27d984c1d78fc85cb5a0cf219a8ddd4f63fd4a83af2e8d48129fac"}
Sep 15 11:38:52.039295 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:52.039156    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:52.161458 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:52.161365    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:52.935325 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:52.935286    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:53.002029 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:53.001984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" event={"ID":"f58bc28e-af73-405e-ae20-622a64f1891b","Type":"ContainerStarted","Data":"cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72"}
Sep 15 11:38:53.067594 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:53.065641    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" podStartSLOduration=3.065616963 podStartE2EDuration="3.065616963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:53.061786016 +0000 UTC m=+834.818032410" watchObservedRunningTime="2026-09-15 11:38:53.065616963 +0000 UTC m=+834.821863343"
Sep 15 11:38:53.390176 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:53.390146    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7488-6be158"
Sep 15 11:38:53.404870 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:53.404822    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:53.415571 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:53.415526    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:53.507096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:53.507062    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn7tj\" (UniqueName: \"kubernetes.io/projected/66a21e5c-3101-4f8e-bd14-01deae212fba-kube-api-access-fn7tj\") pod \"66a21e5c-3101-4f8e-bd14-01deae212fba\" (UID: \"66a21e5c-3101-4f8e-bd14-01deae212fba\") "
Sep 15 11:38:53.517951 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:53.517913    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66a21e5c-3101-4f8e-bd14-01deae212fba-kube-api-access-fn7tj" (OuterVolumeSpecName: "kube-api-access-fn7tj") pod "66a21e5c-3101-4f8e-bd14-01deae212fba" (UID: "66a21e5c-3101-4f8e-bd14-01deae212fba"). InnerVolumeSpecName "kube-api-access-fn7tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:38:53.608751 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:53.608630    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn7tj\" (UniqueName: \"kubernetes.io/projected/66a21e5c-3101-4f8e-bd14-01deae212fba-kube-api-access-fn7tj\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:38:54.009742 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.009710    2570 generic.go:356] "Generic (PLEG): container finished" podID="66a21e5c-3101-4f8e-bd14-01deae212fba" containerID="fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8" exitCode=137
Sep 15 11:38:54.009742 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.009737    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7488-6be158"
Sep 15 11:38:54.010273 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.009785    2570 scope.go:117] "RemoveContainer" containerID="fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8"
Sep 15 11:38:54.010895 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.010849    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:54.011807 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.011791    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:38:54.032962 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.032391    2570 scope.go:117] "RemoveContainer" containerID="fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8"
Sep 15 11:38:54.032962 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:38:54.032783    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8\": container with ID starting with fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8 not found: ID does not exist" containerID="fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8"
Sep 15 11:38:54.032962 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.032816    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8"} err="failed to get container status \"fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8\": rpc error: code = NotFound desc = could not find container \"fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8\": container with ID starting with fd0177bb607b45a0635bb76eb51dec9b8928c3855cc175a032374bca79ae84c8 not found: ID does not exist"
Sep 15 11:38:54.048797 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:38:54.048746    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7488-6be158\" is forbidden: User \"system:node:ip-10-0-139-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-116.ec2.internal' and this object" podUID="66a21e5c-3101-4f8e-bd14-01deae212fba" pod="opendatahub/test-curl-7488-6be158"
Sep 15 11:38:54.199580 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.199487    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:54.309258 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.309121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:54.744324 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.744201    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:54.801642 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.801606    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66a21e5c-3101-4f8e-bd14-01deae212fba" path="/var/lib/kubelet/pods/66a21e5c-3101-4f8e-bd14-01deae212fba/volumes"
Sep 15 11:38:54.835144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.834928    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:54.961349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:54.961295    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:55.286631 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:55.286583    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:55.392915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:55.392870    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:55.806296 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:55.806270    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:55.962501 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:55.962461    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:56.188338 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.188238    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:56.299654 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.299622    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:56.402201 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.402169    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:56.560814 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.560766    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"]
Sep 15 11:38:56.566505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.566472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.570121 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.570089    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"]
Sep 15 11:38:56.571759 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.571733    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1358dc-openshift-default-dockercfg-56jml\""
Sep 15 11:38:56.596003 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.595970    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:56.660454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.660419    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-token\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.660661 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.660486    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-certs\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.660661 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.660618    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-envoy\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.660781 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.660659    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4pr\" (UniqueName: \"kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-kube-api-access-dh4pr\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.660781 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.660691    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-socket\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.660781 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.660730    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-podinfo\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.660781 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.660757    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-credential-socket\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.661003 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.660851    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-data\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.661003 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.660904    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istiod-ca-cert\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.762363 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.762319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-certs\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.762549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.762422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-envoy\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.762549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.762454    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4pr\" (UniqueName: \"kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-kube-api-access-dh4pr\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.762549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.762483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-socket\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.762549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.762521    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-podinfo\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.762549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.762547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-credential-socket\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.762871 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.762606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-data\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.762871 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.762646    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istiod-ca-cert\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.762871 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.762734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-token\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.762871 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.762814    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-certs\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.763087 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.763062    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-credential-socket\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.763139 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.763126    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-socket\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.763622 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.763305    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-data\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.764828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.763808    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istiod-ca-cert\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.765349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.765327    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-envoy\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.766708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.766683    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-podinfo\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.778520 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.778473    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-token\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.778640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.778619    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4pr\" (UniqueName: \"kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-kube-api-access-dh4pr\") pod \"e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") " pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.885795 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.885596    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:56.947086 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:56.946876    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:57.084432 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:57.084242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:57.274992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:57.273306    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"]
Sep 15 11:38:57.281694 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:57.281653    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:57.281818 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:57.281743    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:57.281818 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:57.281789    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:38:57.871308 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:57.871275    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:58.061384 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:58.061349    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" event={"ID":"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84","Type":"ContainerStarted","Data":"80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417"}
Sep 15 11:38:58.061547 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:58.061411    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" event={"ID":"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84","Type":"ContainerStarted","Data":"5268e432d9f77a1cd8b53d5f5d9d51f78fb0cc36f2abd69e2b77e53164bdf044"}
Sep 15 11:38:58.093548 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:58.093486    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" podStartSLOduration=2.093464676 podStartE2EDuration="2.093464676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:58.09016027 +0000 UTC m=+839.846406649" watchObservedRunningTime="2026-09-15 11:38:58.093464676 +0000 UTC m=+839.849711058"
Sep 15 11:38:58.385154 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:58.385092    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:58.590375 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:58.590333    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:58.684410 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:58.684324    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:58.810354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:58.810323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:58.886052 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:58.886022    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:58.891263 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:58.891235    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:58.912987 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:58.912951    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:59.069875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:59.069845    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:59.070916 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:59.070892    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:38:59.723621 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:59.723510    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.074349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:59.859735    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.074349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:38:59.956592    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.074349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:00.129281    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.074349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:00.226113    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.074349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:00.337499    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.074349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:00.427779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.074349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:00.949600    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.085215 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:01.085188    2570 generic.go:356] "Generic (PLEG): container finished" podID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerID="409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265" exitCode=0
Sep 15 11:39:01.085353 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:01.085271    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" event={"ID":"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea","Type":"ContainerDied","Data":"409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265"}
Sep 15 11:39:01.085928 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:01.085912    2570 scope.go:117] "RemoveContainer" containerID="409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265"
Sep 15 11:39:01.087332 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:01.087298    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:01.087418 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:01.087386    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:01.087466 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:01.087431    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:01.452485 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:01.452392    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.501029 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:01.501000    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:39:02.015667 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.015635    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:02.084160 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.084121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:02.097425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.097391    2570 generic.go:356] "Generic (PLEG): container finished" podID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerID="79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a" exitCode=0
Sep 15 11:39:02.097623 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.097467    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" event={"ID":"463b5e48-12c2-48b5-8631-8039daa8fabc","Type":"ContainerDied","Data":"79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a"}
Sep 15 11:39:02.098053 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.098032    2570 scope.go:117] "RemoveContainer" containerID="79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a"
Sep 15 11:39:02.099458 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.099423    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:02.099583 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.099516    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:02.099645 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.099585    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:02.100625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.100597    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" event={"ID":"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea","Type":"ContainerStarted","Data":"6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370"}
Sep 15 11:39:02.102452 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.102431    2570 generic.go:356] "Generic (PLEG): container finished" podID="904a76a3-6f86-4da9-87e1-13761088ba29" containerID="4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23" exitCode=0
Sep 15 11:39:02.102535 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.102509    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" event={"ID":"904a76a3-6f86-4da9-87e1-13761088ba29","Type":"ContainerDied","Data":"4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23"}
Sep 15 11:39:02.102963 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.102944    2570 scope.go:117] "RemoveContainer" containerID="4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23"
Sep 15 11:39:02.110862 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.110832    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:02.110948 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.110928    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:02.110987 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.110977    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:02.368620 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.368496    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:02.616344 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.616304    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:39:02.616536 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.616471    2570 patch_prober.go:28] interesting pod/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:39:02.616645 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.616527    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 15 11:39:02.646548 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.646455    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:02.738044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:02.738009    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:03.110322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.110291    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" event={"ID":"463b5e48-12c2-48b5-8631-8039daa8fabc","Type":"ContainerStarted","Data":"11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e"}
Sep 15 11:39:03.112346 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.112316    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" event={"ID":"904a76a3-6f86-4da9-87e1-13761088ba29","Type":"ContainerStarted","Data":"55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549"}
Sep 15 11:39:03.216403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.216366    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:03.517144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.517094    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:39:03.517363 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.517274    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:39:03.517363 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.517336    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 11:39:03.617493 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.617453    2570 patch_prober.go:28] interesting pod/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:39:03.617720 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.617520    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 15 11:39:03.738004 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.737964    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:39:03.738217 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.738141    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 15 11:39:03.738345 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.738296    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 15 11:39:03.923542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:03.923444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:04.034929 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:04.034379    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:04.135580 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:04.135526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:04.516514 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:04.516475    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:39:04.516780 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:04.516749    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 11:39:04.617284 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:04.617244    2570 patch_prober.go:28] interesting pod/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:39:04.617500 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:04.617322    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 15 11:39:04.738248 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:04.738201    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 15 11:39:04.738458 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:04.738274    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 15 11:39:04.899364 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:04.899255    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:05.517007 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:05.516968    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:39:05.517406 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:05.517024    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 11:39:05.616812 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:05.616775    2570 patch_prober.go:28] interesting pod/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:39:05.616996 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:05.616827    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 15 11:39:05.622028 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:05.622000    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:05.737699 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:05.737654    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 15 11:39:05.737882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:05.737730    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 15 11:39:06.460104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:06.460040    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:06.516524 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:06.516479    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:39:06.516748 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:06.516541    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 11:39:06.562607 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:06.562539    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:06.616825 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:06.616783    2570 patch_prober.go:28] interesting pod/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:39:06.617034 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:06.616862    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 15 11:39:06.676692 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:06.676652    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:06.738040 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:06.737934    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 15 11:39:06.738040 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:06.738015    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 15 11:39:07.274651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:07.274600    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:07.516909 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:07.516847    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:39:07.517131 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:07.516917    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 11:39:07.714625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:07.714518    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:39:07.715104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:07.715080    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:39:07.716031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:07.715992    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:39:07.745502 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:07.744646    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 15 11:39:07.745502 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:07.744708    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 15 11:39:07.979990 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:07.979905    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:08.517089 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:08.517038    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:39:08.517251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:08.517129    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 11:39:08.738481 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:08.738434    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 15 11:39:08.738984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:08.738521    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 15 11:39:08.752215 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:08.752172    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:09.520956 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:09.520926    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:39:09.521344 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:09.521320    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:39:09.522037 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:09.522016    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:39:09.742354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:09.742326    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:39:09.742759 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:09.742740    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:39:09.743305 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:09.743285    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:39:12.656681 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:12.656644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:12.775936 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:12.775903    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:12.874285 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:12.874242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:12.974431 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:12.974330    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:15.275488 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:15.275443    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:16.734577 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:16.734531    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:17.421698 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:17.421631    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:18.095660 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:18.095620    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:18.799196 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:18.799157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:19.132035 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:19.131927    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:19.238524 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:19.238476    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:19.607800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:19.607755    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:20.314200 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:20.314074    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:21.011616 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:21.011427    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"]
Sep 15 11:39:21.025431 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:21.025392    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"
Sep 15 11:39:21.026714 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:21.026684    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"]
Sep 15 11:39:21.031922 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:21.031890    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:39:21.032046 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:21.031926    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2w6g9\""
Sep 15 11:39:21.172650 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:21.172602    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/152df4a2-6cd6-4eda-aac9-299919c61ac3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l\" (UID: \"152df4a2-6cd6-4eda-aac9-299919c61ac3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"
Sep 15 11:39:21.267993 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:21.267905    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:21.274096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:21.274064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/152df4a2-6cd6-4eda-aac9-299919c61ac3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l\" (UID: \"152df4a2-6cd6-4eda-aac9-299919c61ac3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"
Sep 15 11:39:21.274763 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:21.274745    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/152df4a2-6cd6-4eda-aac9-299919c61ac3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l\" (UID: \"152df4a2-6cd6-4eda-aac9-299919c61ac3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"
Sep 15 11:39:21.377341 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:21.377300    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"
Sep 15 11:39:21.689917 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:21.689882    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"]
Sep 15 11:39:21.690233 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:39:21.690204    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152df4a2_6cd6_4eda_aac9_299919c61ac3.slice/crio-3dc52056b8cada4091ea5ff71d635f0222665be0a14b80cb86b3ea95ff89e1ae WatchSource:0}: Error finding container 3dc52056b8cada4091ea5ff71d635f0222665be0a14b80cb86b3ea95ff89e1ae: Status 404 returned error can't find the container with id 3dc52056b8cada4091ea5ff71d635f0222665be0a14b80cb86b3ea95ff89e1ae
Sep 15 11:39:22.015082 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:22.014999    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:22.268305 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:22.268220    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l" event={"ID":"152df4a2-6cd6-4eda-aac9-299919c61ac3","Type":"ContainerStarted","Data":"3dc52056b8cada4091ea5ff71d635f0222665be0a14b80cb86b3ea95ff89e1ae"}
Sep 15 11:39:22.587148 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:22.587067    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:39:22.815661 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:22.815486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:23.844106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:23.489332    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:24.012332 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.012293    2570 patch_prober.go:28] interesting pod/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:39:24.012544 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.012377    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 11:39:24.285508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.285478    2570 generic.go:356] "Generic (PLEG): container finished" podID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerID="80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417" exitCode=0
Sep 15 11:39:24.285679 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.285537    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" event={"ID":"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84","Type":"ContainerDied","Data":"80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417"}
Sep 15 11:39:24.286081 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.286056    2570 scope.go:117] "RemoveContainer" containerID="80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417"
Sep 15 11:39:24.287355 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.287326    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:24.287444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.287423    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:24.287508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.287466    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:24.287578 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.287537    2570 generic.go:356] "Generic (PLEG): container finished" podID="f58bc28e-af73-405e-ae20-622a64f1891b" containerID="cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72" exitCode=0
Sep 15 11:39:24.287625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.287607    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" event={"ID":"f58bc28e-af73-405e-ae20-622a64f1891b","Type":"ContainerDied","Data":"cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72"}
Sep 15 11:39:24.287998 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.287980    2570 scope.go:117] "RemoveContainer" containerID="cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72"
Sep 15 11:39:24.289254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.289224    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:24.289324 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.289301    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:24.289369 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.289348    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:24.404584 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.404328    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:24.987011 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:24.986970    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:25.145281 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.145241    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:25.297323 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.297285    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" event={"ID":"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84","Type":"ContainerStarted","Data":"bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480"}
Sep 15 11:39:25.299098 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.299065    2570 generic.go:356] "Generic (PLEG): container finished" podID="152df4a2-6cd6-4eda-aac9-299919c61ac3" containerID="1fdf64f837bb59cba6ca6e1a53a91739305b504b9fb35ded729d3a2b71f0fa6b" exitCode=0
Sep 15 11:39:25.299242 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.299149    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l" event={"ID":"152df4a2-6cd6-4eda-aac9-299919c61ac3","Type":"ContainerDied","Data":"1fdf64f837bb59cba6ca6e1a53a91739305b504b9fb35ded729d3a2b71f0fa6b"}
Sep 15 11:39:25.301340 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.301315    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" event={"ID":"f58bc28e-af73-405e-ae20-622a64f1891b","Type":"ContainerStarted","Data":"97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba"}
Sep 15 11:39:25.403553 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.403506    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:39:25.403794 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.403644    2570 patch_prober.go:28] interesting pod/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:39:25.403794 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.403681    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 11:39:25.415097 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.415052    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:25.886185 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.886083    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:39:25.887676 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.887647    2570 patch_prober.go:28] interesting pod/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 15 11:39:25.887762 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:25.887727    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 15 11:39:26.196853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.196749    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:26.309572 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.309521    2570 generic.go:356] "Generic (PLEG): container finished" podID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerID="ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e" exitCode=0
Sep 15 11:39:26.310237 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.310217    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" event={"ID":"a3475e39-2a09-491c-9bce-2cef7c3ac6f5","Type":"ContainerDied","Data":"ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e"}
Sep 15 11:39:26.310525 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.310511    2570 scope.go:117] "RemoveContainer" containerID="ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e"
Sep 15 11:39:26.311776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.311741    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:26.311885 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.311820    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:26.311885 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.311860    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:26.404044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.403887    2570 patch_prober.go:28] interesting pod/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:39:26.404044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.403964    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 11:39:26.619800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.619767    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"
Sep 15 11:39:26.664582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.664104    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/152df4a2-6cd6-4eda-aac9-299919c61ac3-maas-api-service-ca\") pod \"152df4a2-6cd6-4eda-aac9-299919c61ac3\" (UID: \"152df4a2-6cd6-4eda-aac9-299919c61ac3\") "
Sep 15 11:39:26.667591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.664853    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/152df4a2-6cd6-4eda-aac9-299919c61ac3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "152df4a2-6cd6-4eda-aac9-299919c61ac3" (UID: "152df4a2-6cd6-4eda-aac9-299919c61ac3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:26.768370 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.768324    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/152df4a2-6cd6-4eda-aac9-299919c61ac3-maas-api-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:39:26.887100 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.887054    2570 patch_prober.go:28] interesting pod/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 15 11:39:26.887414 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.887365    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 15 11:39:26.914141 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:26.914047    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:27.317231 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:27.317201    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"
Sep 15 11:39:27.317647 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:27.317235    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l" event={"ID":"152df4a2-6cd6-4eda-aac9-299919c61ac3","Type":"ContainerDied","Data":"3dc52056b8cada4091ea5ff71d635f0222665be0a14b80cb86b3ea95ff89e1ae"}
Sep 15 11:39:27.317647 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:27.317287    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3dc52056b8cada4091ea5ff71d635f0222665be0a14b80cb86b3ea95ff89e1ae"
Sep 15 11:39:27.320082 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:27.320057    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" event={"ID":"a3475e39-2a09-491c-9bce-2cef7c3ac6f5","Type":"ContainerStarted","Data":"bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b"}
Sep 15 11:39:27.403200 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:27.403163    2570 patch_prober.go:28] interesting pod/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:39:27.403380 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:27.403222    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 11:39:27.815516 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:27.815425    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:39:27.816041 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:27.815825    2570 patch_prober.go:28] interesting pod/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 15 11:39:27.816041 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:27.815880    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 15 11:39:27.887139 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:27.887091    2570 patch_prober.go:28] interesting pod/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 15 11:39:27.887353 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:27.887167    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 15 11:39:28.403506 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:28.403456    2570 patch_prober.go:28] interesting pod/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:39:28.404164 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:28.404127    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 11:39:28.815369 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:28.815325    2570 patch_prober.go:28] interesting pod/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 15 11:39:28.815555 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:28.815388    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 15 11:39:28.886203 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:28.886162    2570 patch_prober.go:28] interesting pod/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 15 11:39:28.886436 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:28.886229    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 15 11:39:29.070644 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:29.070521    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:39:29.404067 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:29.403955    2570 patch_prober.go:28] interesting pod/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:39:29.404067 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:29.404021    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 11:39:29.815528 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:29.815480    2570 patch_prober.go:28] interesting pod/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 15 11:39:29.815780 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:29.815546    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 15 11:39:29.886780 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:29.886730    2570 patch_prober.go:28] interesting pod/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 15 11:39:29.886996 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:29.886805    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 15 11:39:30.403473 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:30.403437    2570 patch_prober.go:28] interesting pod/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:39:30.403764 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:30.403734    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 11:39:30.814788 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:30.814747    2570 patch_prober.go:28] interesting pod/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 15 11:39:30.815183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:30.814813    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 15 11:39:30.890729 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:30.890692    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:39:30.891873 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:30.891854    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:39:31.407551 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:31.407518    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:39:31.407827 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:31.407804    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:39:31.408624 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:31.408603    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:39:31.815286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:31.815239    2570 patch_prober.go:28] interesting pod/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 15 11:39:31.815749 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:31.815301    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 15 11:39:32.263814 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:32.263776    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:32.357368 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:32.357323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:32.448468 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:32.448418    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:32.496417 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:32.496382    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"]
Sep 15 11:39:32.499121 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:32.499087    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f77ab79-55g6l"]
Sep 15 11:39:32.547649 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:32.545208    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:32.657397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:32.657337    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"]
Sep 15 11:39:32.657789 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:32.657755    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy" containerID="cri-o://bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b" gracePeriod=30
Sep 15 11:39:32.676406 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:32.676373    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:32.785726 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:32.785686    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="152df4a2-6cd6-4eda-aac9-299919c61ac3" path="/var/lib/kubelet/pods/152df4a2-6cd6-4eda-aac9-299919c61ac3/volumes"
Sep 15 11:39:32.896418 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:32.896319    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:33.152549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.152439    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:33.257758 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.257712    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:33.364937 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.364884    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:33.465074 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.464972    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:33.688621 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.688585    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"]
Sep 15 11:39:33.689017 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.689003    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="152df4a2-6cd6-4eda-aac9-299919c61ac3" containerName="revoke-keys"
Sep 15 11:39:33.689081 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.689019    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="152df4a2-6cd6-4eda-aac9-299919c61ac3" containerName="revoke-keys"
Sep 15 11:39:33.689120 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.689113    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="152df4a2-6cd6-4eda-aac9-299919c61ac3" containerName="revoke-keys"
Sep 15 11:39:33.692361 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.692337    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.695368 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.695337    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-fc7a9035-gw-openshift-default-dockercfg-82npp\""
Sep 15 11:39:33.717686 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.717595    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"]
Sep 15 11:39:33.719081 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.719051    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:33.773735 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.773692    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-socket\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.773735 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.773733    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s68c\" (UniqueName: \"kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-kube-api-access-7s68c\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.773975 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.773777    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-credential-socket\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.773975 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.773794    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-data\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.773975 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.773903    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-envoy\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.773975 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.773932    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42915bb0-0c88-4756-b069-da384d9b68b0-istiod-ca-cert\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.773975 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.773966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42915bb0-0c88-4756-b069-da384d9b68b0-istio-podinfo\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.774162 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.774022    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-certs\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.774162 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.774049    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-istio-token\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.874813 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.874776    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-certs\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.875705 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.875681    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-istio-token\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.876296 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.876275    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-socket\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.876773 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.876754    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s68c\" (UniqueName: \"kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-kube-api-access-7s68c\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.877285 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.877265    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-credential-socket\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.878100 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.878084    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-data\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.878777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.878760    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-envoy\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.878916 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.878900    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42915bb0-0c88-4756-b069-da384d9b68b0-istiod-ca-cert\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.879037 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.879022    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42915bb0-0c88-4756-b069-da384d9b68b0-istio-podinfo\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.879536 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.876706    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-socket\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.881166 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.880290    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42915bb0-0c88-4756-b069-da384d9b68b0-istiod-ca-cert\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.881312 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.878023    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-credential-socket\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.881461 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.878613    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-data\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.881585 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.875435    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-certs\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.883833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.883809    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42915bb0-0c88-4756-b069-da384d9b68b0-istio-podinfo\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.900800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.898752    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-envoy\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.910422 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.910390    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s68c\" (UniqueName: \"kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-kube-api-access-7s68c\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:33.910987 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:33.910963    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-istio-token\") pod \"e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") " pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:34.003695 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:34.003591    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:34.218614 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:34.218577    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:34.299725 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:34.299688    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"]
Sep 15 11:39:34.303210 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:39:34.303180    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42915bb0_0c88_4756_b069_da384d9b68b0.slice/crio-b3322277beeefce399ff985c38065cb14793ff90ad4141a340ab8684e7ad351d WatchSource:0}: Error finding container b3322277beeefce399ff985c38065cb14793ff90ad4141a340ab8684e7ad351d: Status 404 returned error can't find the container with id b3322277beeefce399ff985c38065cb14793ff90ad4141a340ab8684e7ad351d
Sep 15 11:39:34.305802 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:34.305762    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:34.305907 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:34.305856    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:34.305974 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:34.305903    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:34.317196 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:34.317158    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:34.402619 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:34.402554    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" event={"ID":"42915bb0-0c88-4756-b069-da384d9b68b0","Type":"ContainerStarted","Data":"70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b"}
Sep 15 11:39:34.402789 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:34.402651    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" event={"ID":"42915bb0-0c88-4756-b069-da384d9b68b0","Type":"ContainerStarted","Data":"b3322277beeefce399ff985c38065cb14793ff90ad4141a340ab8684e7ad351d"}
Sep 15 11:39:34.430809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:34.430745    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" podStartSLOduration=1.430722515 podStartE2EDuration="1.430722515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:34.427308479 +0000 UTC m=+876.183554858" watchObservedRunningTime="2026-09-15 11:39:34.430722515 +0000 UTC m=+876.186968892"
Sep 15 11:39:34.952451 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:34.952418    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:39:35.004312 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:35.004262    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:35.009429 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:35.009402    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:35.319027 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:35.318990    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:35.410339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:35.410312    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:35.411324 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:35.411298    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:35.912426 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:35.912385    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:36.012413 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:36.012378    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:36.213171 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:36.213131    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:36.930830 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:36.930789    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:37.796896 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:37.796858    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:38.523273 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.523223    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:38.587909 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.587877    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:38.817328 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.817304    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:39:38.882743 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.882711    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:38.938361 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938334    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-credential-socket\") pod \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") "
Sep 15 11:39:38.938518 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938366    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr9hl\" (UniqueName: \"kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-kube-api-access-kr9hl\") pod \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") "
Sep 15 11:39:38.938518 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938424    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-certs\") pod \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") "
Sep 15 11:39:38.938518 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938444    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-podinfo\") pod \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") "
Sep 15 11:39:38.938518 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938465    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-socket\") pod \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") "
Sep 15 11:39:38.938518 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938501    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-token\") pod \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") "
Sep 15 11:39:38.938828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938595    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istiod-ca-cert\") pod \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") "
Sep 15 11:39:38.938828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938651    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-envoy\") pod \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") "
Sep 15 11:39:38.938828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938680    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-data\") pod \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\" (UID: \"a3475e39-2a09-491c-9bce-2cef7c3ac6f5\") "
Sep 15 11:39:38.938828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938689    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a3475e39-2a09-491c-9bce-2cef7c3ac6f5" (UID: "a3475e39-2a09-491c-9bce-2cef7c3ac6f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:39:38.938828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938757    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a3475e39-2a09-491c-9bce-2cef7c3ac6f5" (UID: "a3475e39-2a09-491c-9bce-2cef7c3ac6f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:39:38.938828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.938793    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a3475e39-2a09-491c-9bce-2cef7c3ac6f5" (UID: "a3475e39-2a09-491c-9bce-2cef7c3ac6f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:39:38.939122 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.939036    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a3475e39-2a09-491c-9bce-2cef7c3ac6f5" (UID: "a3475e39-2a09-491c-9bce-2cef7c3ac6f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:38.939122 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.939060    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "a3475e39-2a09-491c-9bce-2cef7c3ac6f5" (UID: "a3475e39-2a09-491c-9bce-2cef7c3ac6f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:39:38.939235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.939119    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:39:38.939235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.939140    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:39:38.939235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.939154    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:39:38.939235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.939169    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:39:38.941018 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.940979    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3475e39-2a09-491c-9bce-2cef7c3ac6f5" (UID: "a3475e39-2a09-491c-9bce-2cef7c3ac6f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:39:38.941018 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.941004    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a3475e39-2a09-491c-9bce-2cef7c3ac6f5" (UID: "a3475e39-2a09-491c-9bce-2cef7c3ac6f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:39:38.941170 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.941015    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a3475e39-2a09-491c-9bce-2cef7c3ac6f5" (UID: "a3475e39-2a09-491c-9bce-2cef7c3ac6f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:39:38.941170 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:38.941092    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-kube-api-access-kr9hl" (OuterVolumeSpecName: "kube-api-access-kr9hl") pod "a3475e39-2a09-491c-9bce-2cef7c3ac6f5" (UID: "a3475e39-2a09-491c-9bce-2cef7c3ac6f5"). InnerVolumeSpecName "kube-api-access-kr9hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:39:39.040640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.040607    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:39:39.040640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.040639    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:39:39.040640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.040655    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:39:39.040912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.040667    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:39:39.040912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.040680    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr9hl\" (UniqueName: \"kubernetes.io/projected/a3475e39-2a09-491c-9bce-2cef7c3ac6f5-kube-api-access-kr9hl\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:39:39.041425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.041393    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:39.144471 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.144377    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:39.434833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.434728    2570 generic.go:356] "Generic (PLEG): container finished" podID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerID="bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b" exitCode=0
Sep 15 11:39:39.434833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.434789    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"
Sep 15 11:39:39.434833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.434814    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" event={"ID":"a3475e39-2a09-491c-9bce-2cef7c3ac6f5","Type":"ContainerDied","Data":"bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b"}
Sep 15 11:39:39.435111 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.434882    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs" event={"ID":"a3475e39-2a09-491c-9bce-2cef7c3ac6f5","Type":"ContainerDied","Data":"c7d903f861f6a9cdb60acc36254137a4b0ba11b462fa9edf67fdfa2221e50288"}
Sep 15 11:39:39.435111 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.434914    2570 scope.go:117] "RemoveContainer" containerID="bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b"
Sep 15 11:39:39.444869 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.444844    2570 scope.go:117] "RemoveContainer" containerID="ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e"
Sep 15 11:39:39.454092 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.454072    2570 scope.go:117] "RemoveContainer" containerID="bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b"
Sep 15 11:39:39.454401 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:39:39.454378    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b\": container with ID starting with bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b not found: ID does not exist" containerID="bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b"
Sep 15 11:39:39.454496 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.454409    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b"} err="failed to get container status \"bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b\": rpc error: code = NotFound desc = could not find container \"bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b\": container with ID starting with bd3d1309d1a905837a79d10d8ce42ec894802bcd722f369ab9c8820ec61b693b not found: ID does not exist"
Sep 15 11:39:39.454496 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.454428    2570 scope.go:117] "RemoveContainer" containerID="ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e"
Sep 15 11:39:39.454892 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:39:39.454866    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e\": container with ID starting with ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e not found: ID does not exist" containerID="ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e"
Sep 15 11:39:39.455017 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.454904    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e"} err="failed to get container status \"ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e\": rpc error: code = NotFound desc = could not find container \"ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e\": container with ID starting with ec49c25ef9962b7d74a292bf2af54d26bfbe921b30e06f5918792aa73be6e74e not found: ID does not exist"
Sep 15 11:39:39.458650 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.458625    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"]
Sep 15 11:39:39.467054 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.467025    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs"]
Sep 15 11:39:39.502412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:39.502375    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:40.424708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:40.424666    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:40.781380 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:40.781346    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" path="/var/lib/kubelet/pods/a3475e39-2a09-491c-9bce-2cef7c3ac6f5/volumes"
Sep 15 11:39:41.212189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:41.212089    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:43.832689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:43.832650    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:39:52.551063 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.551025    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"]
Sep 15 11:39:52.551523 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.551438    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy"
Sep 15 11:39:52.551523 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.551450    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy"
Sep 15 11:39:52.551523 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.551461    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy"
Sep 15 11:39:52.551523 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.551467    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy"
Sep 15 11:39:52.551682 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.551573    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy"
Sep 15 11:39:52.551682 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.551586    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3475e39-2a09-491c-9bce-2cef7c3ac6f5" containerName="istio-proxy"
Sep 15 11:39:52.555918 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.555900    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.558568 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.558533    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0eb0ef\"/\"openshift-service-ca.crt\""
Sep 15 11:39:52.559530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.559514    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0eb0ef\"/\"default-dockercfg-ktknm\""
Sep 15 11:39:52.559670 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.559546    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0eb0ef\"/\"kube-root-ca.crt\""
Sep 15 11:39:52.559670 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.559520    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0eb0ef\"/\"test-model-0eb0ef-kserve-self-signed-certs\""
Sep 15 11:39:52.566293 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.566269    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"]
Sep 15 11:39:52.589224 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.589197    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb54z\" (UniqueName: \"kubernetes.io/projected/653caadc-51cd-47c2-aef8-a09d13e241ac-kube-api-access-tb54z\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.589380 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.589236    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-model-cache\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.589380 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.589258    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-dshm\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.589380 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.589366    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653caadc-51cd-47c2-aef8-a09d13e241ac-tls-certs\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.589555 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.589467    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-tmp-dir\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.589555 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.589517    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-home\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.681256 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.681216    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:52.690287 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.690265    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-tmp-dir\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.690378 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.690301    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-home\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.690378 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.690360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb54z\" (UniqueName: \"kubernetes.io/projected/653caadc-51cd-47c2-aef8-a09d13e241ac-kube-api-access-tb54z\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.690474 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.690383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-model-cache\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.690474 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.690407    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-dshm\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.690474 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.690458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653caadc-51cd-47c2-aef8-a09d13e241ac-tls-certs\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.690694 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.690672    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-tmp-dir\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.690841 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.690741    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-home\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.690907 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.690854    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-model-cache\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.692649 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.692623    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-dshm\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.692921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.692903    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653caadc-51cd-47c2-aef8-a09d13e241ac-tls-certs\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.698666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.698645    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb54z\" (UniqueName: \"kubernetes.io/projected/653caadc-51cd-47c2-aef8-a09d13e241ac-kube-api-access-tb54z\") pod \"test-model-0eb0ef-kserve-6d4c794f9c-2pgmw\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") " pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:52.869754 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:52.869665    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:39:53.148525 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:53.148498    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"]
Sep 15 11:39:53.150382 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:39:53.150357    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod653caadc_51cd_47c2_aef8_a09d13e241ac.slice/crio-80e26e304e0ec9b9a818b6aaa324f4c2376d658e7fffedc470945dbb5f840f36 WatchSource:0}: Error finding container 80e26e304e0ec9b9a818b6aaa324f4c2376d658e7fffedc470945dbb5f840f36: Status 404 returned error can't find the container with id 80e26e304e0ec9b9a818b6aaa324f4c2376d658e7fffedc470945dbb5f840f36
Sep 15 11:39:53.522020 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:53.521985    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw" event={"ID":"653caadc-51cd-47c2-aef8-a09d13e241ac","Type":"ContainerStarted","Data":"48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587"}
Sep 15 11:39:53.522197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:53.522029    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw" event={"ID":"653caadc-51cd-47c2-aef8-a09d13e241ac","Type":"ContainerStarted","Data":"80e26e304e0ec9b9a818b6aaa324f4c2376d658e7fffedc470945dbb5f840f36"}
Sep 15 11:39:53.540533 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:53.540474    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw" podStartSLOduration=1.5404564729999999 podStartE2EDuration="1.540456473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:53.538373777 +0000 UTC m=+895.294620159" watchObservedRunningTime="2026-09-15 11:39:53.540456473 +0000 UTC m=+895.296702852"
Sep 15 11:39:54.530969 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:54.530933    2570 generic.go:356] "Generic (PLEG): container finished" podID="42915bb0-0c88-4756-b069-da384d9b68b0" containerID="70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b" exitCode=0
Sep 15 11:39:54.531413 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:54.531009    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" event={"ID":"42915bb0-0c88-4756-b069-da384d9b68b0","Type":"ContainerDied","Data":"70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b"}
Sep 15 11:39:54.531645 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:54.531630    2570 scope.go:117] "RemoveContainer" containerID="70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b"
Sep 15 11:39:54.532731 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:54.532703    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:54.532811 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:54.532771    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:54.532811 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:54.532804    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:39:55.540468 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:55.540432    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" event={"ID":"42915bb0-0c88-4756-b069-da384d9b68b0","Type":"ContainerStarted","Data":"69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b"}
Sep 15 11:39:56.004361 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:56.004263    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:39:56.004584 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:56.004488    2570 patch_prober.go:28] interesting pod/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 11:39:56.004652 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:56.004552    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 11:39:57.003983 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:57.003942    2570 patch_prober.go:28] interesting pod/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 11:39:57.004512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:57.003999    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 11:39:58.004352 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:58.004310    2570 patch_prober.go:28] interesting pod/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 11:39:58.004790 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:58.004367    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 11:39:59.004385 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:59.004351    2570 patch_prober.go:28] interesting pod/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 11:39:59.004813 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:39:59.004402    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 11:40:00.004531 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:00.004497    2570 patch_prober.go:28] interesting pod/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 11:40:00.004947 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:00.004552    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 11:40:00.501800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:00.501765    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:00.819162 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:00.819129    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"]
Sep 15 11:40:00.824230 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:00.824198    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"
Sep 15 11:40:00.827183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:00.827159    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:40:00.829697 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:00.829450    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2w6g9\""
Sep 15 11:40:00.835933 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:00.835907    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"]
Sep 15 11:40:00.998955 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:00.998917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdec194-de49-4461-92f6-1d3022eec443-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5\" (UID: \"9cdec194-de49-4461-92f6-1d3022eec443\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"
Sep 15 11:40:01.004926 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:01.004897    2570 patch_prober.go:28] interesting pod/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 11:40:01.005300 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:01.004948    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 11:40:01.100144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:01.100055    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdec194-de49-4461-92f6-1d3022eec443-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5\" (UID: \"9cdec194-de49-4461-92f6-1d3022eec443\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"
Sep 15 11:40:01.100749 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:01.100731    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdec194-de49-4461-92f6-1d3022eec443-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5\" (UID: \"9cdec194-de49-4461-92f6-1d3022eec443\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"
Sep 15 11:40:01.148407 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:01.148373    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"
Sep 15 11:40:01.319636 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:01.319582    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:01.431554 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:01.431460    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"]
Sep 15 11:40:01.438997 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:40:01.438964    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cdec194_de49_4461_92f6_1d3022eec443.slice/crio-548d8ecba26a1428833b437e1e46e5488eabbb98842b0412ead1cd5a1c7d6524 WatchSource:0}: Error finding container 548d8ecba26a1428833b437e1e46e5488eabbb98842b0412ead1cd5a1c7d6524: Status 404 returned error can't find the container with id 548d8ecba26a1428833b437e1e46e5488eabbb98842b0412ead1cd5a1c7d6524
Sep 15 11:40:01.593077 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:01.593038    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5" event={"ID":"9cdec194-de49-4461-92f6-1d3022eec443","Type":"ContainerStarted","Data":"548d8ecba26a1428833b437e1e46e5488eabbb98842b0412ead1cd5a1c7d6524"}
Sep 15 11:40:02.008714 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:02.008686    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:40:02.009159 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:02.009001    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:40:02.009730 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:02.009709    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:40:02.172263 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:02.172228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:02.600602 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:02.600547    2570 generic.go:356] "Generic (PLEG): container finished" podID="9cdec194-de49-4461-92f6-1d3022eec443" containerID="1c644244d478ffb475988d64a3834a11a798feff95a73885ef0eaa451e978c85" exitCode=0
Sep 15 11:40:02.600780 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:02.600635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5" event={"ID":"9cdec194-de49-4461-92f6-1d3022eec443","Type":"ContainerDied","Data":"1c644244d478ffb475988d64a3834a11a798feff95a73885ef0eaa451e978c85"}
Sep 15 11:40:02.857554 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:02.857450    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:02.870270 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:02.870245    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:40:02.870409 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:02.870298    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:40:02.882733 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:02.882711    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:40:03.319080 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:03.319042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:03.419751 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:03.419717    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:03.571401 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:03.571306    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:03.618114 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:03.618078    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:40:03.768615 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:03.768586    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"
Sep 15 11:40:03.932536 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:03.932430    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdec194-de49-4461-92f6-1d3022eec443-maas-api-service-ca\") pod \"9cdec194-de49-4461-92f6-1d3022eec443\" (UID: \"9cdec194-de49-4461-92f6-1d3022eec443\") "
Sep 15 11:40:03.932898 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:03.932874    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cdec194-de49-4461-92f6-1d3022eec443-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9cdec194-de49-4461-92f6-1d3022eec443" (UID: "9cdec194-de49-4461-92f6-1d3022eec443"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:03.932983 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:03.932952    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdec194-de49-4461-92f6-1d3022eec443-maas-api-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:04.421005 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:04.420967    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:04.614617 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:04.614587    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"
Sep 15 11:40:04.614790 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:04.614620    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5" event={"ID":"9cdec194-de49-4461-92f6-1d3022eec443","Type":"ContainerDied","Data":"548d8ecba26a1428833b437e1e46e5488eabbb98842b0412ead1cd5a1c7d6524"}
Sep 15 11:40:04.614790 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:04.614666    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="548d8ecba26a1428833b437e1e46e5488eabbb98842b0412ead1cd5a1c7d6524"
Sep 15 11:40:04.707659 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:04.707575    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:40:05.205760 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:05.205723    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:06.051361 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:06.051310    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:07.059830 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:07.059785    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:07.712967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:07.712931    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:07.805030 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:07.804992    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:07.981536 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:07.981444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:07.988198 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:07.988170    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"]
Sep 15 11:40:07.998948 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:07.998918    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc7a9035-f59d5"]
Sep 15 11:40:08.103546 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.103512    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:08.104681 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.104657    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"]
Sep 15 11:40:08.104887 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.104862    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy" containerID="cri-o://69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b" gracePeriod=30
Sep 15 11:40:08.216642 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.216553    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:08.501416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.501372    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:08.605510 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.605474    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:08.782077 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.782046    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cdec194-de49-4461-92f6-1d3022eec443" path="/var/lib/kubelet/pods/9cdec194-de49-4461-92f6-1d3022eec443/volumes"
Sep 15 11:40:08.864591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.864544    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"]
Sep 15 11:40:08.865086 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.865065    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cdec194-de49-4461-92f6-1d3022eec443" containerName="revoke-keys"
Sep 15 11:40:08.865203 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.865088    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cdec194-de49-4461-92f6-1d3022eec443" containerName="revoke-keys"
Sep 15 11:40:08.865263 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.865240    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cdec194-de49-4461-92f6-1d3022eec443" containerName="revoke-keys"
Sep 15 11:40:08.869592 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.869567    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.872117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.872094    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2b418982-openshift-default-dockercfg-bt2q2\""
Sep 15 11:40:08.881112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.881014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-envoy\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.881112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.881103    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-credential-socket\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.881304 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.881171    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-data\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.881304 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.881205    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b78kl\" (UniqueName: \"kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-kube-api-access-b78kl\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.881304 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.881259    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-socket\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.881444 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.881318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-token\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.881662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.881627    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-certs\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.881794 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.881712    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-podinfo\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.881844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.881811    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istiod-ca-cert\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.881878 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.881857    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"]
Sep 15 11:40:08.897018 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.896986    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:08.982743 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.982695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-certs\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.982942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.982775    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-podinfo\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.982942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.982833    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istiod-ca-cert\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.982942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.982875    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-envoy\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.982942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.982920    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-credential-socket\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.983136 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.982965    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-data\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.983136 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.982996    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b78kl\" (UniqueName: \"kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-kube-api-access-b78kl\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.983136 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.983029    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-socket\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.983136 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.983070    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-token\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.984010 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.983816    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-certs\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.984010 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.983869    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-credential-socket\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.984210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.984074    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-data\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.984593 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.984550    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-socket\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.985241 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.985218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istiod-ca-cert\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.998581 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.989823    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-envoy\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:08.999381 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:08.999323    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-podinfo\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:09.004402 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.003323    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-token\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:09.004402 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.003546    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b78kl\" (UniqueName: \"kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-kube-api-access-b78kl\") pod \"e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") " pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:09.182606 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.182489    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:09.196673 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.196640    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:09.454632 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.454517    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:09.480426 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:40:09.480390    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f8f68d_76e6_4dcc_90c1_56101629cf09.slice/crio-f9646d3199e9ecf2a74e6c2738c72c67d3d1bed06a7b9bd80213c17d91ccd07c WatchSource:0}: Error finding container f9646d3199e9ecf2a74e6c2738c72c67d3d1bed06a7b9bd80213c17d91ccd07c: Status 404 returned error can't find the container with id f9646d3199e9ecf2a74e6c2738c72c67d3d1bed06a7b9bd80213c17d91ccd07c
Sep 15 11:40:09.483072 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.483048    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"]
Sep 15 11:40:09.483162 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.483087    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:40:09.483162 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.483150    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:40:09.483237 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.483174    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:40:09.651254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.651218    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" event={"ID":"c8f8f68d-76e6-4dcc-90c1-56101629cf09","Type":"ContainerStarted","Data":"12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665"}
Sep 15 11:40:09.651458 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.651273    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" event={"ID":"c8f8f68d-76e6-4dcc-90c1-56101629cf09","Type":"ContainerStarted","Data":"f9646d3199e9ecf2a74e6c2738c72c67d3d1bed06a7b9bd80213c17d91ccd07c"}
Sep 15 11:40:09.677842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:09.677770    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" podStartSLOduration=1.67774577 podStartE2EDuration="1.67774577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:09.673079876 +0000 UTC m=+911.429326239" watchObservedRunningTime="2026-09-15 11:40:09.67774577 +0000 UTC m=+911.433992147"
Sep 15 11:40:10.177936 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:10.177900    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:10.182681 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:10.182659    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:10.188031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:10.188003    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:10.657976 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:10.657940    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:10.659060 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:10.659041    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:10.963524 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:10.963432    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:11.109701 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:11.109661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:11.199933 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:11.199901    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:11.847340 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:11.847306    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:12.634007 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:12.633972    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:13.374497 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.374427    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:40:13.437634 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.437592    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-data\") pod \"42915bb0-0c88-4756-b069-da384d9b68b0\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") "
Sep 15 11:40:13.437824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.437643    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-credential-socket\") pod \"42915bb0-0c88-4756-b069-da384d9b68b0\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") "
Sep 15 11:40:13.437824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.437748    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42915bb0-0c88-4756-b069-da384d9b68b0-istiod-ca-cert\") pod \"42915bb0-0c88-4756-b069-da384d9b68b0\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") "
Sep 15 11:40:13.437824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.437781    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-socket\") pod \"42915bb0-0c88-4756-b069-da384d9b68b0\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") "
Sep 15 11:40:13.437824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.437799    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-certs\") pod \"42915bb0-0c88-4756-b069-da384d9b68b0\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") "
Sep 15 11:40:13.438033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.437930    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s68c\" (UniqueName: \"kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-kube-api-access-7s68c\") pod \"42915bb0-0c88-4756-b069-da384d9b68b0\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") "
Sep 15 11:40:13.438033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.437967    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "42915bb0-0c88-4756-b069-da384d9b68b0" (UID: "42915bb0-0c88-4756-b069-da384d9b68b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:13.438033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.437997    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-envoy\") pod \"42915bb0-0c88-4756-b069-da384d9b68b0\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") "
Sep 15 11:40:13.438194 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.438035    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "42915bb0-0c88-4756-b069-da384d9b68b0" (UID: "42915bb0-0c88-4756-b069-da384d9b68b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:13.438194 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.438095    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42915bb0-0c88-4756-b069-da384d9b68b0-istio-podinfo\") pod \"42915bb0-0c88-4756-b069-da384d9b68b0\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") "
Sep 15 11:40:13.438194 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.438125    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-istio-token\") pod \"42915bb0-0c88-4756-b069-da384d9b68b0\" (UID: \"42915bb0-0c88-4756-b069-da384d9b68b0\") "
Sep 15 11:40:13.438194 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.438157    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "42915bb0-0c88-4756-b069-da384d9b68b0" (UID: "42915bb0-0c88-4756-b069-da384d9b68b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:13.438375 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.438196    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "42915bb0-0c88-4756-b069-da384d9b68b0" (UID: "42915bb0-0c88-4756-b069-da384d9b68b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:13.438375 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.438258    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42915bb0-0c88-4756-b069-da384d9b68b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "42915bb0-0c88-4756-b069-da384d9b68b0" (UID: "42915bb0-0c88-4756-b069-da384d9b68b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:13.438540 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.438521    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.438635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.438547    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.438635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.438578    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42915bb0-0c88-4756-b069-da384d9b68b0-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.438635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.438591    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.438635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.438604    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.440246 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.440211    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-kube-api-access-7s68c" (OuterVolumeSpecName: "kube-api-access-7s68c") pod "42915bb0-0c88-4756-b069-da384d9b68b0" (UID: "42915bb0-0c88-4756-b069-da384d9b68b0"). InnerVolumeSpecName "kube-api-access-7s68c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:13.440246 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.440224    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "42915bb0-0c88-4756-b069-da384d9b68b0" (UID: "42915bb0-0c88-4756-b069-da384d9b68b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:13.440397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.440266    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "42915bb0-0c88-4756-b069-da384d9b68b0" (UID: "42915bb0-0c88-4756-b069-da384d9b68b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:13.440397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.440308    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/42915bb0-0c88-4756-b069-da384d9b68b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "42915bb0-0c88-4756-b069-da384d9b68b0" (UID: "42915bb0-0c88-4756-b069-da384d9b68b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:40:13.540271 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.540211    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42915bb0-0c88-4756-b069-da384d9b68b0-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.540271 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.540263    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42915bb0-0c88-4756-b069-da384d9b68b0-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.540271 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.540272    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.540271 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.540281    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s68c\" (UniqueName: \"kubernetes.io/projected/42915bb0-0c88-4756-b069-da384d9b68b0-kube-api-access-7s68c\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.625831 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.625735    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:13.680149 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.680114    2570 generic.go:356] "Generic (PLEG): container finished" podID="42915bb0-0c88-4756-b069-da384d9b68b0" containerID="69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b" exitCode=0
Sep 15 11:40:13.680681 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.680163    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"
Sep 15 11:40:13.680681 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.680199    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" event={"ID":"42915bb0-0c88-4756-b069-da384d9b68b0","Type":"ContainerDied","Data":"69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b"}
Sep 15 11:40:13.680681 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.680264    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b" event={"ID":"42915bb0-0c88-4756-b069-da384d9b68b0","Type":"ContainerDied","Data":"b3322277beeefce399ff985c38065cb14793ff90ad4141a340ab8684e7ad351d"}
Sep 15 11:40:13.680681 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.680300    2570 scope.go:117] "RemoveContainer" containerID="69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b"
Sep 15 11:40:13.709277 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.705548    2570 scope.go:117] "RemoveContainer" containerID="70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b"
Sep 15 11:40:13.724702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.724668    2570 scope.go:117] "RemoveContainer" containerID="69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b"
Sep 15 11:40:13.725062 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:40:13.725030    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b\": container with ID starting with 69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b not found: ID does not exist" containerID="69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b"
Sep 15 11:40:13.725176 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.725069    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b"} err="failed to get container status \"69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b\": rpc error: code = NotFound desc = could not find container \"69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b\": container with ID starting with 69ff198e25d0ae6bb3d40dcee8a5ce7787d2ff069635d11a898fe1fc16276a6b not found: ID does not exist"
Sep 15 11:40:13.725176 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.725092    2570 scope.go:117] "RemoveContainer" containerID="70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b"
Sep 15 11:40:13.725426 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:40:13.725407    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b\": container with ID starting with 70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b not found: ID does not exist" containerID="70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b"
Sep 15 11:40:13.725482 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.725432    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b"} err="failed to get container status \"70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b\": rpc error: code = NotFound desc = could not find container \"70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b\": container with ID starting with 70188052777b51f25c66c3ed1df6db65352208aef4713d74ed9db032537e2b5b not found: ID does not exist"
Sep 15 11:40:13.727038 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.727012    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:13.736183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.736143    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"]
Sep 15 11:40:13.739047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.739023    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b"]
Sep 15 11:40:13.969266 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:13.969161    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:14.104117 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:14.104079    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:14.209265 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:14.209232    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:14.533824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:14.533791    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:14.782238 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:14.782209    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" path="/var/lib/kubelet/pods/42915bb0-0c88-4756-b069-da384d9b68b0/volumes"
Sep 15 11:40:15.391625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:15.391587    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:16.243765 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:16.243731    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:16.956795 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:16.956766    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:25.397139 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:25.397101    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:40:31.153579 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:31.149100    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:35.614029 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:35.613948    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:35.825670 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:35.825631    2570 generic.go:356] "Generic (PLEG): container finished" podID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerID="12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665" exitCode=0
Sep 15 11:40:35.825855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:35.825697    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" event={"ID":"c8f8f68d-76e6-4dcc-90c1-56101629cf09","Type":"ContainerDied","Data":"12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665"}
Sep 15 11:40:35.826142 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:35.826119    2570 scope.go:117] "RemoveContainer" containerID="12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665"
Sep 15 11:40:35.827388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:35.827356    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:40:35.827499 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:35.827434    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:40:35.827499 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:35.827469    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:40:36.474207 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.474168    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:36.711581 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.708706    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"]
Sep 15 11:40:36.711581 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.709785    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy"
Sep 15 11:40:36.711581 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.709809    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy"
Sep 15 11:40:36.711581 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.710055    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy"
Sep 15 11:40:36.711581 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.710079    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy"
Sep 15 11:40:36.715181 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.714988    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"
Sep 15 11:40:36.717740 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.717716    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2w6g9\""
Sep 15 11:40:36.717871 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.717720    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:40:36.723189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.723164    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"]
Sep 15 11:40:36.803393 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.803361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c47923e-f5ad-4510-9868-3fbd5016a315-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2b418982-nqj9d\" (UID: \"9c47923e-f5ad-4510-9868-3fbd5016a315\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"
Sep 15 11:40:36.833933 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.833902    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" event={"ID":"c8f8f68d-76e6-4dcc-90c1-56101629cf09","Type":"ContainerStarted","Data":"9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70"}
Sep 15 11:40:36.905144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.905100    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c47923e-f5ad-4510-9868-3fbd5016a315-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2b418982-nqj9d\" (UID: \"9c47923e-f5ad-4510-9868-3fbd5016a315\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"
Sep 15 11:40:36.905754 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:36.905728    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c47923e-f5ad-4510-9868-3fbd5016a315-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2b418982-nqj9d\" (UID: \"9c47923e-f5ad-4510-9868-3fbd5016a315\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"
Sep 15 11:40:37.029917 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:37.029875    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"
Sep 15 11:40:37.182979 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:37.182954    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:37.183981 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:37.183956    2570 patch_prober.go:28] interesting pod/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 11:40:37.184038 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:37.184006    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 11:40:37.326579 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:37.323745    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"]
Sep 15 11:40:37.326579 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:40:37.326193    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c47923e_f5ad_4510_9868_3fbd5016a315.slice/crio-b50682144a9847ccba0c7da9f5dcab02c1d1151846598e81c65a8693ab275ee9 WatchSource:0}: Error finding container b50682144a9847ccba0c7da9f5dcab02c1d1151846598e81c65a8693ab275ee9: Status 404 returned error can't find the container with id b50682144a9847ccba0c7da9f5dcab02c1d1151846598e81c65a8693ab275ee9
Sep 15 11:40:37.381135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:37.381100    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:37.847367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:37.847324    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d" event={"ID":"9c47923e-f5ad-4510-9868-3fbd5016a315","Type":"ContainerStarted","Data":"8739a072a64b2e2bb1128837577fbe7f3fecbf2f6490c1c08095146f382a1149"}
Sep 15 11:40:37.847885 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:37.847388    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d" event={"ID":"9c47923e-f5ad-4510-9868-3fbd5016a315","Type":"ContainerStarted","Data":"b50682144a9847ccba0c7da9f5dcab02c1d1151846598e81c65a8693ab275ee9"}
Sep 15 11:40:37.863509 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:37.863458    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d" podStartSLOduration=1.863440922 podStartE2EDuration="1.863440922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:37.862495042 +0000 UTC m=+939.618741421" watchObservedRunningTime="2026-09-15 11:40:37.863440922 +0000 UTC m=+939.619687334"
Sep 15 11:40:38.180443 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:38.180408    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:38.183430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:38.183345    2570 patch_prober.go:28] interesting pod/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 11:40:38.183430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:38.183409    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 11:40:38.854381 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:38.854349    2570 generic.go:356] "Generic (PLEG): container finished" podID="9c47923e-f5ad-4510-9868-3fbd5016a315" containerID="8739a072a64b2e2bb1128837577fbe7f3fecbf2f6490c1c08095146f382a1149" exitCode=0
Sep 15 11:40:38.854799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:38.854435    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d" event={"ID":"9c47923e-f5ad-4510-9868-3fbd5016a315","Type":"ContainerDied","Data":"8739a072a64b2e2bb1128837577fbe7f3fecbf2f6490c1c08095146f382a1149"}
Sep 15 11:40:39.002698 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:39.002655    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:39.183575 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:39.183461    2570 patch_prober.go:28] interesting pod/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 11:40:39.183575 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:39.183520    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 11:40:39.699660 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:39.699619    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:40.013395 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:40.013372    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"
Sep 15 11:40:40.053838 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:40.045403    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c47923e-f5ad-4510-9868-3fbd5016a315-maas-api-service-ca\") pod \"9c47923e-f5ad-4510-9868-3fbd5016a315\" (UID: \"9c47923e-f5ad-4510-9868-3fbd5016a315\") "
Sep 15 11:40:40.053838 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:40.053792    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c47923e-f5ad-4510-9868-3fbd5016a315-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9c47923e-f5ad-4510-9868-3fbd5016a315" (UID: "9c47923e-f5ad-4510-9868-3fbd5016a315"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:40.148375 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:40.148338    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c47923e-f5ad-4510-9868-3fbd5016a315-maas-api-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:40.182967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:40.182934    2570 patch_prober.go:28] interesting pod/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 11:40:40.183143 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:40.182991    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 11:40:40.478367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:40.478331    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:40.658579 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:40.658528    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:40.868515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:40.868485    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"
Sep 15 11:40:40.868696 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:40.868525    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d" event={"ID":"9c47923e-f5ad-4510-9868-3fbd5016a315","Type":"ContainerDied","Data":"b50682144a9847ccba0c7da9f5dcab02c1d1151846598e81c65a8693ab275ee9"}
Sep 15 11:40:40.868696 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:40.868592    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b50682144a9847ccba0c7da9f5dcab02c1d1151846598e81c65a8693ab275ee9"
Sep 15 11:40:41.120221 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:41.120124    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:41.184035 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:41.184001    2570 patch_prober.go:28] interesting pod/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 11:40:41.184381 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:41.184341    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 11:40:41.893092 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:41.893062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:42.183713 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:42.183619    2570 patch_prober.go:28] interesting pod/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 11:40:42.183713 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:42.183691    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 11:40:42.445431 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:42.445338    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:42.542341 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:42.542303    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:42.622990 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:42.622953    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"]
Sep 15 11:40:42.624400 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:42.624363    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:42.626197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:42.626172    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b418982-nqj9d"]
Sep 15 11:40:42.688365 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:42.688330    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:42.781504 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:42.781464    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c47923e-f5ad-4510-9868-3fbd5016a315" path="/var/lib/kubelet/pods/9c47923e-f5ad-4510-9868-3fbd5016a315/volumes"
Sep 15 11:40:43.187537 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:43.187458    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:43.188316 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:43.188299    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:43.545629 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:43.545592    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:43.729265 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:43.729226    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"]
Sep 15 11:40:43.748321 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:43.748291    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:43.888962 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:43.888880    2570 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" secret="" err="secret \"e2e-ait-2b418982-openshift-default-dockercfg-bt2q2\" not found"
Sep 15 11:40:44.162007 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.161909    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:44.394552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.394512    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:44.428599 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.428483    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"]
Sep 15 11:40:44.429030 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.429012    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy"
Sep 15 11:40:44.429145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.429033    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="42915bb0-0c88-4756-b069-da384d9b68b0" containerName="istio-proxy"
Sep 15 11:40:44.429145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.429055    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c47923e-f5ad-4510-9868-3fbd5016a315" containerName="revoke-keys"
Sep 15 11:40:44.429145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.429065    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c47923e-f5ad-4510-9868-3fbd5016a315" containerName="revoke-keys"
Sep 15 11:40:44.429302 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.429215    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c47923e-f5ad-4510-9868-3fbd5016a315" containerName="revoke-keys"
Sep 15 11:40:44.432537 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.432516    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.435232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.435212    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ed7d9f67-openshift-default-dockercfg-d2vc6\""
Sep 15 11:40:44.451198 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.451174    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"]
Sep 15 11:40:44.474396 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.474363    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:44.494244 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.494213    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btxwx\" (UniqueName: \"kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-kube-api-access-btxwx\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.494354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.494264    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-certs\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.494354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.494332    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-credential-socket\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.494442 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.494379    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-socket\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.494442 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.494437    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-envoy\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.494516 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.494462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-data\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.494516 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.494482    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/381063de-e59a-41da-ba05-de2d17bc7896-istiod-ca-cert\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.494606 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.494519    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-istio-token\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.494606 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.494540    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/381063de-e59a-41da-ba05-de2d17bc7896-istio-podinfo\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.595842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.595802    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-istio-token\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.595842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.595844    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/381063de-e59a-41da-ba05-de2d17bc7896-istio-podinfo\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.595882    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btxwx\" (UniqueName: \"kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-kube-api-access-btxwx\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.595927    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-certs\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596148 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.596092    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-credential-socket\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596209 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.596192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-socket\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596275 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.596262    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-envoy\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596323 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.596301    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-data\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596323 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.596319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/381063de-e59a-41da-ba05-de2d17bc7896-istiod-ca-cert\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.596362    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-certs\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.596385    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-credential-socket\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596647 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.596625    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-socket\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596744 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.596646    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-data\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.596953 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.596938    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/381063de-e59a-41da-ba05-de2d17bc7896-istiod-ca-cert\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.598452 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.598415    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-envoy\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.598808 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.598791    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/381063de-e59a-41da-ba05-de2d17bc7896-istio-podinfo\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.605849 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.605824    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-istio-token\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.606234 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.606214    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btxwx\" (UniqueName: \"kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-kube-api-access-btxwx\") pod \"e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") " pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.749843 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.749757    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:44.853107 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.853071    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:44.894419 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:44.894381    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy" containerID="cri-o://9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70" gracePeriod=30
Sep 15 11:40:45.032300 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:45.032273    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"]
Sep 15 11:40:45.033877 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:40:45.033850    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381063de_e59a_41da_ba05_de2d17bc7896.slice/crio-d7587989dfc51491c8a8acefcbb07737280cf24090a1af5b6113e6994eb0faa2 WatchSource:0}: Error finding container d7587989dfc51491c8a8acefcbb07737280cf24090a1af5b6113e6994eb0faa2: Status 404 returned error can't find the container with id d7587989dfc51491c8a8acefcbb07737280cf24090a1af5b6113e6994eb0faa2
Sep 15 11:40:45.036582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:45.036535    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:40:45.036673 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:45.036614    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:40:45.036673 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:45.036644    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:40:45.223702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:45.223617    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:45.901996 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:45.901964    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" event={"ID":"381063de-e59a-41da-ba05-de2d17bc7896","Type":"ContainerStarted","Data":"b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178"}
Sep 15 11:40:45.902414 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:45.902018    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" event={"ID":"381063de-e59a-41da-ba05-de2d17bc7896","Type":"ContainerStarted","Data":"d7587989dfc51491c8a8acefcbb07737280cf24090a1af5b6113e6994eb0faa2"}
Sep 15 11:40:45.928808 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:45.928755    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" podStartSLOduration=1.9287378880000001 podStartE2EDuration="1.928737888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:45.924918895 +0000 UTC m=+947.681165273" watchObservedRunningTime="2026-09-15 11:40:45.928737888 +0000 UTC m=+947.684984333"
Sep 15 11:40:45.941211 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:45.941172    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:46.750273 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:46.750240    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:46.755835 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:46.755807    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:46.770034 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:46.770002    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:46.908610 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:46.908574    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:46.909571 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:46.909541    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:40:47.296525 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:47.296491    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:47.450320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:47.450287    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:47.870223 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:47.870188    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:48.609277 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:48.609242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:49.337193 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:49.337150    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:50.012142 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.012114    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:50.152076 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.152052    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:50.254967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.254875    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-certs\") pod \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") "
Sep 15 11:40:50.254967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.254929    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-socket\") pod \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") "
Sep 15 11:40:50.254967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.254968    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-podinfo\") pod \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") "
Sep 15 11:40:50.255210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255024    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-envoy\") pod \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") "
Sep 15 11:40:50.255210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255076    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-credential-socket\") pod \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") "
Sep 15 11:40:50.255210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255106    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-data\") pod \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") "
Sep 15 11:40:50.255210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255162    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-token\") pod \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") "
Sep 15 11:40:50.255210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255192    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istiod-ca-cert\") pod \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") "
Sep 15 11:40:50.255465 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255229    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b78kl\" (UniqueName: \"kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-kube-api-access-b78kl\") pod \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\" (UID: \"c8f8f68d-76e6-4dcc-90c1-56101629cf09\") "
Sep 15 11:40:50.255465 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255223    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8f8f68d-76e6-4dcc-90c1-56101629cf09" (UID: "c8f8f68d-76e6-4dcc-90c1-56101629cf09"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:50.255465 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255322    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8f8f68d-76e6-4dcc-90c1-56101629cf09" (UID: "c8f8f68d-76e6-4dcc-90c1-56101629cf09"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:50.255654 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255497    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8f8f68d-76e6-4dcc-90c1-56101629cf09" (UID: "c8f8f68d-76e6-4dcc-90c1-56101629cf09"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:50.255725 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255688    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.255725 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255708    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.255820 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255722    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.255820 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255751    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8f8f68d-76e6-4dcc-90c1-56101629cf09" (UID: "c8f8f68d-76e6-4dcc-90c1-56101629cf09"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:50.255820 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.255763    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8f8f68d-76e6-4dcc-90c1-56101629cf09" (UID: "c8f8f68d-76e6-4dcc-90c1-56101629cf09"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:50.257945 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.257917    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8f8f68d-76e6-4dcc-90c1-56101629cf09" (UID: "c8f8f68d-76e6-4dcc-90c1-56101629cf09"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:40:50.258073 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.257994    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8f8f68d-76e6-4dcc-90c1-56101629cf09" (UID: "c8f8f68d-76e6-4dcc-90c1-56101629cf09"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:50.258073 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.258036    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-kube-api-access-b78kl" (OuterVolumeSpecName: "kube-api-access-b78kl") pod "c8f8f68d-76e6-4dcc-90c1-56101629cf09" (UID: "c8f8f68d-76e6-4dcc-90c1-56101629cf09"). InnerVolumeSpecName "kube-api-access-b78kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:50.258073 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.258054    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8f8f68d-76e6-4dcc-90c1-56101629cf09" (UID: "c8f8f68d-76e6-4dcc-90c1-56101629cf09"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:50.357033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.356990    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.357033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.357025    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.357033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.357034    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b78kl\" (UniqueName: \"kubernetes.io/projected/c8f8f68d-76e6-4dcc-90c1-56101629cf09-kube-api-access-b78kl\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.357254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.357054    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.357254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.357063    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.357254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.357071    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f8f68d-76e6-4dcc-90c1-56101629cf09-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.819921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.819884    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:50.934710 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.934670    2570 generic.go:356] "Generic (PLEG): container finished" podID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerID="9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70" exitCode=0
Sep 15 11:40:50.934899 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.934717    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"
Sep 15 11:40:50.934899 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.934742    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" event={"ID":"c8f8f68d-76e6-4dcc-90c1-56101629cf09","Type":"ContainerDied","Data":"9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70"}
Sep 15 11:40:50.934899 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.934793    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs" event={"ID":"c8f8f68d-76e6-4dcc-90c1-56101629cf09","Type":"ContainerDied","Data":"f9646d3199e9ecf2a74e6c2738c72c67d3d1bed06a7b9bd80213c17d91ccd07c"}
Sep 15 11:40:50.934899 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.934822    2570 scope.go:117] "RemoveContainer" containerID="9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70"
Sep 15 11:40:50.945430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.945405    2570 scope.go:117] "RemoveContainer" containerID="12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665"
Sep 15 11:40:50.955428 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.955404    2570 scope.go:117] "RemoveContainer" containerID="9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70"
Sep 15 11:40:50.955802 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:40:50.955780    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70\": container with ID starting with 9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70 not found: ID does not exist" containerID="9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70"
Sep 15 11:40:50.955874 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.955811    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70"} err="failed to get container status \"9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70\": rpc error: code = NotFound desc = could not find container \"9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70\": container with ID starting with 9abf5d02e4ee75d71dfdaac7a465ae425e06c556f0f6f1820e8eac8cb8cb2d70 not found: ID does not exist"
Sep 15 11:40:50.955874 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.955831    2570 scope.go:117] "RemoveContainer" containerID="12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665"
Sep 15 11:40:50.955874 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.955791    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"]
Sep 15 11:40:50.956122 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:40:50.956108    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665\": container with ID starting with 12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665 not found: ID does not exist" containerID="12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665"
Sep 15 11:40:50.956165 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.956125    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665"} err="failed to get container status \"12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665\": rpc error: code = NotFound desc = could not find container \"12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665\": container with ID starting with 12b3598ae296a13df93df91f28d47ca39bf6ca8124db13ed98adf95934fcc665 not found: ID does not exist"
Sep 15 11:40:50.971657 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:50.971627    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs"]
Sep 15 11:40:51.570329 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:51.570292    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:51.668542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:51.668510    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:51.768466 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:51.768430    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:52.059708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:52.059668    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:52.147997 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:52.147956    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:52.589628 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:52.589588    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:40:52.781682 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:40:52.781643    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" path="/var/lib/kubelet/pods/c8f8f68d-76e6-4dcc-90c1-56101629cf09/volumes"
Sep 15 11:41:01.866861 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:01.866820    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:02.914572 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:02.914530    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"]
Sep 15 11:41:02.914989 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:02.914974    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy"
Sep 15 11:41:02.915034 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:02.914991    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy"
Sep 15 11:41:02.915034 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:02.915011    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy"
Sep 15 11:41:02.915034 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:02.915016    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy"
Sep 15 11:41:02.915136 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:02.915085    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy"
Sep 15 11:41:02.915136 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:02.915092    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f8f68d-76e6-4dcc-90c1-56101629cf09" containerName="istio-proxy"
Sep 15 11:41:02.919682 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:02.919662    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"
Sep 15 11:41:02.922356 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:02.922326    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:41:02.923948 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:02.923255    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2w6g9\""
Sep 15 11:41:02.927026 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:02.926999    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"]
Sep 15 11:41:03.093119 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:03.093079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf06793-95d1-48a4-a2fc-665d3182347a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-e114ba-mxkg8\" (UID: \"cdf06793-95d1-48a4-a2fc-665d3182347a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"
Sep 15 11:41:03.194254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:03.194155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf06793-95d1-48a4-a2fc-665d3182347a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-e114ba-mxkg8\" (UID: \"cdf06793-95d1-48a4-a2fc-665d3182347a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"
Sep 15 11:41:03.194864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:03.194845    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf06793-95d1-48a4-a2fc-665d3182347a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-e114ba-mxkg8\" (UID: \"cdf06793-95d1-48a4-a2fc-665d3182347a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"
Sep 15 11:41:03.203833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:03.203801    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:03.238606 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:03.238549    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"
Sep 15 11:41:03.536080 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:03.528577    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"]
Sep 15 11:41:04.004926 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:04.004887    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:04.022932 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:04.022826    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8" event={"ID":"cdf06793-95d1-48a4-a2fc-665d3182347a","Type":"ContainerStarted","Data":"2ac96b5571606754a3bdaa56e445baa23e216c1566c92fe77918863948a09f31"}
Sep 15 11:41:04.022932 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:04.022891    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8" event={"ID":"cdf06793-95d1-48a4-a2fc-665d3182347a","Type":"ContainerStarted","Data":"1b89a7083bc43fe4d87285be7bdf4157fd3c3bffe7c698c2e613efa29e9d6bc6"}
Sep 15 11:41:04.043403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:04.043319    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8" podStartSLOduration=2.043295532 podStartE2EDuration="2.043295532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:04.039118629 +0000 UTC m=+965.795365008" watchObservedRunningTime="2026-09-15 11:41:04.043295532 +0000 UTC m=+965.799541912"
Sep 15 11:41:04.595237 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:04.595200    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:04.874953 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:04.874916    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:05.042260 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:05.042215    2570 generic.go:356] "Generic (PLEG): container finished" podID="cdf06793-95d1-48a4-a2fc-665d3182347a" containerID="2ac96b5571606754a3bdaa56e445baa23e216c1566c92fe77918863948a09f31" exitCode=0
Sep 15 11:41:05.042854 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:05.042818    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8" event={"ID":"cdf06793-95d1-48a4-a2fc-665d3182347a","Type":"ContainerDied","Data":"2ac96b5571606754a3bdaa56e445baa23e216c1566c92fe77918863948a09f31"}
Sep 15 11:41:05.814042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:05.814009    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:06.210247 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:06.210220    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"
Sep 15 11:41:06.351220 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:06.351186    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf06793-95d1-48a4-a2fc-665d3182347a-maas-api-service-ca\") pod \"cdf06793-95d1-48a4-a2fc-665d3182347a\" (UID: \"cdf06793-95d1-48a4-a2fc-665d3182347a\") "
Sep 15 11:41:06.351670 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:06.351644    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf06793-95d1-48a4-a2fc-665d3182347a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cdf06793-95d1-48a4-a2fc-665d3182347a" (UID: "cdf06793-95d1-48a4-a2fc-665d3182347a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:06.453003 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:06.452913    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf06793-95d1-48a4-a2fc-665d3182347a-maas-api-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:06.513973 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:06.513937    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:07.059233 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:07.059157    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"
Sep 15 11:41:07.059233 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:07.059177    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8" event={"ID":"cdf06793-95d1-48a4-a2fc-665d3182347a","Type":"ContainerDied","Data":"1b89a7083bc43fe4d87285be7bdf4157fd3c3bffe7c698c2e613efa29e9d6bc6"}
Sep 15 11:41:07.059403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:07.059249    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b89a7083bc43fe4d87285be7bdf4157fd3c3bffe7c698c2e613efa29e9d6bc6"
Sep 15 11:41:07.173736 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:07.173695    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:07.968058 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:07.968024    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:08.841572 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:08.841528    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:09.702579 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:09.702525    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:10.520799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:10.520767    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:10.607700 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:10.607663    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:41:11.085499 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:11.085467    2570 generic.go:356] "Generic (PLEG): container finished" podID="381063de-e59a-41da-ba05-de2d17bc7896" containerID="b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178" exitCode=0
Sep 15 11:41:11.085914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:11.085542    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" event={"ID":"381063de-e59a-41da-ba05-de2d17bc7896","Type":"ContainerDied","Data":"b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178"}
Sep 15 11:41:11.086012 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:11.085996    2570 scope.go:117] "RemoveContainer" containerID="b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178"
Sep 15 11:41:11.087261 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:11.087229    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:41:11.087343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:11.087301    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:41:11.087343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:11.087336    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:41:11.318707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:11.318662    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:12.094096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.094059    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" event={"ID":"381063de-e59a-41da-ba05-de2d17bc7896","Type":"ContainerStarted","Data":"9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1"}
Sep 15 11:41:12.129640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.129600    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"]
Sep 15 11:41:12.130393 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.130363    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdf06793-95d1-48a4-a2fc-665d3182347a" containerName="revoke-keys"
Sep 15 11:41:12.130393 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.130392    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdf06793-95d1-48a4-a2fc-665d3182347a" containerName="revoke-keys"
Sep 15 11:41:12.130634 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.130513    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdf06793-95d1-48a4-a2fc-665d3182347a" containerName="revoke-keys"
Sep 15 11:41:12.134404 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.134380    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"
Sep 15 11:41:12.144053 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.144017    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2w6g9\""
Sep 15 11:41:12.144349 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.144301    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:41:12.160756 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.159934    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"]
Sep 15 11:41:12.215187 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.215150    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06770864-8181-4dbc-829b-ce9aae834197-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz\" (UID: \"06770864-8181-4dbc-829b-ce9aae834197\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"
Sep 15 11:41:12.303071 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.303036    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:12.316270 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.316238    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06770864-8181-4dbc-829b-ce9aae834197-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz\" (UID: \"06770864-8181-4dbc-829b-ce9aae834197\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"
Sep 15 11:41:12.316876 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.316859    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06770864-8181-4dbc-829b-ce9aae834197-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz\" (UID: \"06770864-8181-4dbc-829b-ce9aae834197\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"
Sep 15 11:41:12.450846 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.450753    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"
Sep 15 11:41:12.730316 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.730218    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"]
Sep 15 11:41:12.752624 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:41:12.750683    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06770864_8181_4dbc_829b_ce9aae834197.slice/crio-4b53c94320d0c20452c85dfe83e6575350c2fa63eb28c582c4548145d6f00c84 WatchSource:0}: Error finding container 4b53c94320d0c20452c85dfe83e6575350c2fa63eb28c582c4548145d6f00c84: Status 404 returned error can't find the container with id 4b53c94320d0c20452c85dfe83e6575350c2fa63eb28c582c4548145d6f00c84
Sep 15 11:41:12.752624 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.750890    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:41:12.752624 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.752139    2570 patch_prober.go:28] interesting pod/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 15 11:41:12.752624 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:12.752192    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 15 11:41:13.100550 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:13.100508    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:13.104549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:13.104524    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz" event={"ID":"06770864-8181-4dbc-829b-ce9aae834197","Type":"ContainerStarted","Data":"4b53c94320d0c20452c85dfe83e6575350c2fa63eb28c582c4548145d6f00c84"}
Sep 15 11:41:13.750627 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:13.750589    2570 patch_prober.go:28] interesting pod/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 15 11:41:13.750771 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:13.750656    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 15 11:41:13.828484 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:13.828443    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:14.112672 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:14.112638    2570 generic.go:356] "Generic (PLEG): container finished" podID="06770864-8181-4dbc-829b-ce9aae834197" containerID="6aa9358ed1baf2f30f8d397cba876a13070240f1880d2ac115b7e18afdc35638" exitCode=0
Sep 15 11:41:14.113075 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:14.112703    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz" event={"ID":"06770864-8181-4dbc-829b-ce9aae834197","Type":"ContainerDied","Data":"6aa9358ed1baf2f30f8d397cba876a13070240f1880d2ac115b7e18afdc35638"}
Sep 15 11:41:14.598507 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:14.598466    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:14.750965 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:14.750915    2570 patch_prober.go:28] interesting pod/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 15 11:41:14.751182 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:14.750986    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 15 11:41:15.296268 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:15.296237    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"
Sep 15 11:41:15.355670 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:15.355620    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06770864-8181-4dbc-829b-ce9aae834197-maas-api-service-ca\") pod \"06770864-8181-4dbc-829b-ce9aae834197\" (UID: \"06770864-8181-4dbc-829b-ce9aae834197\") "
Sep 15 11:41:15.356183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:15.356160    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06770864-8181-4dbc-829b-ce9aae834197-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "06770864-8181-4dbc-829b-ce9aae834197" (UID: "06770864-8181-4dbc-829b-ce9aae834197"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:15.456535 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:15.456438    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06770864-8181-4dbc-829b-ce9aae834197-maas-api-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:15.745849 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:15.745750    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:15.750911 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:15.750470    2570 patch_prober.go:28] interesting pod/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 15 11:41:15.750911 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:15.750530    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 15 11:41:16.127823 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:16.127782    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz" event={"ID":"06770864-8181-4dbc-829b-ce9aae834197","Type":"ContainerDied","Data":"4b53c94320d0c20452c85dfe83e6575350c2fa63eb28c582c4548145d6f00c84"}
Sep 15 11:41:16.128031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:16.127848    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b53c94320d0c20452c85dfe83e6575350c2fa63eb28c582c4548145d6f00c84"
Sep 15 11:41:16.128031 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:16.127918    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"
Sep 15 11:41:16.520586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:16.520537    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:16.751004 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:16.750972    2570 patch_prober.go:28] interesting pod/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 15 11:41:16.751214 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:16.751097    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 15 11:41:16.908698 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:16.908604    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:41:17.161241 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:17.161150    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:17.252434 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:17.252391    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:17.329469 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:17.329428    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:17.432033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:17.431947    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:17.488685 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:17.488654    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"]
Sep 15 11:41:17.494935 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:17.494908    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e114ba-mxkg8"]
Sep 15 11:41:17.536609 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:17.536552    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:17.628684 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:17.628647    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:17.755109 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:17.755034    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:41:17.756155 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:17.756134    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:41:17.844812 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:17.844779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:18.430678 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:18.430640    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:18.780953 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:18.780925    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdf06793-95d1-48a4-a2fc-665d3182347a" path="/var/lib/kubelet/pods/cdf06793-95d1-48a4-a2fc-665d3182347a/volumes"
Sep 15 11:41:19.301161 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:19.301128    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:19.402643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:19.402546    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:19.501416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:19.501381    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:19.608080 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:19.607984    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:19.683105 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:19.683069    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:19.736795 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:19.736750    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"]
Sep 15 11:41:19.739509 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:19.739480    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed7d9f67-fqxtz"]
Sep 15 11:41:19.815571 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:19.815526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:19.878867 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:19.878766    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"]
Sep 15 11:41:19.879039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:19.878970    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy" containerID="cri-o://9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1" gracePeriod=30
Sep 15 11:41:19.954359 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:19.954327    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:20.648237 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:20.648202    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:20.783012 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:20.782978    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06770864-8181-4dbc-829b-ce9aae834197" path="/var/lib/kubelet/pods/06770864-8181-4dbc-829b-ce9aae834197/volumes"
Sep 15 11:41:20.786028 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:20.786000    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:21.173267 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:21.173229    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:21.648369 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:21.648314    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:22.106734 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:22.106693    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:22.392459 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:22.392377    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:23.097250 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:23.097218    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:23.900175 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:23.900142    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:24.581844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:24.581798    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:24.668398 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:24.668366    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:24.791618 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:24.791586    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"]
Sep 15 11:41:24.791813 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:24.791792    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy" containerID="cri-o://97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba" gracePeriod=30
Sep 15 11:41:24.813416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:24.813385    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:25.148654 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.148629    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:41:25.191187 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.191103    2570 generic.go:356] "Generic (PLEG): container finished" podID="381063de-e59a-41da-ba05-de2d17bc7896" containerID="9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1" exitCode=0
Sep 15 11:41:25.191187 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.191175    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" event={"ID":"381063de-e59a-41da-ba05-de2d17bc7896","Type":"ContainerDied","Data":"9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1"}
Sep 15 11:41:25.191411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.191213    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c" event={"ID":"381063de-e59a-41da-ba05-de2d17bc7896","Type":"ContainerDied","Data":"d7587989dfc51491c8a8acefcbb07737280cf24090a1af5b6113e6994eb0faa2"}
Sep 15 11:41:25.191411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.191235    2570 scope.go:117] "RemoveContainer" containerID="9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1"
Sep 15 11:41:25.191411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.191367    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"
Sep 15 11:41:25.201215 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.201188    2570 scope.go:117] "RemoveContainer" containerID="b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178"
Sep 15 11:41:25.210517 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.210498    2570 scope.go:117] "RemoveContainer" containerID="9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1"
Sep 15 11:41:25.210833 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:41:25.210810    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1\": container with ID starting with 9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1 not found: ID does not exist" containerID="9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1"
Sep 15 11:41:25.210917 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.210841    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1"} err="failed to get container status \"9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1\": rpc error: code = NotFound desc = could not find container \"9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1\": container with ID starting with 9d13569896d1e2bc31372ce2776d299a33ad3ffabaea33f1437741df7bc5fde1 not found: ID does not exist"
Sep 15 11:41:25.210917 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.210860    2570 scope.go:117] "RemoveContainer" containerID="b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178"
Sep 15 11:41:25.211179 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:41:25.211151    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178\": container with ID starting with b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178 not found: ID does not exist" containerID="b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178"
Sep 15 11:41:25.211260 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.211187    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178"} err="failed to get container status \"b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178\": rpc error: code = NotFound desc = could not find container \"b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178\": container with ID starting with b9c807b4f2542700a84f8259a6bc75c3c569828517578148f0c94a5dd2fec178 not found: ID does not exist"
Sep 15 11:41:25.230988 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.230952    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:25.269008 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.268982    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-envoy\") pod \"381063de-e59a-41da-ba05-de2d17bc7896\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") "
Sep 15 11:41:25.269120 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269092    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btxwx\" (UniqueName: \"kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-kube-api-access-btxwx\") pod \"381063de-e59a-41da-ba05-de2d17bc7896\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") "
Sep 15 11:41:25.269168 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269139    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-data\") pod \"381063de-e59a-41da-ba05-de2d17bc7896\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") "
Sep 15 11:41:25.269221 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269203    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-certs\") pod \"381063de-e59a-41da-ba05-de2d17bc7896\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") "
Sep 15 11:41:25.269294 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269273    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/381063de-e59a-41da-ba05-de2d17bc7896-istiod-ca-cert\") pod \"381063de-e59a-41da-ba05-de2d17bc7896\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") "
Sep 15 11:41:25.269440 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269315    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/381063de-e59a-41da-ba05-de2d17bc7896-istio-podinfo\") pod \"381063de-e59a-41da-ba05-de2d17bc7896\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") "
Sep 15 11:41:25.269440 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269361    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-istio-token\") pod \"381063de-e59a-41da-ba05-de2d17bc7896\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") "
Sep 15 11:41:25.269440 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269382    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-data" (OuterVolumeSpecName: "istio-data") pod "381063de-e59a-41da-ba05-de2d17bc7896" (UID: "381063de-e59a-41da-ba05-de2d17bc7896"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:25.269664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269475    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-socket\") pod \"381063de-e59a-41da-ba05-de2d17bc7896\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") "
Sep 15 11:41:25.269664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269487    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "381063de-e59a-41da-ba05-de2d17bc7896" (UID: "381063de-e59a-41da-ba05-de2d17bc7896"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:25.269664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269531    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-credential-socket\") pod \"381063de-e59a-41da-ba05-de2d17bc7896\" (UID: \"381063de-e59a-41da-ba05-de2d17bc7896\") "
Sep 15 11:41:25.269830 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269731    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "381063de-e59a-41da-ba05-de2d17bc7896" (UID: "381063de-e59a-41da-ba05-de2d17bc7896"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:25.269830 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269740    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/381063de-e59a-41da-ba05-de2d17bc7896-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "381063de-e59a-41da-ba05-de2d17bc7896" (UID: "381063de-e59a-41da-ba05-de2d17bc7896"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:25.269963 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269937    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "381063de-e59a-41da-ba05-de2d17bc7896" (UID: "381063de-e59a-41da-ba05-de2d17bc7896"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:25.270068 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.269992    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:25.270068 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.270012    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:25.270068 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.270026    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/381063de-e59a-41da-ba05-de2d17bc7896-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:25.270068 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.270038    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:25.271275 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.271255    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-kube-api-access-btxwx" (OuterVolumeSpecName: "kube-api-access-btxwx") pod "381063de-e59a-41da-ba05-de2d17bc7896" (UID: "381063de-e59a-41da-ba05-de2d17bc7896"). InnerVolumeSpecName "kube-api-access-btxwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:25.271402 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.271379    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-istio-token" (OuterVolumeSpecName: "istio-token") pod "381063de-e59a-41da-ba05-de2d17bc7896" (UID: "381063de-e59a-41da-ba05-de2d17bc7896"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:25.271508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.271492    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "381063de-e59a-41da-ba05-de2d17bc7896" (UID: "381063de-e59a-41da-ba05-de2d17bc7896"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:25.271678 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.271651    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/381063de-e59a-41da-ba05-de2d17bc7896-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "381063de-e59a-41da-ba05-de2d17bc7896" (UID: "381063de-e59a-41da-ba05-de2d17bc7896"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:41:25.370734 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.370710    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:25.370734 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.370733    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:25.370850 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.370743    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/381063de-e59a-41da-ba05-de2d17bc7896-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:25.370850 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.370752    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btxwx\" (UniqueName: \"kubernetes.io/projected/381063de-e59a-41da-ba05-de2d17bc7896-kube-api-access-btxwx\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:25.370850 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.370761    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/381063de-e59a-41da-ba05-de2d17bc7896-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:25.524852 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.524818    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"]
Sep 15 11:41:25.525306 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.525287    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06770864-8181-4dbc-829b-ce9aae834197" containerName="revoke-keys"
Sep 15 11:41:25.525306 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.525307    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="06770864-8181-4dbc-829b-ce9aae834197" containerName="revoke-keys"
Sep 15 11:41:25.525451 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.525323    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy"
Sep 15 11:41:25.525451 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.525331    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy"
Sep 15 11:41:25.525552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.525466    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy"
Sep 15 11:41:25.525552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.525482    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy"
Sep 15 11:41:25.525552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.525492    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="06770864-8181-4dbc-829b-ce9aae834197" containerName="revoke-keys"
Sep 15 11:41:25.528611 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.528591    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.534472 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.534451    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-a1c362-openshift-default-dockercfg-sgq9h\""
Sep 15 11:41:25.537361 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.537343    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"]
Sep 15 11:41:25.560305 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.559997    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c"]
Sep 15 11:41:25.560305 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.560277    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"]
Sep 15 11:41:25.577226 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.577168    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:25.673640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.673605    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-socket\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.673640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.673649    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-data\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.673842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.673677    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-certs\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.673842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.673774    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-podinfo\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.673842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.673827    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-credential-socket\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.673971 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.673951    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7jc6\" (UniqueName: \"kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-kube-api-access-t7jc6\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.674007 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.673984    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-token\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.674007 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.674003    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-envoy\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.674103 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.674083    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1640b1eb-c469-4202-a632-d59dd4f0b107-istiod-ca-cert\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775114 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775082    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7jc6\" (UniqueName: \"kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-kube-api-access-t7jc6\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775121    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-token\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-envoy\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775187    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1640b1eb-c469-4202-a632-d59dd4f0b107-istiod-ca-cert\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775229    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-socket\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775259    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-data\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775528 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775293    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-certs\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775528 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775323    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-podinfo\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775528 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-credential-socket\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775735 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775708    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-socket\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775806 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775768    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-certs\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.775867 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.775801    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-credential-socket\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.776179 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.776060    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1640b1eb-c469-4202-a632-d59dd4f0b107-istiod-ca-cert\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.776516 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.776492    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-data\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.777738 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.777714    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-envoy\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.777916 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.777899    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-podinfo\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.785456 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.785434    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-token\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.785856 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.785833    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7jc6\" (UniqueName: \"kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-kube-api-access-t7jc6\") pod \"e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") " pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:25.841542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:25.841506    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:26.026399 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:26.026300    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:26.125906 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:26.125862    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"]
Sep 15 11:41:26.127503 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:41:26.127473    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1640b1eb_c469_4202_a632_d59dd4f0b107.slice/crio-6553ef00cbab46d9be126a0ecc44c44d86487ece397d0401ad7bf74dd14a0697 WatchSource:0}: Error finding container 6553ef00cbab46d9be126a0ecc44c44d86487ece397d0401ad7bf74dd14a0697: Status 404 returned error can't find the container with id 6553ef00cbab46d9be126a0ecc44c44d86487ece397d0401ad7bf74dd14a0697
Sep 15 11:41:26.130307 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:26.130267    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:41:26.130384 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:26.130365    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:41:26.130430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:26.130416    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:41:26.200488 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:26.200456    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" event={"ID":"1640b1eb-c469-4202-a632-d59dd4f0b107","Type":"ContainerStarted","Data":"594b756444fcb002c321cf3dbacf6ab58e07a4112c607db1c14e1d333182196f"}
Sep 15 11:41:26.200879 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:26.200518    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" event={"ID":"1640b1eb-c469-4202-a632-d59dd4f0b107","Type":"ContainerStarted","Data":"6553ef00cbab46d9be126a0ecc44c44d86487ece397d0401ad7bf74dd14a0697"}
Sep 15 11:41:26.219483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:26.219431    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" podStartSLOduration=1.2194129519999999 podStartE2EDuration="1.219412952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:26.218465558 +0000 UTC m=+987.974711951" watchObservedRunningTime="2026-09-15 11:41:26.219412952 +0000 UTC m=+987.975659331"
Sep 15 11:41:26.780642 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:26.780603    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="381063de-e59a-41da-ba05-de2d17bc7896" path="/var/lib/kubelet/pods/381063de-e59a-41da-ba05-de2d17bc7896/volumes"
Sep 15 11:41:26.842244 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:26.842212    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:27.427634 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:27.427597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:27.847470 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:27.847440    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:28.098948 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:28.098861    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:28.191200 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:28.191168    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:28.213848 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:28.213821    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:28.214618 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:28.214601    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:28.448287 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:28.448194    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:28.620550 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:28.620519    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:28.766454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:28.766425    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:28.909469 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:28.909438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:29.024024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:29.023934    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:29.386646 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:29.386548    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:29.497655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:29.497619    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:30.051589 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.051547    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:41:30.118405 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118342    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8827\" (UniqueName: \"kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-kube-api-access-b8827\") pod \"f58bc28e-af73-405e-ae20-622a64f1891b\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") "
Sep 15 11:41:30.118405 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118378    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-socket\") pod \"f58bc28e-af73-405e-ae20-622a64f1891b\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") "
Sep 15 11:41:30.118405 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118400    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f58bc28e-af73-405e-ae20-622a64f1891b-istio-podinfo\") pod \"f58bc28e-af73-405e-ae20-622a64f1891b\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") "
Sep 15 11:41:30.118689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118430    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-credential-socket\") pod \"f58bc28e-af73-405e-ae20-622a64f1891b\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") "
Sep 15 11:41:30.118689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118466    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f58bc28e-af73-405e-ae20-622a64f1891b-istiod-ca-cert\") pod \"f58bc28e-af73-405e-ae20-622a64f1891b\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") "
Sep 15 11:41:30.118689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118500    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-istio-token\") pod \"f58bc28e-af73-405e-ae20-622a64f1891b\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") "
Sep 15 11:41:30.118689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118525    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-envoy\") pod \"f58bc28e-af73-405e-ae20-622a64f1891b\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") "
Sep 15 11:41:30.118689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118628    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-data\") pod \"f58bc28e-af73-405e-ae20-622a64f1891b\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") "
Sep 15 11:41:30.118689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118639    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f58bc28e-af73-405e-ae20-622a64f1891b" (UID: "f58bc28e-af73-405e-ae20-622a64f1891b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:30.118689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118672    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-certs\") pod \"f58bc28e-af73-405e-ae20-622a64f1891b\" (UID: \"f58bc28e-af73-405e-ae20-622a64f1891b\") "
Sep 15 11:41:30.119053 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118777    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f58bc28e-af73-405e-ae20-622a64f1891b" (UID: "f58bc28e-af73-405e-ae20-622a64f1891b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:30.119053 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.118890    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f58bc28e-af73-405e-ae20-622a64f1891b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f58bc28e-af73-405e-ae20-622a64f1891b" (UID: "f58bc28e-af73-405e-ae20-622a64f1891b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:30.119053 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.119023    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-data" (OuterVolumeSpecName: "istio-data") pod "f58bc28e-af73-405e-ae20-622a64f1891b" (UID: "f58bc28e-af73-405e-ae20-622a64f1891b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:30.119053 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.119037    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f58bc28e-af73-405e-ae20-622a64f1891b" (UID: "f58bc28e-af73-405e-ae20-622a64f1891b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:30.119809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.119788    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:30.119932 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.119824    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:30.119932 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.119840    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:30.119932 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.119855    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:30.119932 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.119872    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f58bc28e-af73-405e-ae20-622a64f1891b-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:30.128708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.128681    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f58bc28e-af73-405e-ae20-622a64f1891b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f58bc28e-af73-405e-ae20-622a64f1891b" (UID: "f58bc28e-af73-405e-ae20-622a64f1891b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:41:30.128826 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.128687    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-kube-api-access-b8827" (OuterVolumeSpecName: "kube-api-access-b8827") pod "f58bc28e-af73-405e-ae20-622a64f1891b" (UID: "f58bc28e-af73-405e-ae20-622a64f1891b"). InnerVolumeSpecName "kube-api-access-b8827". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:30.128826 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.128790    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f58bc28e-af73-405e-ae20-622a64f1891b" (UID: "f58bc28e-af73-405e-ae20-622a64f1891b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:30.128826 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.128798    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-istio-token" (OuterVolumeSpecName: "istio-token") pod "f58bc28e-af73-405e-ae20-622a64f1891b" (UID: "f58bc28e-af73-405e-ae20-622a64f1891b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:30.220666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.220642    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8827\" (UniqueName: \"kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-kube-api-access-b8827\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:30.220775 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.220668    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f58bc28e-af73-405e-ae20-622a64f1891b-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:30.220775 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.220682    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f58bc28e-af73-405e-ae20-622a64f1891b-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:30.220775 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.220694    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f58bc28e-af73-405e-ae20-622a64f1891b-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:41:30.227699 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.227668    2570 generic.go:356] "Generic (PLEG): container finished" podID="f58bc28e-af73-405e-ae20-622a64f1891b" containerID="97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba" exitCode=0
Sep 15 11:41:30.227797 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.227744    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"
Sep 15 11:41:30.227797 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.227751    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" event={"ID":"f58bc28e-af73-405e-ae20-622a64f1891b","Type":"ContainerDied","Data":"97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba"}
Sep 15 11:41:30.227870 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.227840    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs" event={"ID":"f58bc28e-af73-405e-ae20-622a64f1891b","Type":"ContainerDied","Data":"b4050c841e27d984c1d78fc85cb5a0cf219a8ddd4f63fd4a83af2e8d48129fac"}
Sep 15 11:41:30.227870 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.227865    2570 scope.go:117] "RemoveContainer" containerID="97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba"
Sep 15 11:41:30.234590 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.234534    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:30.239907 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.239890    2570 scope.go:117] "RemoveContainer" containerID="cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72"
Sep 15 11:41:30.248298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.248279    2570 scope.go:117] "RemoveContainer" containerID="97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba"
Sep 15 11:41:30.248599 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:41:30.248577    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba\": container with ID starting with 97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba not found: ID does not exist" containerID="97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba"
Sep 15 11:41:30.248672 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.248605    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba"} err="failed to get container status \"97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba\": rpc error: code = NotFound desc = could not find container \"97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba\": container with ID starting with 97759645f33ea1d358344696165c2ef35d90dbe542f22df8c5a249ef87cb60ba not found: ID does not exist"
Sep 15 11:41:30.248672 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.248620    2570 scope.go:117] "RemoveContainer" containerID="cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72"
Sep 15 11:41:30.248849 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:41:30.248834    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72\": container with ID starting with cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72 not found: ID does not exist" containerID="cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72"
Sep 15 11:41:30.248891 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.248853    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72"} err="failed to get container status \"cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72\": rpc error: code = NotFound desc = could not find container \"cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72\": container with ID starting with cabc567b1bed9aea897978fccace6e3ac5fdccc9b163c69de44e4bb2c7763e72 not found: ID does not exist"
Sep 15 11:41:30.250979 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.250956    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"]
Sep 15 11:41:30.254267 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.254249    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs"]
Sep 15 11:41:30.781178 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.781145    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" path="/var/lib/kubelet/pods/f58bc28e-af73-405e-ae20-622a64f1891b/volumes"
Sep 15 11:41:30.995492 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:30.995463    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:31.931608 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:31.931577    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:32.031891 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:32.031850    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:32.203472 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:32.203379    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:32.495385 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:32.495306    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:32.599647 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:32.599614    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:35.003357 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:35.003323    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:41:39.175370 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:39.175332    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:43.940991 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:43.940950    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:50.572460 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.572420    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"]
Sep 15 11:41:50.572864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.572850    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy"
Sep 15 11:41:50.572864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.572865    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy"
Sep 15 11:41:50.572942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.572882    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy"
Sep 15 11:41:50.572942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.572888    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy"
Sep 15 11:41:50.572942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.572902    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy"
Sep 15 11:41:50.572942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.572909    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="381063de-e59a-41da-ba05-de2d17bc7896" containerName="istio-proxy"
Sep 15 11:41:50.573079 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.572968    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy"
Sep 15 11:41:50.573079 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.572979    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58bc28e-af73-405e-ae20-622a64f1891b" containerName="istio-proxy"
Sep 15 11:41:50.577794 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.577779    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.580796 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.580773    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1358dc\"/\"kube-root-ca.crt\""
Sep 15 11:41:50.581988 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.581970    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1358dc\"/\"openshift-service-ca.crt\""
Sep 15 11:41:50.582096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.581982    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1358dc\"/\"default-dockercfg-vkhm4\""
Sep 15 11:41:50.582096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.582072    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1358dc\"/\"test-model-1358dc-kserve-self-signed-certs\""
Sep 15 11:41:50.601642 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.601615    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"]
Sep 15 11:41:50.627167 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.627139    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-model-cache\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.627340 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.627320    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d895a11c-0a80-4c04-ac40-6dc3f1886844-tls-certs\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.627473 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.627457    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jg6h\" (UniqueName: \"kubernetes.io/projected/d895a11c-0a80-4c04-ac40-6dc3f1886844-kube-api-access-8jg6h\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.627730 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.627711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-dshm\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.627860 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.627845    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-tmp-dir\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.627979 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.627966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-home\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.729249 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.729212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-dshm\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.729504 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.729482    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-tmp-dir\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.729687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.729668    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-home\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.729859 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.729842    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-model-cache\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.729974 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.729961    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d895a11c-0a80-4c04-ac40-6dc3f1886844-tls-certs\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.730086 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.730073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jg6h\" (UniqueName: \"kubernetes.io/projected/d895a11c-0a80-4c04-ac40-6dc3f1886844-kube-api-access-8jg6h\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.730271 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.730080    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-home\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.730386 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.729846    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-tmp-dir\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.730485 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.730301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-model-cache\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.737199 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.737176    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d895a11c-0a80-4c04-ac40-6dc3f1886844-tls-certs\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.760166 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.760142    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-dshm\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.761012 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.760985    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:50.764084 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.764064    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jg6h\" (UniqueName: \"kubernetes.io/projected/d895a11c-0a80-4c04-ac40-6dc3f1886844-kube-api-access-8jg6h\") pod \"test-model-1358dc-kserve-5f595f6477-fqdkt\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") " pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:50.887019 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:50.886925    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:41:51.187617 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:51.187586    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"]
Sep 15 11:41:51.188689 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:41:51.188665    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd895a11c_0a80_4c04_ac40_6dc3f1886844.slice/crio-2c1f7fc6e4d448cbe6fcaf7c2318e61b7ca83ca28caec1ce7fb7f53f222fd1a2 WatchSource:0}: Error finding container 2c1f7fc6e4d448cbe6fcaf7c2318e61b7ca83ca28caec1ce7fb7f53f222fd1a2: Status 404 returned error can't find the container with id 2c1f7fc6e4d448cbe6fcaf7c2318e61b7ca83ca28caec1ce7fb7f53f222fd1a2
Sep 15 11:41:51.381475 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:51.381398    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt" event={"ID":"d895a11c-0a80-4c04-ac40-6dc3f1886844","Type":"ContainerStarted","Data":"b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267"}
Sep 15 11:41:51.381475 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:51.381447    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt" event={"ID":"d895a11c-0a80-4c04-ac40-6dc3f1886844","Type":"ContainerStarted","Data":"2c1f7fc6e4d448cbe6fcaf7c2318e61b7ca83ca28caec1ce7fb7f53f222fd1a2"}
Sep 15 11:41:51.400161 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:51.400103    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt" podStartSLOduration=1.400086667 podStartE2EDuration="1.400086667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:51.398486271 +0000 UTC m=+1013.154732651" watchObservedRunningTime="2026-09-15 11:41:51.400086667 +0000 UTC m=+1013.156333089"
Sep 15 11:41:53.975463 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:53.975427    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:54.615976 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:54.615941    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:55.293946 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:55.293909    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:55.394317 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:55.394283    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:55.410040 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:55.410017    2570 generic.go:356] "Generic (PLEG): container finished" podID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerID="594b756444fcb002c321cf3dbacf6ab58e07a4112c607db1c14e1d333182196f" exitCode=0
Sep 15 11:41:55.410177 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:55.410101    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" event={"ID":"1640b1eb-c469-4202-a632-d59dd4f0b107","Type":"ContainerDied","Data":"594b756444fcb002c321cf3dbacf6ab58e07a4112c607db1c14e1d333182196f"}
Sep 15 11:41:55.410571 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:55.410540    2570 scope.go:117] "RemoveContainer" containerID="594b756444fcb002c321cf3dbacf6ab58e07a4112c607db1c14e1d333182196f"
Sep 15 11:41:55.411815 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:55.411788    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:41:55.411875 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:55.411856    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:41:55.411911 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:55.411902    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:41:56.022780 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:56.022741    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:56.419049 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:56.418954    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" event={"ID":"1640b1eb-c469-4202-a632-d59dd4f0b107","Type":"ContainerStarted","Data":"869b142804c127b10ae997383e221bc11cb257ad652c63e5350074d7d9bda69a"}
Sep 15 11:41:56.785054 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:56.785008    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:56.842047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:56.842006    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:56.843515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:56.843482    2570 patch_prober.go:28] interesting pod/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 15 11:41:56.843687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:56.843549    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 15 11:41:57.411774 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:57.411741    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:57.842878 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:57.842838    2570 patch_prober.go:28] interesting pod/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 15 11:41:57.843452 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:57.843419    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 15 11:41:58.103869 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:58.103775    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:58.213805 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:58.213775    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:41:58.856259 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:58.856211    2570 patch_prober.go:28] interesting pod/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 15 11:41:58.856750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:58.856309    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 15 11:41:59.842975 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:59.842931    2570 patch_prober.go:28] interesting pod/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 15 11:41:59.843345 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:41:59.843305    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 15 11:42:00.841881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:00.841845    2570 patch_prober.go:28] interesting pod/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 15 11:42:00.842467 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:00.842432    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 15 11:42:00.888073 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:00.888043    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:42:00.888210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:00.888090    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:42:00.900416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:00.900384    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:42:01.134889 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:01.134794    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:01.284797 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:01.284762    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:01.386685 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:01.386597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:01.479426 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:01.479393    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:42:01.845874 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:01.845840    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:42:01.846784 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:01.846761    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:42:02.705659 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:02.705626    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:42:17.191901 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:17.191859    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:23.793216 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:23.793181    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:23.857202 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:23.857172    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:23.948414 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:23.948377    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:24.047437 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:24.047341    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:25.591393 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:25.591351    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:42:31.286442 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:31.286403    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:34.467888 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:34.467849    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:35.224856 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:35.224817    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:41.783176 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:41.783132    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:41.892585 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:41.892510    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:42.041343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:42.041254    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:42.227645 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:42.227608    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:42.874669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:42.874632    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:43.023498 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:43.023463    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:44.469689 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:44.469658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:48.108494 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:48.108468    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:50.278788 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.278759    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"]
Sep 15 11:42:50.282046 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.282025    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.285858 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.285807    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2fab1f\"/\"openshift-service-ca.crt\""
Sep 15 11:42:50.285858 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.285821    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2fab1f\"/\"default-dockercfg-q727f\""
Sep 15 11:42:50.285858 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.285825    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2fab1f\"/\"kube-root-ca.crt\""
Sep 15 11:42:50.286059 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.285875    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2fab1f\"/\"e2e-conflict-a-f81d2f5d-kserve-self-signed-certs\""
Sep 15 11:42:50.291523 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.291500    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"]
Sep 15 11:42:50.311673 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.311646    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:50.457343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.457308    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-tmp-dir\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.457343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.457343    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d470695-d3c3-44d0-ac2c-6ed763949075-tls-certs\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.457555 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.457368    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-home\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.457555 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.457479    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-model-cache\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.457555 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.457512    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-dshm\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.457555 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.457546    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qhnd\" (UniqueName: \"kubernetes.io/projected/1d470695-d3c3-44d0-ac2c-6ed763949075-kube-api-access-8qhnd\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.558336 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.558262    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-tmp-dir\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.558336 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.558295    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d470695-d3c3-44d0-ac2c-6ed763949075-tls-certs\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.558336 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.558315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-home\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.558605 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.558356    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-model-cache\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.558605 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.558381    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-dshm\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.558605 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.558408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qhnd\" (UniqueName: \"kubernetes.io/projected/1d470695-d3c3-44d0-ac2c-6ed763949075-kube-api-access-8qhnd\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.558776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.558754    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-tmp-dir\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.558836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.558760    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-home\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.558836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.558816    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-model-cache\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.560661 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.560643    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-dshm\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.560856 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.560840    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d470695-d3c3-44d0-ac2c-6ed763949075-tls-certs\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.565963 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.565940    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qhnd\" (UniqueName: \"kubernetes.io/projected/1d470695-d3c3-44d0-ac2c-6ed763949075-kube-api-access-8qhnd\") pod \"e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") " pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.592707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.592681    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:42:50.659833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.659802    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:50.759475 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.759437    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:50.876171 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:50.876146    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"]
Sep 15 11:42:50.877805 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:42:50.877778    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d470695_d3c3_44d0_ac2c_6ed763949075.slice/crio-f4dcbdf5cbbe535447888c517166c4d2ee957bc7d68608b43b94349411041dd3 WatchSource:0}: Error finding container f4dcbdf5cbbe535447888c517166c4d2ee957bc7d68608b43b94349411041dd3: Status 404 returned error can't find the container with id f4dcbdf5cbbe535447888c517166c4d2ee957bc7d68608b43b94349411041dd3
Sep 15 11:42:51.344804 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:51.344768    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:51.773555 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:51.773517    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf" event={"ID":"1d470695-d3c3-44d0-ac2c-6ed763949075","Type":"ContainerStarted","Data":"998668b1e14855720eb75028a3b1b484f3cece879833ba60c6242ae55a77e3b5"}
Sep 15 11:42:51.773743 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:51.773584    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf" event={"ID":"1d470695-d3c3-44d0-ac2c-6ed763949075","Type":"ContainerStarted","Data":"f4dcbdf5cbbe535447888c517166c4d2ee957bc7d68608b43b94349411041dd3"}
Sep 15 11:42:51.791259 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:51.791212    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf" podStartSLOduration=1.79119844 podStartE2EDuration="1.79119844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:51.789064989 +0000 UTC m=+1073.545311368" watchObservedRunningTime="2026-09-15 11:42:51.79119844 +0000 UTC m=+1073.547444817"
Sep 15 11:42:53.181490 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:53.181446    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:53.275082 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:53.275050    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"]
Sep 15 11:42:53.278775 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:53.278753    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"
Sep 15 11:42:53.281223 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:53.281200    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2w6g9\""
Sep 15 11:42:53.281491 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:53.281476    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:42:53.287008 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:53.286980    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"]
Sep 15 11:42:53.384964 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:53.384933    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60bb8a38-aa95-470b-8245-47addfcaf057-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj\" (UID: \"60bb8a38-aa95-470b-8245-47addfcaf057\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"
Sep 15 11:42:53.485741 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:53.485657    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60bb8a38-aa95-470b-8245-47addfcaf057-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj\" (UID: \"60bb8a38-aa95-470b-8245-47addfcaf057\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"
Sep 15 11:42:53.486270 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:53.486252    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60bb8a38-aa95-470b-8245-47addfcaf057-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj\" (UID: \"60bb8a38-aa95-470b-8245-47addfcaf057\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"
Sep 15 11:42:53.593251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:53.593222    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"
Sep 15 11:42:53.867941 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:53.867915    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"]
Sep 15 11:42:53.868855 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:42:53.868832    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bb8a38_aa95_470b_8245_47addfcaf057.slice/crio-6fd49f453f9c4fda71840ed74787c5529fcb33f0c6e979b89a262072941428fe WatchSource:0}: Error finding container 6fd49f453f9c4fda71840ed74787c5529fcb33f0c6e979b89a262072941428fe: Status 404 returned error can't find the container with id 6fd49f453f9c4fda71840ed74787c5529fcb33f0c6e979b89a262072941428fe
Sep 15 11:42:54.166088 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:54.166063    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:54.286338 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:54.286314    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:54.794596 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:54.794488    2570 generic.go:356] "Generic (PLEG): container finished" podID="60bb8a38-aa95-470b-8245-47addfcaf057" containerID="b7c2b0ab25024726526593da08da712fad0ba630553795eeeb9968c0774178bb" exitCode=0
Sep 15 11:42:54.794596 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:54.794582    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj" event={"ID":"60bb8a38-aa95-470b-8245-47addfcaf057","Type":"ContainerDied","Data":"b7c2b0ab25024726526593da08da712fad0ba630553795eeeb9968c0774178bb"}
Sep 15 11:42:54.794779 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:54.794635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj" event={"ID":"60bb8a38-aa95-470b-8245-47addfcaf057","Type":"ContainerStarted","Data":"6fd49f453f9c4fda71840ed74787c5529fcb33f0c6e979b89a262072941428fe"}
Sep 15 11:42:55.086324 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:55.086227    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:55.789319 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:55.789278    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:55.943003 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:55.942978    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"
Sep 15 11:42:56.009272 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:56.009246    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60bb8a38-aa95-470b-8245-47addfcaf057-maas-api-service-ca\") pod \"60bb8a38-aa95-470b-8245-47addfcaf057\" (UID: \"60bb8a38-aa95-470b-8245-47addfcaf057\") "
Sep 15 11:42:56.009526 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:56.009507    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60bb8a38-aa95-470b-8245-47addfcaf057-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "60bb8a38-aa95-470b-8245-47addfcaf057" (UID: "60bb8a38-aa95-470b-8245-47addfcaf057"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:42:56.110221 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:56.110144    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60bb8a38-aa95-470b-8245-47addfcaf057-maas-api-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:42:56.512531 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:56.512489    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:56.807371 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:56.807340    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"
Sep 15 11:42:56.807787 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:56.807379    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj" event={"ID":"60bb8a38-aa95-470b-8245-47addfcaf057","Type":"ContainerDied","Data":"6fd49f453f9c4fda71840ed74787c5529fcb33f0c6e979b89a262072941428fe"}
Sep 15 11:42:56.807787 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:56.807423    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fd49f453f9c4fda71840ed74787c5529fcb33f0c6e979b89a262072941428fe"
Sep 15 11:42:56.997235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:56.997203    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:42:57.412408 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:57.412373    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:58.104618 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.104588    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:58.333601 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.333555    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:58.448402 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.448318    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:58.635380 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.635337    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:58.891609 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.891577    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"]
Sep 15 11:42:58.892048 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.892031    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bb8a38-aa95-470b-8245-47addfcaf057" containerName="revoke-keys"
Sep 15 11:42:58.892130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.892051    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bb8a38-aa95-470b-8245-47addfcaf057" containerName="revoke-keys"
Sep 15 11:42:58.892130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.892119    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="60bb8a38-aa95-470b-8245-47addfcaf057" containerName="revoke-keys"
Sep 15 11:42:58.895307 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.895292    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:58.901014 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.900988    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-53d3db96-openshift-default-dockercfg-xsrbf\""
Sep 15 11:42:58.931347 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.924180    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"]
Sep 15 11:42:58.933798 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.933772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2148acc7-8931-4ded-8168-0c5063439503-istio-podinfo\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:58.933964 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.933943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-istio-token\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:58.934130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.934111    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-certs\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:58.934271 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.934254    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2148acc7-8931-4ded-8168-0c5063439503-istiod-ca-cert\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:58.934415 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.934399    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-envoy\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:58.934603 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.934584    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-data\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:58.934785 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.934767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7xq5\" (UniqueName: \"kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-kube-api-access-w7xq5\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:58.934904 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.934889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-socket\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:58.935067 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.935049    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-credential-socket\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:58.974644 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:58.974363    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:59.036300 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.036257    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-credential-socket\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.036505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.036336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2148acc7-8931-4ded-8168-0c5063439503-istio-podinfo\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.036505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.036369    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-istio-token\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.036505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.036397    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-certs\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.036505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.036426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2148acc7-8931-4ded-8168-0c5063439503-istiod-ca-cert\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.036505 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.036486    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-envoy\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.036799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.036554    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-data\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.036799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.036643    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7xq5\" (UniqueName: \"kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-kube-api-access-w7xq5\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.036799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.036675    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-socket\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.036957 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.036809    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-credential-socket\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.037126 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.037106    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-socket\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.037310 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.037289    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-data\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.037708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.037684    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-certs\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.038124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.038099    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2148acc7-8931-4ded-8168-0c5063439503-istiod-ca-cert\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.040445 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.040422    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2148acc7-8931-4ded-8168-0c5063439503-istio-podinfo\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.041076 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.041032    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-envoy\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.054217 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.054171    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-istio-token\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.057585 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.057523    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7xq5\" (UniqueName: \"kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-kube-api-access-w7xq5\") pod \"e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") " pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.208489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.208400    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:42:59.431906 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.431869    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:59.491244 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.491214    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"]
Sep 15 11:42:59.492426 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:42:59.492400    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2148acc7_8931_4ded_8168_0c5063439503.slice/crio-8aaed2d952d95b8499074fe702700f83d7d997ce2dd18d2a8deb9a3fcb5e7f2d WatchSource:0}: Error finding container 8aaed2d952d95b8499074fe702700f83d7d997ce2dd18d2a8deb9a3fcb5e7f2d: Status 404 returned error can't find the container with id 8aaed2d952d95b8499074fe702700f83d7d997ce2dd18d2a8deb9a3fcb5e7f2d
Sep 15 11:42:59.494728 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.494698    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:42:59.494797 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.494758    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:42:59.494797 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.494787    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:42:59.830243 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.830198    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" event={"ID":"2148acc7-8931-4ded-8168-0c5063439503","Type":"ContainerStarted","Data":"dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58"}
Sep 15 11:42:59.830397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.830277    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" event={"ID":"2148acc7-8931-4ded-8168-0c5063439503","Type":"ContainerStarted","Data":"8aaed2d952d95b8499074fe702700f83d7d997ce2dd18d2a8deb9a3fcb5e7f2d"}
Sep 15 11:42:59.854005 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:42:59.853956    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" podStartSLOduration=1.853940707 podStartE2EDuration="1.853940707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:59.850258686 +0000 UTC m=+1081.606505060" watchObservedRunningTime="2026-09-15 11:42:59.853940707 +0000 UTC m=+1081.610187151"
Sep 15 11:43:00.209246 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:00.209150    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:43:00.214261 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:00.214236    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:43:00.593378 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:00.593326    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:43:00.593646 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:00.593616    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:43:00.605798 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:00.605776    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:43:00.837331 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:00.837294    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:43:00.838157 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:00.838133    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:43:00.849263 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:00.849198    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:43:01.022847 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:01.022808    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:01.828452 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:01.828419    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:02.744687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:02.744657    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:02.844210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:02.844179    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:03.619220 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:03.619158    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:04.393219 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:04.393185    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:04.491902 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:04.491861    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:04.605326 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:04.605291    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:04.789937 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:04.789909    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"]
Sep 15 11:43:04.792623 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:04.792598    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a1c362-q6tzj"]
Sep 15 11:43:04.799354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:04.799315    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:04.886755 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:04.886722    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:05.086082 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:05.085984    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:05.574348 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:05.574313    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:05.678196 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:05.678159    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:05.801223 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:05.801151    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:06.212539 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:06.212503    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:06.288680 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:06.288643    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:06.624048 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:06.624012    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:06.781254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:06.781220    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60bb8a38-aa95-470b-8245-47addfcaf057" path="/var/lib/kubelet/pods/60bb8a38-aa95-470b-8245-47addfcaf057/volumes"
Sep 15 11:43:07.492825 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:07.492788    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:08.289634 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:08.289595    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:09.513023 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:09.512978    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:10.206611 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:10.206550    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:10.944835 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:10.944798    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:11.537619 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:11.537577    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:11.635135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:11.635083    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:11.763523 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:11.763487    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"]
Sep 15 11:43:11.763836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:11.763802    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy" containerID="cri-o://869b142804c127b10ae997383e221bc11cb257ad652c63e5350074d7d9bda69a" gracePeriod=30
Sep 15 11:43:11.787855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:11.787765    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:12.220020 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.219933    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:12.479230 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.479151    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"]
Sep 15 11:43:12.483621 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.483598    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.486658 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.486640    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-849a35-openshift-default-dockercfg-mbg7r\""
Sep 15 11:43:12.499965 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.499932    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"]
Sep 15 11:43:12.509969 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.509939    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:12.591315 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.591220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-credential-socket\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.591611 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.591590    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-envoy\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.591781 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.591767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-socket\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.591896 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.591884    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-data\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.592097 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.592079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-podinfo\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.592236 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.592220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istiod-ca-cert\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.592426 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.592410    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-certs\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.592595 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.592576    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p7hp\" (UniqueName: \"kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-kube-api-access-2p7hp\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.592808 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.592788    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-token\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.693633 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.693604    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-socket\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.693633 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.693635    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-data\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.693879 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.693704    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-podinfo\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.693879 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.693725    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istiod-ca-cert\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.693879 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.693769    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-certs\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.693879 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.693796    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p7hp\" (UniqueName: \"kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-kube-api-access-2p7hp\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.693879 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.693873    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-token\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.694042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.693929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-credential-socket\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.694042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.693953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-envoy\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.694112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.694059    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-socket\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.694480 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.694453    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istiod-ca-cert\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.694480 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.694475    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-data\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.694718 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.694543    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-certs\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.694718 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.694582    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-credential-socket\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.696246 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.696220    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-podinfo\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.696353 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.696340    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-envoy\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.704891 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.704864    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p7hp\" (UniqueName: \"kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-kube-api-access-2p7hp\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.706338 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.706320    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-token\") pod \"e2e-noten-849a35-openshift-default-6658f6b56-spdg6\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") " pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:12.796709 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:12.796678    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:13.080114 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:13.080083    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"]
Sep 15 11:43:13.081539 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:43:13.081509    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1ed411_712a_4824_a0fd_0d2b10eb20ff.slice/crio-7675f7122d20a102c8af23c13b8234fb432ca8eeec7d7df177d3b64e5ba3107b WatchSource:0}: Error finding container 7675f7122d20a102c8af23c13b8234fb432ca8eeec7d7df177d3b64e5ba3107b: Status 404 returned error can't find the container with id 7675f7122d20a102c8af23c13b8234fb432ca8eeec7d7df177d3b64e5ba3107b
Sep 15 11:43:13.083807 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:13.083774    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:43:13.083892 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:13.083839    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:43:13.083892 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:13.083881    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:43:13.085323 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:13.085295    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:13.924376 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:13.924331    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6" event={"ID":"6c1ed411-712a-4824-a0fd-0d2b10eb20ff","Type":"ContainerStarted","Data":"4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910"}
Sep 15 11:43:13.924884 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:13.924405    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6" event={"ID":"6c1ed411-712a-4824-a0fd-0d2b10eb20ff","Type":"ContainerStarted","Data":"7675f7122d20a102c8af23c13b8234fb432ca8eeec7d7df177d3b64e5ba3107b"}
Sep 15 11:43:13.949627 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:13.949553    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6" podStartSLOduration=1.949539505 podStartE2EDuration="1.949539505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:43:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:43:13.948037682 +0000 UTC m=+1095.704284063" watchObservedRunningTime="2026-09-15 11:43:13.949539505 +0000 UTC m=+1095.705785882"
Sep 15 11:43:14.258260 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:14.258156    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:14.359167 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:14.359133    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:14.467677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:14.467648    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:14.797161 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:14.797125    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:14.802168 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:14.802142    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:14.930333 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:14.930304    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:14.931353 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:14.931334    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:43:16.848066 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:16.848024    2570 patch_prober.go:28] interesting pod/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 15 11:43:16.848580 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:16.848131    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 15 11:43:16.969489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:16.968713    2570 generic.go:356] "Generic (PLEG): container finished" podID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerID="869b142804c127b10ae997383e221bc11cb257ad652c63e5350074d7d9bda69a" exitCode=0
Sep 15 11:43:16.969489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:16.968784    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" event={"ID":"1640b1eb-c469-4202-a632-d59dd4f0b107","Type":"ContainerDied","Data":"869b142804c127b10ae997383e221bc11cb257ad652c63e5350074d7d9bda69a"}
Sep 15 11:43:16.969489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:16.968848    2570 scope.go:117] "RemoveContainer" containerID="594b756444fcb002c321cf3dbacf6ab58e07a4112c607db1c14e1d333182196f"
Sep 15 11:43:17.062025 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.061963    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:43:17.161133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161101    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-data\") pod \"1640b1eb-c469-4202-a632-d59dd4f0b107\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") "
Sep 15 11:43:17.161309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161163    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-certs\") pod \"1640b1eb-c469-4202-a632-d59dd4f0b107\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") "
Sep 15 11:43:17.161309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161197    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-envoy\") pod \"1640b1eb-c469-4202-a632-d59dd4f0b107\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") "
Sep 15 11:43:17.161309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161232    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-socket\") pod \"1640b1eb-c469-4202-a632-d59dd4f0b107\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") "
Sep 15 11:43:17.161412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161329    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-podinfo\") pod \"1640b1eb-c469-4202-a632-d59dd4f0b107\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") "
Sep 15 11:43:17.161412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161350    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-credential-socket\") pod \"1640b1eb-c469-4202-a632-d59dd4f0b107\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") "
Sep 15 11:43:17.161412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161374    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-token\") pod \"1640b1eb-c469-4202-a632-d59dd4f0b107\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") "
Sep 15 11:43:17.161412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161371    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1640b1eb-c469-4202-a632-d59dd4f0b107" (UID: "1640b1eb-c469-4202-a632-d59dd4f0b107"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:17.161412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161393    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1640b1eb-c469-4202-a632-d59dd4f0b107-istiod-ca-cert\") pod \"1640b1eb-c469-4202-a632-d59dd4f0b107\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") "
Sep 15 11:43:17.161412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161380    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-data" (OuterVolumeSpecName: "istio-data") pod "1640b1eb-c469-4202-a632-d59dd4f0b107" (UID: "1640b1eb-c469-4202-a632-d59dd4f0b107"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:17.161687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161421    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7jc6\" (UniqueName: \"kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-kube-api-access-t7jc6\") pod \"1640b1eb-c469-4202-a632-d59dd4f0b107\" (UID: \"1640b1eb-c469-4202-a632-d59dd4f0b107\") "
Sep 15 11:43:17.161687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161527    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1640b1eb-c469-4202-a632-d59dd4f0b107" (UID: "1640b1eb-c469-4202-a632-d59dd4f0b107"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:17.161804 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161725    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1640b1eb-c469-4202-a632-d59dd4f0b107" (UID: "1640b1eb-c469-4202-a632-d59dd4f0b107"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:17.161858 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161828    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1640b1eb-c469-4202-a632-d59dd4f0b107-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1640b1eb-c469-4202-a632-d59dd4f0b107" (UID: "1640b1eb-c469-4202-a632-d59dd4f0b107"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:43:17.161915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161866    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:43:17.161915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161892    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:43:17.161915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161906    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:43:17.162126 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.161920    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:43:17.163879 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.163853    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1640b1eb-c469-4202-a632-d59dd4f0b107" (UID: "1640b1eb-c469-4202-a632-d59dd4f0b107"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:43:17.163992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.163853    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1640b1eb-c469-4202-a632-d59dd4f0b107" (UID: "1640b1eb-c469-4202-a632-d59dd4f0b107"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:17.164056 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.164008    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-token" (OuterVolumeSpecName: "istio-token") pod "1640b1eb-c469-4202-a632-d59dd4f0b107" (UID: "1640b1eb-c469-4202-a632-d59dd4f0b107"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:17.164137 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.164117    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-kube-api-access-t7jc6" (OuterVolumeSpecName: "kube-api-access-t7jc6") pod "1640b1eb-c469-4202-a632-d59dd4f0b107" (UID: "1640b1eb-c469-4202-a632-d59dd4f0b107"). InnerVolumeSpecName "kube-api-access-t7jc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:17.263042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.263003    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:43:17.263042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.263036    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:43:17.263042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.263045    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:43:17.263042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.263053    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1640b1eb-c469-4202-a632-d59dd4f0b107-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:43:17.263318 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.263063    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7jc6\" (UniqueName: \"kubernetes.io/projected/1640b1eb-c469-4202-a632-d59dd4f0b107-kube-api-access-t7jc6\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:43:17.834700 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.834506    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:17.976727 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.976698    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"
Sep 15 11:43:17.977151 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.976726    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h" event={"ID":"1640b1eb-c469-4202-a632-d59dd4f0b107","Type":"ContainerDied","Data":"6553ef00cbab46d9be126a0ecc44c44d86487ece397d0401ad7bf74dd14a0697"}
Sep 15 11:43:17.977151 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:17.976786    2570 scope.go:117] "RemoveContainer" containerID="869b142804c127b10ae997383e221bc11cb257ad652c63e5350074d7d9bda69a"
Sep 15 11:43:18.004675 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:18.004650    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"]
Sep 15 11:43:18.014272 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:18.014250    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h"]
Sep 15 11:43:18.781738 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:18.781707    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" path="/var/lib/kubelet/pods/1640b1eb-c469-4202-a632-d59dd4f0b107/volumes"
Sep 15 11:43:24.018881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:24.018847    2570 generic.go:356] "Generic (PLEG): container finished" podID="2148acc7-8931-4ded-8168-0c5063439503" containerID="dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58" exitCode=0
Sep 15 11:43:24.019347 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:24.018920    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" event={"ID":"2148acc7-8931-4ded-8168-0c5063439503","Type":"ContainerDied","Data":"dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58"}
Sep 15 11:43:24.019347 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:24.019341    2570 scope.go:117] "RemoveContainer" containerID="dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58"
Sep 15 11:43:24.020510 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:24.020478    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:43:24.020625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:24.020548    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:43:24.020625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:24.020614    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:43:25.057949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:25.057909    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" event={"ID":"2148acc7-8931-4ded-8168-0c5063439503","Type":"ContainerStarted","Data":"27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48"}
Sep 15 11:43:25.209137 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:25.209094    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:43:25.209447 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:25.209421    2570 patch_prober.go:28] interesting pod/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 15 11:43:25.209546 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:25.209474    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 15 11:43:26.209739 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:26.209703    2570 patch_prober.go:28] interesting pod/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 15 11:43:26.210155 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:26.209759    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 15 11:43:27.209183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:27.209145    2570 patch_prober.go:28] interesting pod/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 15 11:43:27.209371 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:27.209202    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 15 11:43:27.823114 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:27.823076    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:28.168873 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:28.168785    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:28.209433 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:28.209400    2570 patch_prober.go:28] interesting pod/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 15 11:43:28.209635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:28.209467    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 15 11:43:28.750633 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:28.750596    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:29.208887 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:29.208850    2570 patch_prober.go:28] interesting pod/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 15 11:43:29.209283 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:29.208910    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 15 11:43:29.434390 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:29.434348    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:30.189888 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:30.189844    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:30.213594 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:30.213546    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:43:30.213973 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:30.213944    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:43:30.214608 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:30.214593    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:43:30.901486 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:30.901439    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:31.611432 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:31.611390    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:31.733441 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:31.733407    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:32.355717 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:32.355680    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:32.452585 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:32.452525    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:32.784774 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:32.784740    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:34.999413 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:34.999378    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:43:37.130179 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:37.130124    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:37.196162 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:37.196124    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:39.029529 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.029485    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:39.096060 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.096022    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:39.378180 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.378096    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"]
Sep 15 11:43:39.378528 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.378515    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy"
Sep 15 11:43:39.378589 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.378530    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy"
Sep 15 11:43:39.378589 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.378543    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy"
Sep 15 11:43:39.378589 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.378550    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy"
Sep 15 11:43:39.378693 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.378655    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy"
Sep 15 11:43:39.378693 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.378666    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1640b1eb-c469-4202-a632-d59dd4f0b107" containerName="istio-proxy"
Sep 15 11:43:39.382032 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.382015    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"
Sep 15 11:43:39.385494 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.385472    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2w6g9\""
Sep 15 11:43:39.385630 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.385472    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:43:39.391805 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.391780    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"]
Sep 15 11:43:39.504007 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.503967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a141630f-06b5-4794-aea4-c6358cc0811f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw\" (UID: \"a141630f-06b5-4794-aea4-c6358cc0811f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"
Sep 15 11:43:39.605065 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.605025    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a141630f-06b5-4794-aea4-c6358cc0811f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw\" (UID: \"a141630f-06b5-4794-aea4-c6358cc0811f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"
Sep 15 11:43:39.605740 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.605715    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a141630f-06b5-4794-aea4-c6358cc0811f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw\" (UID: \"a141630f-06b5-4794-aea4-c6358cc0811f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"
Sep 15 11:43:39.694243 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.694157    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"
Sep 15 11:43:39.966851 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:39.966821    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"]
Sep 15 11:43:39.968131 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:43:39.968104    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda141630f_06b5_4794_aea4_c6358cc0811f.slice/crio-8f806bdc32364c030c7c1f9dac56ecf10110ff7dc982f8003bcd3564273577f7 WatchSource:0}: Error finding container 8f806bdc32364c030c7c1f9dac56ecf10110ff7dc982f8003bcd3564273577f7: Status 404 returned error can't find the container with id 8f806bdc32364c030c7c1f9dac56ecf10110ff7dc982f8003bcd3564273577f7
Sep 15 11:43:40.108732 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:40.108699    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:40.172416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:40.172384    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw" event={"ID":"a141630f-06b5-4794-aea4-c6358cc0811f","Type":"ContainerStarted","Data":"8f806bdc32364c030c7c1f9dac56ecf10110ff7dc982f8003bcd3564273577f7"}
Sep 15 11:43:40.994483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:40.994382    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:41.180419 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:41.180379    2570 generic.go:356] "Generic (PLEG): container finished" podID="a141630f-06b5-4794-aea4-c6358cc0811f" containerID="a0789479f4ad1184ccc1947659d9a7c50e7279ebdf24e5a1579de23c86eaa8ea" exitCode=0
Sep 15 11:43:41.180851 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:41.180469    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw" event={"ID":"a141630f-06b5-4794-aea4-c6358cc0811f","Type":"ContainerDied","Data":"a0789479f4ad1184ccc1947659d9a7c50e7279ebdf24e5a1579de23c86eaa8ea"}
Sep 15 11:43:41.626375 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:41.626326    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:42.328587 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:42.328549    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"
Sep 15 11:43:42.393516 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:42.393487    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:42.437591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:42.437502    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a141630f-06b5-4794-aea4-c6358cc0811f-maas-api-service-ca\") pod \"a141630f-06b5-4794-aea4-c6358cc0811f\" (UID: \"a141630f-06b5-4794-aea4-c6358cc0811f\") "
Sep 15 11:43:42.437855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:42.437835    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a141630f-06b5-4794-aea4-c6358cc0811f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a141630f-06b5-4794-aea4-c6358cc0811f" (UID: "a141630f-06b5-4794-aea4-c6358cc0811f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:43:42.539283 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:42.539248    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a141630f-06b5-4794-aea4-c6358cc0811f-maas-api-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:43:43.080423 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:43.080316    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:43.193094 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:43.193066    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"
Sep 15 11:43:43.193258 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:43.193087    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw" event={"ID":"a141630f-06b5-4794-aea4-c6358cc0811f","Type":"ContainerDied","Data":"8f806bdc32364c030c7c1f9dac56ecf10110ff7dc982f8003bcd3564273577f7"}
Sep 15 11:43:43.193258 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:43.193135    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f806bdc32364c030c7c1f9dac56ecf10110ff7dc982f8003bcd3564273577f7"
Sep 15 11:43:43.900378 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:43.900345    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:49.968336 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:49.968295    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:50.073634 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:50.073590    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:50.242984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:50.242888    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:50.307242 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:50.307205    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"]
Sep 15 11:43:50.314979 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:50.314953    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-53d3db96-kpgxw"]
Sep 15 11:43:50.324673 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:50.324642    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:50.672474 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:50.672442    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:50.763916 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:50.763882    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:50.783033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:50.782999    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a141630f-06b5-4794-aea4-c6358cc0811f" path="/var/lib/kubelet/pods/a141630f-06b5-4794-aea4-c6358cc0811f/volumes"
Sep 15 11:43:51.443731 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:51.443695    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:52.298794 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:52.298759    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:53.115606 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:53.115553    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:53.787767 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:53.787729    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:56.470162 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:56.470132    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:56.532637 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:56.532601    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:56.703369 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:56.703334    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"]
Sep 15 11:43:56.703610 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:56.703573    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy" containerID="cri-o://27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48" gracePeriod=30
Sep 15 11:43:56.725279 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:56.725192    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:57.115848 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:57.115792    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:57.205947 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:57.205908    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:57.305530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:43:57.305491    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:00.216366 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:00.216324    2570 patch_prober.go:28] interesting pod/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 11:44:00.216799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:00.216452    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 11:44:00.483994 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:00.483908    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:44:01.762160 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:01.762125    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:01.958630 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:01.958602    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:44:02.038725 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.038698    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2148acc7-8931-4ded-8168-0c5063439503-istio-podinfo\") pod \"2148acc7-8931-4ded-8168-0c5063439503\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") "
Sep 15 11:44:02.038915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.038771    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-data\") pod \"2148acc7-8931-4ded-8168-0c5063439503\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") "
Sep 15 11:44:02.038915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.038787    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-credential-socket\") pod \"2148acc7-8931-4ded-8168-0c5063439503\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") "
Sep 15 11:44:02.038915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.038832    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-certs\") pod \"2148acc7-8931-4ded-8168-0c5063439503\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") "
Sep 15 11:44:02.038915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.038858    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-envoy\") pod \"2148acc7-8931-4ded-8168-0c5063439503\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") "
Sep 15 11:44:02.038915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.038885    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7xq5\" (UniqueName: \"kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-kube-api-access-w7xq5\") pod \"2148acc7-8931-4ded-8168-0c5063439503\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") "
Sep 15 11:44:02.039207 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.038951    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2148acc7-8931-4ded-8168-0c5063439503-istiod-ca-cert\") pod \"2148acc7-8931-4ded-8168-0c5063439503\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") "
Sep 15 11:44:02.039207 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039082    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-data" (OuterVolumeSpecName: "istio-data") pod "2148acc7-8931-4ded-8168-0c5063439503" (UID: "2148acc7-8931-4ded-8168-0c5063439503"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:44:02.039207 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039157    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2148acc7-8931-4ded-8168-0c5063439503" (UID: "2148acc7-8931-4ded-8168-0c5063439503"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:44:02.039207 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039175    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2148acc7-8931-4ded-8168-0c5063439503" (UID: "2148acc7-8931-4ded-8168-0c5063439503"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:44:02.039415 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039218    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-istio-token\") pod \"2148acc7-8931-4ded-8168-0c5063439503\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") "
Sep 15 11:44:02.039415 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039279    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-socket\") pod \"2148acc7-8931-4ded-8168-0c5063439503\" (UID: \"2148acc7-8931-4ded-8168-0c5063439503\") "
Sep 15 11:44:02.039415 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039356    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2148acc7-8931-4ded-8168-0c5063439503-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2148acc7-8931-4ded-8168-0c5063439503" (UID: "2148acc7-8931-4ded-8168-0c5063439503"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:44:02.039600 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039529    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2148acc7-8931-4ded-8168-0c5063439503" (UID: "2148acc7-8931-4ded-8168-0c5063439503"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:44:02.039778 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039759    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:02.039844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039788    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:02.039844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039803    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:02.039844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039818    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2148acc7-8931-4ded-8168-0c5063439503-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:02.039844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.039831    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:02.041039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.041002    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2148acc7-8931-4ded-8168-0c5063439503-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2148acc7-8931-4ded-8168-0c5063439503" (UID: "2148acc7-8931-4ded-8168-0c5063439503"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:44:02.041285 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.041267    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-istio-token" (OuterVolumeSpecName: "istio-token") pod "2148acc7-8931-4ded-8168-0c5063439503" (UID: "2148acc7-8931-4ded-8168-0c5063439503"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:44:02.041534 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.041514    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2148acc7-8931-4ded-8168-0c5063439503" (UID: "2148acc7-8931-4ded-8168-0c5063439503"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:44:02.041597 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.041519    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-kube-api-access-w7xq5" (OuterVolumeSpecName: "kube-api-access-w7xq5") pod "2148acc7-8931-4ded-8168-0c5063439503" (UID: "2148acc7-8931-4ded-8168-0c5063439503"). InnerVolumeSpecName "kube-api-access-w7xq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:44:02.140364 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.140314    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2148acc7-8931-4ded-8168-0c5063439503-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:02.140364 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.140356    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2148acc7-8931-4ded-8168-0c5063439503-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:02.140364 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.140372    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7xq5\" (UniqueName: \"kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-kube-api-access-w7xq5\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:02.140642 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.140382    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2148acc7-8931-4ded-8168-0c5063439503-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:02.321060 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.320959    2570 generic.go:356] "Generic (PLEG): container finished" podID="2148acc7-8931-4ded-8168-0c5063439503" containerID="27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48" exitCode=0
Sep 15 11:44:02.321060 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.321035    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"
Sep 15 11:44:02.321060 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.321036    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" event={"ID":"2148acc7-8931-4ded-8168-0c5063439503","Type":"ContainerDied","Data":"27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48"}
Sep 15 11:44:02.321274 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.321117    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp" event={"ID":"2148acc7-8931-4ded-8168-0c5063439503","Type":"ContainerDied","Data":"8aaed2d952d95b8499074fe702700f83d7d997ce2dd18d2a8deb9a3fcb5e7f2d"}
Sep 15 11:44:02.321274 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.321141    2570 scope.go:117] "RemoveContainer" containerID="27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48"
Sep 15 11:44:02.331925 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.331903    2570 scope.go:117] "RemoveContainer" containerID="dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58"
Sep 15 11:44:02.341765 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.341742    2570 scope.go:117] "RemoveContainer" containerID="27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48"
Sep 15 11:44:02.342070 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:44:02.342051    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48\": container with ID starting with 27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48 not found: ID does not exist" containerID="27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48"
Sep 15 11:44:02.342130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.342078    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48"} err="failed to get container status \"27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48\": rpc error: code = NotFound desc = could not find container \"27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48\": container with ID starting with 27ff5cfa45fe1d3db0fde4f71d49e271c20791837ebcd2331d43352e55d20e48 not found: ID does not exist"
Sep 15 11:44:02.342130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.342099    2570 scope.go:117] "RemoveContainer" containerID="dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58"
Sep 15 11:44:02.342366 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:44:02.342347    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58\": container with ID starting with dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58 not found: ID does not exist" containerID="dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58"
Sep 15 11:44:02.342408 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.342372    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58"} err="failed to get container status \"dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58\": rpc error: code = NotFound desc = could not find container \"dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58\": container with ID starting with dceee4d77e0d226c918b3e5322387092ed3e9161cf40fe36c5f8763709f86e58 not found: ID does not exist"
Sep 15 11:44:02.348199 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.348168    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"]
Sep 15 11:44:02.351448 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.351426    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp"]
Sep 15 11:44:02.780963 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.780930    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2148acc7-8931-4ded-8168-0c5063439503" path="/var/lib/kubelet/pods/2148acc7-8931-4ded-8168-0c5063439503/volumes"
Sep 15 11:44:02.976133 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:02.976101    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:03.040148 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:03.040043    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:03.122736 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:03.122698    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:03.223064 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:03.223030    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:03.322688 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:03.322582    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:04.751499 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:04.751465    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:05.688621 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:05.688588    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:06.499700 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:06.499661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:09.446378 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:09.446346    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:09.547572 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:09.547517    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:10.320404 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.320362    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:10.597985 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.597902    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"]
Sep 15 11:44:10.598409 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.598328    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy"
Sep 15 11:44:10.598409 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.598341    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy"
Sep 15 11:44:10.598409 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.598365    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a141630f-06b5-4794-aea4-c6358cc0811f" containerName="revoke-keys"
Sep 15 11:44:10.598409 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.598371    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a141630f-06b5-4794-aea4-c6358cc0811f" containerName="revoke-keys"
Sep 15 11:44:10.598650 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.598433    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a141630f-06b5-4794-aea4-c6358cc0811f" containerName="revoke-keys"
Sep 15 11:44:10.598650 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.598441    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy"
Sep 15 11:44:10.598650 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.598448    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy"
Sep 15 11:44:10.603132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.603111    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.605647 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.605623    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-01611d-openshift-default-dockercfg-sxd7v\""
Sep 15 11:44:10.610730 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.610705    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:10.612605 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.612584    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"]
Sep 15 11:44:10.730586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.730537    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-istio-token\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.730954 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.730932    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f41e208-08da-4777-8196-15c3e87f151b-istiod-ca-cert\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.731157 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.731138    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lns8r\" (UniqueName: \"kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-kube-api-access-lns8r\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.731417 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.731396    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-certs\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.731615 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.731597    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-envoy\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.731756 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.731739    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-credential-socket\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.731938 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.731922    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f41e208-08da-4777-8196-15c3e87f151b-istio-podinfo\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.732099 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.732084    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-data\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.732226 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.732212    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-socket\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.800259 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.800209    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:10.833542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.833499    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-socket\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.833542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.833550    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-istio-token\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.833799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.833608    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f41e208-08da-4777-8196-15c3e87f151b-istiod-ca-cert\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.833799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.833632    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lns8r\" (UniqueName: \"kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-kube-api-access-lns8r\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.833799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.833735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-certs\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.833799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.833787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-envoy\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.833949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.833819    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-credential-socket\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.833949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.833844    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f41e208-08da-4777-8196-15c3e87f151b-istio-podinfo\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.833949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.833877    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-data\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.834091 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.833947    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-socket\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.834269 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.834236    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-credential-socket\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.834394 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.834286    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-certs\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.834394 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.834384    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f41e208-08da-4777-8196-15c3e87f151b-istiod-ca-cert\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.834476 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.834389    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-data\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.836105 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.836079    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-envoy\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.836531 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.836510    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f41e208-08da-4777-8196-15c3e87f151b-istio-podinfo\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.842507 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.842481    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-istio-token\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.842778 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.842756    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lns8r\" (UniqueName: \"kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-kube-api-access-lns8r\") pod \"e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") " pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:10.916290 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:10.916205    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:11.193432 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:11.193403    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"]
Sep 15 11:44:11.194396 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:44:11.194370    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f41e208_08da_4777_8196_15c3e87f151b.slice/crio-50fbfa5912428d53f1095e0fdd631185ef8fc0356b35830ccec75be0ff54f5d8 WatchSource:0}: Error finding container 50fbfa5912428d53f1095e0fdd631185ef8fc0356b35830ccec75be0ff54f5d8: Status 404 returned error can't find the container with id 50fbfa5912428d53f1095e0fdd631185ef8fc0356b35830ccec75be0ff54f5d8
Sep 15 11:44:11.196665 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:11.196632    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:44:11.196750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:11.196697    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:44:11.196750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:11.196726    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:44:11.390398 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:11.390355    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" event={"ID":"8f41e208-08da-4777-8196-15c3e87f151b","Type":"ContainerStarted","Data":"9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4"}
Sep 15 11:44:11.390583 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:11.390453    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" event={"ID":"8f41e208-08da-4777-8196-15c3e87f151b","Type":"ContainerStarted","Data":"50fbfa5912428d53f1095e0fdd631185ef8fc0356b35830ccec75be0ff54f5d8"}
Sep 15 11:44:11.411156 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:11.411109    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" podStartSLOduration=1.4110951680000001 podStartE2EDuration="1.411095168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:11.408764187 +0000 UTC m=+1153.165010567" watchObservedRunningTime="2026-09-15 11:44:11.411095168 +0000 UTC m=+1153.167341546"
Sep 15 11:44:11.917087 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:11.917033    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:12.607896 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:12.607862    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:12.922236 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:12.922161    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:13.277789 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:13.277755    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:13.403827 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:13.403793    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:13.404664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:13.404638    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:13.433058 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:13.433011    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:13.618358 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:13.618262    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:14.300575 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:14.300534    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:15.223884 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:15.223845    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:15.949722 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:15.949684    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:16.657330 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:16.657265    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:16.757079 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:16.757037    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:16.970896 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:16.970794    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:17.156964 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:17.156931    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:17.258158 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:17.258058    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:22.055439 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.055350    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:22.616487 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.616447    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"]
Sep 15 11:44:22.616911 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.616897    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy"
Sep 15 11:44:22.616911 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.616912    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2148acc7-8931-4ded-8168-0c5063439503" containerName="istio-proxy"
Sep 15 11:44:22.620278 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.620262    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"
Sep 15 11:44:22.622908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.622885    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2w6g9\""
Sep 15 11:44:22.623006 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.622885    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:44:22.629633 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.629605    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"]
Sep 15 11:44:22.763754 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.763713    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/854c392c-6e95-404e-b094-fa1dc5ab08ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw\" (UID: \"854c392c-6e95-404e-b094-fa1dc5ab08ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"
Sep 15 11:44:22.864862 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.864790    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/854c392c-6e95-404e-b094-fa1dc5ab08ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw\" (UID: \"854c392c-6e95-404e-b094-fa1dc5ab08ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"
Sep 15 11:44:22.865678 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.865643    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/854c392c-6e95-404e-b094-fa1dc5ab08ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw\" (UID: \"854c392c-6e95-404e-b094-fa1dc5ab08ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"
Sep 15 11:44:22.907788 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.907674    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:22.933476 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:22.933442    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"
Sep 15 11:44:23.235511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:23.235476    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"]
Sep 15 11:44:23.237213 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:44:23.237184    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854c392c_6e95_404e_b094_fa1dc5ab08ae.slice/crio-50c478882e7357a5a4f631fc46b7bdd8fc2f7a26fbd5f805c25536e3d709cc8a WatchSource:0}: Error finding container 50c478882e7357a5a4f631fc46b7bdd8fc2f7a26fbd5f805c25536e3d709cc8a: Status 404 returned error can't find the container with id 50c478882e7357a5a4f631fc46b7bdd8fc2f7a26fbd5f805c25536e3d709cc8a
Sep 15 11:44:23.470554 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:23.470518    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw" event={"ID":"854c392c-6e95-404e-b094-fa1dc5ab08ae","Type":"ContainerStarted","Data":"50c478882e7357a5a4f631fc46b7bdd8fc2f7a26fbd5f805c25536e3d709cc8a"}
Sep 15 11:44:24.017772 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:24.017738    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:24.478126 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:24.478089    2570 generic.go:356] "Generic (PLEG): container finished" podID="854c392c-6e95-404e-b094-fa1dc5ab08ae" containerID="2e62fd459c871d5bca1ce42bfc715a1f76e79351d8cc395376f09f21eac25382" exitCode=0
Sep 15 11:44:24.478527 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:24.478173    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw" event={"ID":"854c392c-6e95-404e-b094-fa1dc5ab08ae","Type":"ContainerDied","Data":"2e62fd459c871d5bca1ce42bfc715a1f76e79351d8cc395376f09f21eac25382"}
Sep 15 11:44:24.708410 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:24.708372    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:25.606306 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:25.606156    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:25.623367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:25.623347    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"
Sep 15 11:44:25.796707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:25.796674    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/854c392c-6e95-404e-b094-fa1dc5ab08ae-maas-api-service-ca\") pod \"854c392c-6e95-404e-b094-fa1dc5ab08ae\" (UID: \"854c392c-6e95-404e-b094-fa1dc5ab08ae\") "
Sep 15 11:44:25.796989 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:25.796968    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/854c392c-6e95-404e-b094-fa1dc5ab08ae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "854c392c-6e95-404e-b094-fa1dc5ab08ae" (UID: "854c392c-6e95-404e-b094-fa1dc5ab08ae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:44:25.898328 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:25.898298    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/854c392c-6e95-404e-b094-fa1dc5ab08ae-maas-api-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:26.302496 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:26.302453    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:26.493322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:26.493292    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw" event={"ID":"854c392c-6e95-404e-b094-fa1dc5ab08ae","Type":"ContainerDied","Data":"50c478882e7357a5a4f631fc46b7bdd8fc2f7a26fbd5f805c25536e3d709cc8a"}
Sep 15 11:44:26.493322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:26.493311    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"
Sep 15 11:44:26.493542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:26.493365    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50c478882e7357a5a4f631fc46b7bdd8fc2f7a26fbd5f805c25536e3d709cc8a"
Sep 15 11:44:27.170327 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:27.170297    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:27.850527 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:27.850488    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:27.985801 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:27.985769    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:28.311384 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.311350    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:28.577015 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.576926    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:28.606632 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.606600    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"]
Sep 15 11:44:28.607065 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.607050    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854c392c-6e95-404e-b094-fa1dc5ab08ae" containerName="revoke-keys"
Sep 15 11:44:28.607153 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.607066    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="854c392c-6e95-404e-b094-fa1dc5ab08ae" containerName="revoke-keys"
Sep 15 11:44:28.607153 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.607151    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="854c392c-6e95-404e-b094-fa1dc5ab08ae" containerName="revoke-keys"
Sep 15 11:44:28.610144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.610125    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.613745 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.613721    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-4dbbbf-openshift-default-dockercfg-tpm8z\""
Sep 15 11:44:28.623683 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.623657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-token\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.623824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.623704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-podinfo\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.623824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.623737    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-credential-socket\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.623824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.623759    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-envoy\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.623824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.623817    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-certs\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.624038 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.623854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd05048f-54ff-48a2-9709-23bdc199d38b-istiod-ca-cert\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.624038 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.623902    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njw8z\" (UniqueName: \"kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-kube-api-access-njw8z\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.624038 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.624012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-socket\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.624252 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.624061    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-data\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.624456 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.624431    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"]
Sep 15 11:44:28.678096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.678062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:28.725429 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.725400    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd05048f-54ff-48a2-9709-23bdc199d38b-istiod-ca-cert\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.725631 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.725461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njw8z\" (UniqueName: \"kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-kube-api-access-njw8z\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.725631 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.725586    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-socket\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.725772 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.725635    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-data\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.725772 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.725663    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-token\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.725772 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.725705    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-podinfo\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.725772 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.725739    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-credential-socket\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.725772 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.725763    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-envoy\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.726028 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.725837    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-certs\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.726095 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.726045    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-data\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.726191 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.726168    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd05048f-54ff-48a2-9709-23bdc199d38b-istiod-ca-cert\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.726257 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.726194    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-socket\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.726257 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.726206    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-certs\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.726384 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.726322    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-credential-socket\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.728239 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.728217    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-envoy\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.728473 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.728454    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-podinfo\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.735217 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.735192    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-token\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.735351 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.735334    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njw8z\" (UniqueName: \"kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-kube-api-access-njw8z\") pod \"e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") " pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:28.778630 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.778599    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:28.922483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:28.922388    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:29.214852 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:29.214820    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"]
Sep 15 11:44:29.215647 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:44:29.215621    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd05048f_54ff_48a2_9709_23bdc199d38b.slice/crio-fca74c79d2e65ab979dc3ac924953486f23e59d4c0c60f81753dfedf0d20fbd4 WatchSource:0}: Error finding container fca74c79d2e65ab979dc3ac924953486f23e59d4c0c60f81753dfedf0d20fbd4: Status 404 returned error can't find the container with id fca74c79d2e65ab979dc3ac924953486f23e59d4c0c60f81753dfedf0d20fbd4
Sep 15 11:44:29.218437 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:29.218401    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:44:29.218538 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:29.218487    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:44:29.218628 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:29.218533    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:44:29.303845 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:29.303806    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:29.515192 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:29.515157    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" event={"ID":"bd05048f-54ff-48a2-9709-23bdc199d38b","Type":"ContainerStarted","Data":"88349d5b1d64560880f3174d019681994a3b2af3a8924afe357635f9b1cb72cc"}
Sep 15 11:44:29.515590 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:29.515217    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" event={"ID":"bd05048f-54ff-48a2-9709-23bdc199d38b","Type":"ContainerStarted","Data":"fca74c79d2e65ab979dc3ac924953486f23e59d4c0c60f81753dfedf0d20fbd4"}
Sep 15 11:44:29.547946 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:29.547885    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" podStartSLOduration=1.54786304 podStartE2EDuration="1.54786304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:29.543781714 +0000 UTC m=+1171.300028110" watchObservedRunningTime="2026-09-15 11:44:29.54786304 +0000 UTC m=+1171.304109420"
Sep 15 11:44:29.923011 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:29.922915    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:29.990623 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:29.990590    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:44:30.125305 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:30.125271    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:30.896429 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:30.896389    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:30.928277 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:30.928254    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:31.436094 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:31.435994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:31.528957 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:31.528923    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:31.530005 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:31.529979    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:44:31.532587 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:31.532548    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:31.775111 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:31.775080    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:32.503880 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:32.503845    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:33.111427 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:33.111399    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:33.179437 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:33.179402    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:33.257141 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:33.257098    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:33.390012 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:33.389929    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:33.419087 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:33.419058    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"]
Sep 15 11:44:33.432571 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:33.432515    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0eb0ef-dhjkw"]
Sep 15 11:44:33.479085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:33.479044    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:33.580710 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:33.580682    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:33.732789 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:33.732681    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:34.401626 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:34.401594    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:34.781014 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:34.780983    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="854c392c-6e95-404e-b094-fa1dc5ab08ae" path="/var/lib/kubelet/pods/854c392c-6e95-404e-b094-fa1dc5ab08ae/volumes"
Sep 15 11:44:35.205932 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:35.205844    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:35.306240 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:35.306203    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:35.365228 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:35.365174    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:35.692809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:35.692770    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:35.776650 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:35.776613    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:36.104822 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:36.104779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:36.828690 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:36.828653    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:37.617477 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:37.617444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:38.252891 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:38.252853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:38.721733 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:38.721694    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"]
Sep 15 11:44:38.813254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:38.813209    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:39.095203 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:39.095156    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:41.612788 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:41.612733    2570 generic.go:356] "Generic (PLEG): container finished" podID="8f41e208-08da-4777-8196-15c3e87f151b" containerID="9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4" exitCode=0
Sep 15 11:44:41.613331 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:41.612815    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" event={"ID":"8f41e208-08da-4777-8196-15c3e87f151b","Type":"ContainerDied","Data":"9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4"}
Sep 15 11:44:41.613331 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:41.613307    2570 scope.go:117] "RemoveContainer" containerID="9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4"
Sep 15 11:44:41.614472 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:41.614438    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:44:41.614586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:41.614507    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:44:41.614586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:41.614537    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:44:42.621081 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:42.621046    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" event={"ID":"8f41e208-08da-4777-8196-15c3e87f151b","Type":"ContainerStarted","Data":"d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a"}
Sep 15 11:44:42.917218 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:42.917130    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:42.918143 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:42.918120    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 15 11:44:42.918200 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:42.918169    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 15 11:44:43.404154 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:43.404120    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:43.917422 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:43.917380    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 15 11:44:43.917917 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:43.917449    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 15 11:44:44.917259 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:44.917218    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 15 11:44:44.917447 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:44.917293    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 15 11:44:45.917283 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:45.917243    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 15 11:44:45.917473 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:45.917302    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 15 11:44:46.916626 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:46.916587    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 15 11:44:46.916806 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:46.916666    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 15 11:44:47.921286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:47.921251    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:47.922525 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:47.922504    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:44:53.741724 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:53.741655    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw" podUID="653caadc-51cd-47c2-aef8-a09d13e241ac" containerName="main" containerID="cri-o://48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587" gracePeriod=45
Sep 15 11:44:54.034585 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.025033    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:44:54.139582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.138950    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653caadc-51cd-47c2-aef8-a09d13e241ac-tls-certs\") pod \"653caadc-51cd-47c2-aef8-a09d13e241ac\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") "
Sep 15 11:44:54.139582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.139111    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-model-cache\") pod \"653caadc-51cd-47c2-aef8-a09d13e241ac\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") "
Sep 15 11:44:54.139582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.139148    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-home\") pod \"653caadc-51cd-47c2-aef8-a09d13e241ac\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") "
Sep 15 11:44:54.139582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.139196    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-tmp-dir\") pod \"653caadc-51cd-47c2-aef8-a09d13e241ac\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") "
Sep 15 11:44:54.139582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.139226    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tb54z\" (UniqueName: \"kubernetes.io/projected/653caadc-51cd-47c2-aef8-a09d13e241ac-kube-api-access-tb54z\") pod \"653caadc-51cd-47c2-aef8-a09d13e241ac\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") "
Sep 15 11:44:54.139582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.139291    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-dshm\") pod \"653caadc-51cd-47c2-aef8-a09d13e241ac\" (UID: \"653caadc-51cd-47c2-aef8-a09d13e241ac\") "
Sep 15 11:44:54.140405 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.140214    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-home" (OuterVolumeSpecName: "home") pod "653caadc-51cd-47c2-aef8-a09d13e241ac" (UID: "653caadc-51cd-47c2-aef8-a09d13e241ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:44:54.140405 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.140388    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "653caadc-51cd-47c2-aef8-a09d13e241ac" (UID: "653caadc-51cd-47c2-aef8-a09d13e241ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:44:54.140727 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.140691    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "653caadc-51cd-47c2-aef8-a09d13e241ac" (UID: "653caadc-51cd-47c2-aef8-a09d13e241ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:44:54.142968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.142942    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653caadc-51cd-47c2-aef8-a09d13e241ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "653caadc-51cd-47c2-aef8-a09d13e241ac" (UID: "653caadc-51cd-47c2-aef8-a09d13e241ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:44:54.149582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.147050    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/653caadc-51cd-47c2-aef8-a09d13e241ac-kube-api-access-tb54z" (OuterVolumeSpecName: "kube-api-access-tb54z") pod "653caadc-51cd-47c2-aef8-a09d13e241ac" (UID: "653caadc-51cd-47c2-aef8-a09d13e241ac"). InnerVolumeSpecName "kube-api-access-tb54z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:44:54.149582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.147982    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-dshm" (OuterVolumeSpecName: "dshm") pod "653caadc-51cd-47c2-aef8-a09d13e241ac" (UID: "653caadc-51cd-47c2-aef8-a09d13e241ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:44:54.241020 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.240895    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-tmp-dir\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:54.241020 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.240939    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tb54z\" (UniqueName: \"kubernetes.io/projected/653caadc-51cd-47c2-aef8-a09d13e241ac-kube-api-access-tb54z\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:54.241020 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.240955    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-dshm\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:54.241020 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.240969    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653caadc-51cd-47c2-aef8-a09d13e241ac-tls-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:54.241020 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.240981    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-model-cache\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:54.241020 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.240993    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653caadc-51cd-47c2-aef8-a09d13e241ac-home\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:44:54.712858 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.712816    2570 generic.go:356] "Generic (PLEG): container finished" podID="653caadc-51cd-47c2-aef8-a09d13e241ac" containerID="48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587" exitCode=0
Sep 15 11:44:54.713070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.712861    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"
Sep 15 11:44:54.713070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.712889    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw" event={"ID":"653caadc-51cd-47c2-aef8-a09d13e241ac","Type":"ContainerDied","Data":"48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587"}
Sep 15 11:44:54.713070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.712925    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw" event={"ID":"653caadc-51cd-47c2-aef8-a09d13e241ac","Type":"ContainerDied","Data":"80e26e304e0ec9b9a818b6aaa324f4c2376d658e7fffedc470945dbb5f840f36"}
Sep 15 11:44:54.713070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.712945    2570 scope.go:117] "RemoveContainer" containerID="48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587"
Sep 15 11:44:54.724530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.724509    2570 scope.go:117] "RemoveContainer" containerID="48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587"
Sep 15 11:44:54.725195 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:44:54.725062    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587\": container with ID starting with 48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587 not found: ID does not exist" containerID="48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587"
Sep 15 11:44:54.725195 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.725103    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587"} err="failed to get container status \"48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587\": rpc error: code = NotFound desc = could not find container \"48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587\": container with ID starting with 48ba1d1c17594331b4df13cc33d38c79a1ce89555b3c0f9c30149b3137af8587 not found: ID does not exist"
Sep 15 11:44:54.740147 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.740106    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"]
Sep 15 11:44:54.752691 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.752652    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-0eb0ef/test-model-0eb0ef-kserve-6d4c794f9c-2pgmw"]
Sep 15 11:44:54.780673 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:54.780646    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="653caadc-51cd-47c2-aef8-a09d13e241ac" path="/var/lib/kubelet/pods/653caadc-51cd-47c2-aef8-a09d13e241ac/volumes"
Sep 15 11:44:57.079044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:57.079002    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:57.805683 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:57.805646    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:58.474747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:58.474707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:59.220700 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:59.220602    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:59.838078 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:44:59.838031    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:00.157799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.157685    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k"]
Sep 15 11:45:00.158160 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.158145    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653caadc-51cd-47c2-aef8-a09d13e241ac" containerName="main"
Sep 15 11:45:00.158225 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.158161    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="653caadc-51cd-47c2-aef8-a09d13e241ac" containerName="main"
Sep 15 11:45:00.158283 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.158235    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="653caadc-51cd-47c2-aef8-a09d13e241ac" containerName="main"
Sep 15 11:45:00.162548 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.162527    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll"]
Sep 15 11:45:00.162711 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.162648    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k"
Sep 15 11:45:00.165831 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.165808    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng"]
Sep 15 11:45:00.165966 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.165943    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll"
Sep 15 11:45:00.166036 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.165946    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2w6g9\""
Sep 15 11:45:00.169268 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.169248    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng"
Sep 15 11:45:00.174998 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.174843    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k"
Sep 15 11:45:00.181655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.181634    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll"]
Sep 15 11:45:00.185433 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.185374    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng"]
Sep 15 11:45:00.186456 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.186437    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll"
Sep 15 11:45:00.191106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.190631    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k"]
Sep 15 11:45:00.243169 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.242960    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng"
Sep 15 11:45:00.478237 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.478207    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k"]
Sep 15 11:45:00.479158 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:45:00.479130    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02cbaba6_af62_4681_a9e5_3b77aa539dd1.slice/crio-5b8d2a530993e417b6dc6f77077be0ce939659882872a526f964793aee776593 WatchSource:0}: Error finding container 5b8d2a530993e417b6dc6f77077be0ce939659882872a526f964793aee776593: Status 404 returned error can't find the container with id 5b8d2a530993e417b6dc6f77077be0ce939659882872a526f964793aee776593
Sep 15 11:45:00.520174 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.520145    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll"]
Sep 15 11:45:00.559723 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.559696    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng"]
Sep 15 11:45:00.565949 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:45:00.565925    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201f9d53_22cc_4bae_9e14_cbc407d88992.slice/crio-9791abb4011fa2b2941a0c8219952a0a5c74048a2c2c4f854fc5e82055313a4a WatchSource:0}: Error finding container 9791abb4011fa2b2941a0c8219952a0a5c74048a2c2c4f854fc5e82055313a4a: Status 404 returned error can't find the container with id 9791abb4011fa2b2941a0c8219952a0a5c74048a2c2c4f854fc5e82055313a4a
Sep 15 11:45:00.693793 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.693756    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:00.785394 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.785347    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k" event={"ID":"02cbaba6-af62-4681-a9e5-3b77aa539dd1","Type":"ContainerStarted","Data":"2bd38b3461f02ce9f9615009bbe58ff19020b26f51bcd5a015656c760b7fb40c"}
Sep 15 11:45:00.785596 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.785413    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k" event={"ID":"02cbaba6-af62-4681-a9e5-3b77aa539dd1","Type":"ContainerStarted","Data":"5b8d2a530993e417b6dc6f77077be0ce939659882872a526f964793aee776593"}
Sep 15 11:45:00.786915 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.786883    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll" event={"ID":"521711a5-bb31-43fd-bf34-ebc51c5e8287","Type":"ContainerStarted","Data":"e802d1870aca1da282081cd17f505008db6b1c46b539593ef3558e97b5c3e666"}
Sep 15 11:45:00.788297 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.788271    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng" event={"ID":"201f9d53-22cc-4bae-9e14-cbc407d88992","Type":"ContainerStarted","Data":"9791abb4011fa2b2941a0c8219952a0a5c74048a2c2c4f854fc5e82055313a4a"}
Sep 15 11:45:00.805853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:00.805808    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k" podStartSLOduration=0.805792192 podStartE2EDuration="805.792192ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:00.804832864 +0000 UTC m=+1202.561079246" watchObservedRunningTime="2026-09-15 11:45:00.805792192 +0000 UTC m=+1202.562038570"
Sep 15 11:45:01.445919 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:01.445886    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:01.798036 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:01.798003    2570 generic.go:356] "Generic (PLEG): container finished" podID="02cbaba6-af62-4681-a9e5-3b77aa539dd1" containerID="2bd38b3461f02ce9f9615009bbe58ff19020b26f51bcd5a015656c760b7fb40c" exitCode=0
Sep 15 11:45:01.798196 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:01.798085    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k" event={"ID":"02cbaba6-af62-4681-a9e5-3b77aa539dd1","Type":"ContainerDied","Data":"2bd38b3461f02ce9f9615009bbe58ff19020b26f51bcd5a015656c760b7fb40c"}
Sep 15 11:45:01.799910 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:01.799888    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll" event={"ID":"521711a5-bb31-43fd-bf34-ebc51c5e8287","Type":"ContainerStarted","Data":"ae72768c166968307a7333e1f5b48ad0f082e72a43b37c38f24a2bcb8ba7d634"}
Sep 15 11:45:01.801632 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:01.801596    2570 generic.go:356] "Generic (PLEG): container finished" podID="201f9d53-22cc-4bae-9e14-cbc407d88992" containerID="1d4daa7f39d07c8dae69e16df1d176755b1780e687a6e94d1f06979dd48ad7c2" exitCode=0
Sep 15 11:45:01.801732 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:01.801680    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng" event={"ID":"201f9d53-22cc-4bae-9e14-cbc407d88992","Type":"ContainerDied","Data":"1d4daa7f39d07c8dae69e16df1d176755b1780e687a6e94d1f06979dd48ad7c2"}
Sep 15 11:45:01.837177 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:01.837126    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll" podStartSLOduration=1.837106775 podStartE2EDuration="1.837106775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:01.833315794 +0000 UTC m=+1203.589562175" watchObservedRunningTime="2026-09-15 11:45:01.837106775 +0000 UTC m=+1203.593353155"
Sep 15 11:45:02.150602 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.150496    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7476-10d483"]
Sep 15 11:45:02.154253 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.154232    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-10d483"
Sep 15 11:45:02.157085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.157060    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lrtt7\""
Sep 15 11:45:02.162012 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.161990    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-10d483"]
Sep 15 11:45:02.245694 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.245655    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mjl8\" (UniqueName: \"kubernetes.io/projected/3393f9fd-1344-440d-ac25-25a9ea5f7d93-kube-api-access-7mjl8\") pod \"test-curl-7476-10d483\" (UID: \"3393f9fd-1344-440d-ac25-25a9ea5f7d93\") " pod="opendatahub/test-curl-7476-10d483"
Sep 15 11:45:02.346641 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.346596    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mjl8\" (UniqueName: \"kubernetes.io/projected/3393f9fd-1344-440d-ac25-25a9ea5f7d93-kube-api-access-7mjl8\") pod \"test-curl-7476-10d483\" (UID: \"3393f9fd-1344-440d-ac25-25a9ea5f7d93\") " pod="opendatahub/test-curl-7476-10d483"
Sep 15 11:45:02.355060 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.355036    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mjl8\" (UniqueName: \"kubernetes.io/projected/3393f9fd-1344-440d-ac25-25a9ea5f7d93-kube-api-access-7mjl8\") pod \"test-curl-7476-10d483\" (UID: \"3393f9fd-1344-440d-ac25-25a9ea5f7d93\") " pod="opendatahub/test-curl-7476-10d483"
Sep 15 11:45:02.467600 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.467504    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-10d483"
Sep 15 11:45:02.574740 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.574702    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 11:45:02.574930 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.574783    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 11:45:02.742101 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.742069    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-10d483"]
Sep 15 11:45:02.743268 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:45:02.743237    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3393f9fd_1344_440d_ac25_25a9ea5f7d93.slice/crio-0f0b066a3c2b9c055422a81428c3de05510b4e2d5d99922b64d84f973f4e09d2 WatchSource:0}: Error finding container 0f0b066a3c2b9c055422a81428c3de05510b4e2d5d99922b64d84f973f4e09d2: Status 404 returned error can't find the container with id 0f0b066a3c2b9c055422a81428c3de05510b4e2d5d99922b64d84f973f4e09d2
Sep 15 11:45:02.809976 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.809947    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-10d483" event={"ID":"3393f9fd-1344-440d-ac25-25a9ea5f7d93","Type":"ContainerStarted","Data":"0f0b066a3c2b9c055422a81428c3de05510b4e2d5d99922b64d84f973f4e09d2"}
Sep 15 11:45:02.811529 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.811506    2570 generic.go:356] "Generic (PLEG): container finished" podID="521711a5-bb31-43fd-bf34-ebc51c5e8287" containerID="ae72768c166968307a7333e1f5b48ad0f082e72a43b37c38f24a2bcb8ba7d634" exitCode=0
Sep 15 11:45:02.811641 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.811607    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll" event={"ID":"521711a5-bb31-43fd-bf34-ebc51c5e8287","Type":"ContainerDied","Data":"ae72768c166968307a7333e1f5b48ad0f082e72a43b37c38f24a2bcb8ba7d634"}
Sep 15 11:45:02.813421 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.813402    2570 generic.go:356] "Generic (PLEG): container finished" podID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerID="88349d5b1d64560880f3174d019681994a3b2af3a8924afe357635f9b1cb72cc" exitCode=0
Sep 15 11:45:02.813509 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.813476    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" event={"ID":"bd05048f-54ff-48a2-9709-23bdc199d38b","Type":"ContainerDied","Data":"88349d5b1d64560880f3174d019681994a3b2af3a8924afe357635f9b1cb72cc"}
Sep 15 11:45:02.814040 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.813953    2570 scope.go:117] "RemoveContainer" containerID="88349d5b1d64560880f3174d019681994a3b2af3a8924afe357635f9b1cb72cc"
Sep 15 11:45:02.815263 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.815231    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:45:02.815369 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.815302    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:45:02.815369 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.815336    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:45:02.993635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:02.989747    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k"
Sep 15 11:45:03.032575 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.032536    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng"
Sep 15 11:45:03.402734 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.402699    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:45:03.821992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.821964    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng"
Sep 15 11:45:03.822422 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.821996    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng" event={"ID":"201f9d53-22cc-4bae-9e14-cbc407d88992","Type":"ContainerDied","Data":"9791abb4011fa2b2941a0c8219952a0a5c74048a2c2c4f854fc5e82055313a4a"}
Sep 15 11:45:03.822422 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.822047    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9791abb4011fa2b2941a0c8219952a0a5c74048a2c2c4f854fc5e82055313a4a"
Sep 15 11:45:03.824856 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.824822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" event={"ID":"bd05048f-54ff-48a2-9709-23bdc199d38b","Type":"ContainerStarted","Data":"82c4c2ce509189cc85708b9fc6c3229deb37ebb07754aeb126e7e0ce992f4f45"}
Sep 15 11:45:03.828270 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.828243    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-10d483" event={"ID":"3393f9fd-1344-440d-ac25-25a9ea5f7d93","Type":"ContainerStarted","Data":"4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca"}
Sep 15 11:45:03.831509 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.831470    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k"
Sep 15 11:45:03.834633 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.834600    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k" event={"ID":"02cbaba6-af62-4681-a9e5-3b77aa539dd1","Type":"ContainerDied","Data":"5b8d2a530993e417b6dc6f77077be0ce939659882872a526f964793aee776593"}
Sep 15 11:45:03.834761 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.834656    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b8d2a530993e417b6dc6f77077be0ce939659882872a526f964793aee776593"
Sep 15 11:45:03.871069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.871017    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7476-10d483" podStartSLOduration=1.871000189 podStartE2EDuration="1.871000189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:03.869752542 +0000 UTC m=+1205.625998920" watchObservedRunningTime="2026-09-15 11:45:03.871000189 +0000 UTC m=+1205.627246568"
Sep 15 11:45:03.933583 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.927962    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 15 11:45:03.933583 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.928029    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 15 11:45:03.933583 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.928329    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:45:03.994193 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:03.994164    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:04.019277 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.019257    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll"
Sep 15 11:45:04.501679 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.501637    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7476-10d483"]
Sep 15 11:45:04.505605 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.505579    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7476-10d483"]
Sep 15 11:45:04.614368 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614287    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7476-765830"]
Sep 15 11:45:04.614784 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614770    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02cbaba6-af62-4681-a9e5-3b77aa539dd1" containerName="cleanup"
Sep 15 11:45:04.614842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614786    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="02cbaba6-af62-4681-a9e5-3b77aa539dd1" containerName="cleanup"
Sep 15 11:45:04.614842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614798    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="201f9d53-22cc-4bae-9e14-cbc407d88992" containerName="cleanup"
Sep 15 11:45:04.614842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614803    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="201f9d53-22cc-4bae-9e14-cbc407d88992" containerName="cleanup"
Sep 15 11:45:04.614842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614821    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3393f9fd-1344-440d-ac25-25a9ea5f7d93" containerName="test-curl-7476-10d483"
Sep 15 11:45:04.614842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614828    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3393f9fd-1344-440d-ac25-25a9ea5f7d93" containerName="test-curl-7476-10d483"
Sep 15 11:45:04.614992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614852    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="521711a5-bb31-43fd-bf34-ebc51c5e8287" containerName="cleanup"
Sep 15 11:45:04.614992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614858    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="521711a5-bb31-43fd-bf34-ebc51c5e8287" containerName="cleanup"
Sep 15 11:45:04.614992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614919    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3393f9fd-1344-440d-ac25-25a9ea5f7d93" containerName="test-curl-7476-10d483"
Sep 15 11:45:04.614992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614927    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="02cbaba6-af62-4681-a9e5-3b77aa539dd1" containerName="cleanup"
Sep 15 11:45:04.614992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614935    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="201f9d53-22cc-4bae-9e14-cbc407d88992" containerName="cleanup"
Sep 15 11:45:04.614992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.614943    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="521711a5-bb31-43fd-bf34-ebc51c5e8287" containerName="cleanup"
Sep 15 11:45:04.618165 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.618140    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-765830"
Sep 15 11:45:04.653636 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.647609    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-765830"]
Sep 15 11:45:04.669666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.669641    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfjkd\" (UniqueName: \"kubernetes.io/projected/048e7f39-cd20-485d-80c2-52198a8b2a6e-kube-api-access-rfjkd\") pod \"test-curl-7476-765830\" (UID: \"048e7f39-cd20-485d-80c2-52198a8b2a6e\") " pod="opendatahub/test-curl-7476-765830"
Sep 15 11:45:04.770354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.770325    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjkd\" (UniqueName: \"kubernetes.io/projected/048e7f39-cd20-485d-80c2-52198a8b2a6e-kube-api-access-rfjkd\") pod \"test-curl-7476-765830\" (UID: \"048e7f39-cd20-485d-80c2-52198a8b2a6e\") " pod="opendatahub/test-curl-7476-765830"
Sep 15 11:45:04.786801 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.786103    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfjkd\" (UniqueName: \"kubernetes.io/projected/048e7f39-cd20-485d-80c2-52198a8b2a6e-kube-api-access-rfjkd\") pod \"test-curl-7476-765830\" (UID: \"048e7f39-cd20-485d-80c2-52198a8b2a6e\") " pod="opendatahub/test-curl-7476-765830"
Sep 15 11:45:04.847681 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.847646    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll"
Sep 15 11:45:04.848144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.848090    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll" event={"ID":"521711a5-bb31-43fd-bf34-ebc51c5e8287","Type":"ContainerDied","Data":"e802d1870aca1da282081cd17f505008db6b1c46b539593ef3558e97b5c3e666"}
Sep 15 11:45:04.848144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.848141    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e802d1870aca1da282081cd17f505008db6b1c46b539593ef3558e97b5c3e666"
Sep 15 11:45:04.848441 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:04.848296    2570 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7476-10d483" container="test-curl-7476-10d483"
Sep 15 11:45:04.923974 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.923330    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 15 11:45:04.923974 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.923381    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 15 11:45:04.932997 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:04.932968    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-765830"
Sep 15 11:45:05.216650 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:05.216625    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-765830"]
Sep 15 11:45:05.217931 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:45:05.217907    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod048e7f39_cd20_485d_80c2_52198a8b2a6e.slice/crio-8f4995eef587fd534dff36a6059a24259e58f23b0982305b70bd32bd165c7b36 WatchSource:0}: Error finding container 8f4995eef587fd534dff36a6059a24259e58f23b0982305b70bd32bd165c7b36: Status 404 returned error can't find the container with id 8f4995eef587fd534dff36a6059a24259e58f23b0982305b70bd32bd165c7b36
Sep 15 11:45:05.856203 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:05.856160    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-765830" event={"ID":"048e7f39-cd20-485d-80c2-52198a8b2a6e","Type":"ContainerStarted","Data":"7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863"}
Sep 15 11:45:05.856686 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:05.856213    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-765830" event={"ID":"048e7f39-cd20-485d-80c2-52198a8b2a6e","Type":"ContainerStarted","Data":"8f4995eef587fd534dff36a6059a24259e58f23b0982305b70bd32bd165c7b36"}
Sep 15 11:45:05.856686 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:05.856254    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7476-10d483" podUID="3393f9fd-1344-440d-ac25-25a9ea5f7d93" containerName="test-curl-7476-10d483" containerID="cri-o://4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca" gracePeriod=2
Sep 15 11:45:05.875463 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:05.875403    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7476-765830" podStartSLOduration=1.875382023 podStartE2EDuration="1.875382023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:05.872500266 +0000 UTC m=+1207.628746689" watchObservedRunningTime="2026-09-15 11:45:05.875382023 +0000 UTC m=+1207.631628403"
Sep 15 11:45:05.936582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:05.929895    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 15 11:45:05.936582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:05.929957    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 15 11:45:06.523190 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.523156    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7476-765830"]
Sep 15 11:45:06.528248 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.528215    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7476-765830"]
Sep 15 11:45:06.654702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.653644    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7476-39fabe"]
Sep 15 11:45:06.654702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.654372    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="048e7f39-cd20-485d-80c2-52198a8b2a6e" containerName="test-curl-7476-765830"
Sep 15 11:45:06.654702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.654398    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="048e7f39-cd20-485d-80c2-52198a8b2a6e" containerName="test-curl-7476-765830"
Sep 15 11:45:06.654702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.654525    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="048e7f39-cd20-485d-80c2-52198a8b2a6e" containerName="test-curl-7476-765830"
Sep 15 11:45:06.658306 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.658285    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-39fabe"
Sep 15 11:45:06.658446 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.658377    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-39fabe"]
Sep 15 11:45:06.688781 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.688755    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brnps\" (UniqueName: \"kubernetes.io/projected/6ad0adbe-4bbb-4fe7-9d68-4c9604742c41-kube-api-access-brnps\") pod \"test-curl-7476-39fabe\" (UID: \"6ad0adbe-4bbb-4fe7-9d68-4c9604742c41\") " pod="opendatahub/test-curl-7476-39fabe"
Sep 15 11:45:06.790398 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.790368    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brnps\" (UniqueName: \"kubernetes.io/projected/6ad0adbe-4bbb-4fe7-9d68-4c9604742c41-kube-api-access-brnps\") pod \"test-curl-7476-39fabe\" (UID: \"6ad0adbe-4bbb-4fe7-9d68-4c9604742c41\") " pod="opendatahub/test-curl-7476-39fabe"
Sep 15 11:45:06.799198 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.799176    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brnps\" (UniqueName: \"kubernetes.io/projected/6ad0adbe-4bbb-4fe7-9d68-4c9604742c41-kube-api-access-brnps\") pod \"test-curl-7476-39fabe\" (UID: \"6ad0adbe-4bbb-4fe7-9d68-4c9604742c41\") " pod="opendatahub/test-curl-7476-39fabe"
Sep 15 11:45:06.862681 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:06.862650    2570 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7476-765830" container="test-curl-7476-765830"
Sep 15 11:45:06.923309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.923220    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 15 11:45:06.923309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.923294    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 15 11:45:06.967705 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:06.967672    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-39fabe"
Sep 15 11:45:07.245201 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:07.243204    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-39fabe"]
Sep 15 11:45:07.870630 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:07.870596    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-39fabe" event={"ID":"6ad0adbe-4bbb-4fe7-9d68-4c9604742c41","Type":"ContainerStarted","Data":"eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045"}
Sep 15 11:45:07.870989 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:07.870648    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-39fabe" event={"ID":"6ad0adbe-4bbb-4fe7-9d68-4c9604742c41","Type":"ContainerStarted","Data":"1bbd354fef82e4a81df33fef9501309fccb6197bc37128f77f6497d39ff2868f"}
Sep 15 11:45:07.870989 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:07.870760    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7476-765830" podUID="048e7f39-cd20-485d-80c2-52198a8b2a6e" containerName="test-curl-7476-765830" containerID="cri-o://7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863" gracePeriod=2
Sep 15 11:45:07.907869 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:07.907812    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7476-39fabe" podStartSLOduration=1.907791827 podStartE2EDuration="1.907791827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:07.904277478 +0000 UTC m=+1209.660523857" watchObservedRunningTime="2026-09-15 11:45:07.907791827 +0000 UTC m=+1209.664038207"
Sep 15 11:45:07.926370 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:07.925945    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 15 11:45:07.926370 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:07.926014    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 15 11:45:08.066897 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.066858    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:08.105418 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.105392    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-10d483"
Sep 15 11:45:08.202974 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.202900    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mjl8\" (UniqueName: \"kubernetes.io/projected/3393f9fd-1344-440d-ac25-25a9ea5f7d93-kube-api-access-7mjl8\") pod \"3393f9fd-1344-440d-ac25-25a9ea5f7d93\" (UID: \"3393f9fd-1344-440d-ac25-25a9ea5f7d93\") "
Sep 15 11:45:08.205113 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.205091    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3393f9fd-1344-440d-ac25-25a9ea5f7d93-kube-api-access-7mjl8" (OuterVolumeSpecName: "kube-api-access-7mjl8") pod "3393f9fd-1344-440d-ac25-25a9ea5f7d93" (UID: "3393f9fd-1344-440d-ac25-25a9ea5f7d93"). InnerVolumeSpecName "kube-api-access-7mjl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:08.304233 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.304198    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mjl8\" (UniqueName: \"kubernetes.io/projected/3393f9fd-1344-440d-ac25-25a9ea5f7d93-kube-api-access-7mjl8\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:08.596587 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.596537    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7476-39fabe"]
Sep 15 11:45:08.600356 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.600324    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7476-39fabe"]
Sep 15 11:45:08.719930 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.719898    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7476-bacd46"]
Sep 15 11:45:08.720329 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.720317    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ad0adbe-4bbb-4fe7-9d68-4c9604742c41" containerName="test-curl-7476-39fabe"
Sep 15 11:45:08.720375 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.720331    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ad0adbe-4bbb-4fe7-9d68-4c9604742c41" containerName="test-curl-7476-39fabe"
Sep 15 11:45:08.720435 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.720426    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ad0adbe-4bbb-4fe7-9d68-4c9604742c41" containerName="test-curl-7476-39fabe"
Sep 15 11:45:08.727574 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.723736    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-bacd46"
Sep 15 11:45:08.753740 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.753671    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-bacd46"]
Sep 15 11:45:08.781840 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.781812    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3393f9fd-1344-440d-ac25-25a9ea5f7d93" path="/var/lib/kubelet/pods/3393f9fd-1344-440d-ac25-25a9ea5f7d93/volumes"
Sep 15 11:45:08.810427 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.810398    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8pk4\" (UniqueName: \"kubernetes.io/projected/44cf3898-f024-42e6-af64-75ccadc4643f-kube-api-access-p8pk4\") pod \"test-curl-7476-bacd46\" (UID: \"44cf3898-f024-42e6-af64-75ccadc4643f\") " pod="opendatahub/test-curl-7476-bacd46"
Sep 15 11:45:08.878898 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.878798    2570 generic.go:356] "Generic (PLEG): container finished" podID="3393f9fd-1344-440d-ac25-25a9ea5f7d93" containerID="4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca" exitCode=137
Sep 15 11:45:08.878898 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.878844    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-10d483"
Sep 15 11:45:08.878898 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.878883    2570 scope.go:117] "RemoveContainer" containerID="4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca"
Sep 15 11:45:08.879437 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:08.879179    2570 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7476-39fabe" container="test-curl-7476-39fabe"
Sep 15 11:45:08.888743 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.888711    2570 scope.go:117] "RemoveContainer" containerID="4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca"
Sep 15 11:45:08.889035 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:08.889011    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca\": container with ID starting with 4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca not found: ID does not exist" containerID="4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca"
Sep 15 11:45:08.889102 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.889043    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca"} err="failed to get container status \"4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca\": rpc error: code = NotFound desc = could not find container \"4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca\": container with ID starting with 4f157530ccd446d1a99c6c61594dfe55f468e3a8404e23d45c661fc7edadedca not found: ID does not exist"
Sep 15 11:45:08.911737 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.911712    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pk4\" (UniqueName: \"kubernetes.io/projected/44cf3898-f024-42e6-af64-75ccadc4643f-kube-api-access-p8pk4\") pod \"test-curl-7476-bacd46\" (UID: \"44cf3898-f024-42e6-af64-75ccadc4643f\") " pod="opendatahub/test-curl-7476-bacd46"
Sep 15 11:45:08.921194 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.921176    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8pk4\" (UniqueName: \"kubernetes.io/projected/44cf3898-f024-42e6-af64-75ccadc4643f-kube-api-access-p8pk4\") pod \"test-curl-7476-bacd46\" (UID: \"44cf3898-f024-42e6-af64-75ccadc4643f\") " pod="opendatahub/test-curl-7476-bacd46"
Sep 15 11:45:08.934865 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.929037    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 15 11:45:08.934865 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:08.929089    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 15 11:45:09.063898 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:09.063861    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-bacd46"
Sep 15 11:45:09.355733 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:09.355691    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-bacd46"]
Sep 15 11:45:09.356895 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:45:09.356871    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44cf3898_f024_42e6_af64_75ccadc4643f.slice/crio-bef5bf6464456bbb88b9acb3ecff031a3ede90de3347560ac7b8ccef7c67d408 WatchSource:0}: Error finding container bef5bf6464456bbb88b9acb3ecff031a3ede90de3347560ac7b8ccef7c67d408: Status 404 returned error can't find the container with id bef5bf6464456bbb88b9acb3ecff031a3ede90de3347560ac7b8ccef7c67d408
Sep 15 11:45:09.887202 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:09.887169    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-bacd46" event={"ID":"44cf3898-f024-42e6-af64-75ccadc4643f","Type":"ContainerStarted","Data":"56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf"}
Sep 15 11:45:09.887551 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:09.887219    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-bacd46" event={"ID":"44cf3898-f024-42e6-af64-75ccadc4643f","Type":"ContainerStarted","Data":"bef5bf6464456bbb88b9acb3ecff031a3ede90de3347560ac7b8ccef7c67d408"}
Sep 15 11:45:09.888415 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:09.888372    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7476-39fabe" podUID="6ad0adbe-4bbb-4fe7-9d68-4c9604742c41" containerName="test-curl-7476-39fabe" containerID="cri-o://eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045" gracePeriod=2
Sep 15 11:45:09.914254 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:09.914212    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7476-bacd46" podStartSLOduration=1.914198777 podStartE2EDuration="1.914198777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:09.912127546 +0000 UTC m=+1211.668373924" watchObservedRunningTime="2026-09-15 11:45:09.914198777 +0000 UTC m=+1211.670445147"
Sep 15 11:45:09.928391 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:09.928364    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:45:09.928804 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:09.928786    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:45:09.929661 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:09.929635    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:45:10.075453 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.075427    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-765830"
Sep 15 11:45:10.126042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.125965    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfjkd\" (UniqueName: \"kubernetes.io/projected/048e7f39-cd20-485d-80c2-52198a8b2a6e-kube-api-access-rfjkd\") pod \"048e7f39-cd20-485d-80c2-52198a8b2a6e\" (UID: \"048e7f39-cd20-485d-80c2-52198a8b2a6e\") "
Sep 15 11:45:10.128123 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.128091    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/048e7f39-cd20-485d-80c2-52198a8b2a6e-kube-api-access-rfjkd" (OuterVolumeSpecName: "kube-api-access-rfjkd") pod "048e7f39-cd20-485d-80c2-52198a8b2a6e" (UID: "048e7f39-cd20-485d-80c2-52198a8b2a6e"). InnerVolumeSpecName "kube-api-access-rfjkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:10.227815 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.227783    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfjkd\" (UniqueName: \"kubernetes.io/projected/048e7f39-cd20-485d-80c2-52198a8b2a6e-kube-api-access-rfjkd\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:10.504401 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.504299    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7476-bacd46"]
Sep 15 11:45:10.507591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.507553    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7476-bacd46"]
Sep 15 11:45:10.781641 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.781608    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="048e7f39-cd20-485d-80c2-52198a8b2a6e" path="/var/lib/kubelet/pods/048e7f39-cd20-485d-80c2-52198a8b2a6e/volumes"
Sep 15 11:45:10.895849 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.895812    2570 generic.go:356] "Generic (PLEG): container finished" podID="048e7f39-cd20-485d-80c2-52198a8b2a6e" containerID="7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863" exitCode=137
Sep 15 11:45:10.895849 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.895848    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-765830"
Sep 15 11:45:10.896359 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.895914    2570 scope.go:117] "RemoveContainer" containerID="7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863"
Sep 15 11:45:10.896359 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:10.896114    2570 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7476-bacd46" container="test-curl-7476-bacd46"
Sep 15 11:45:10.907833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.907813    2570 scope.go:117] "RemoveContainer" containerID="7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863"
Sep 15 11:45:10.908264 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:10.908232    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863\": container with ID starting with 7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863 not found: ID does not exist" containerID="7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863"
Sep 15 11:45:10.908326 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:10.908265    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863"} err="failed to get container status \"7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863\": rpc error: code = NotFound desc = could not find container \"7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863\": container with ID starting with 7ed1d50fed5b1c2c550c0bf2f964678fb8f432c91fe8d9558082598624425863 not found: ID does not exist"
Sep 15 11:45:11.108587 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.108494    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:11.386859 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.386792    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"]
Sep 15 11:45:11.387226 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.387214    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44cf3898-f024-42e6-af64-75ccadc4643f" containerName="test-curl-7476-bacd46"
Sep 15 11:45:11.387273 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.387228    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="44cf3898-f024-42e6-af64-75ccadc4643f" containerName="test-curl-7476-bacd46"
Sep 15 11:45:11.387323 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.387314    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="44cf3898-f024-42e6-af64-75ccadc4643f" containerName="test-curl-7476-bacd46"
Sep 15 11:45:11.391941 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.391922    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.394925 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.394904    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-944c275f-openshift-default-dockercfg-6pwtk\""
Sep 15 11:45:11.405483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.405462    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"]
Sep 15 11:45:11.426185 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.426162    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:11.440197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.440168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-certs\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.440306 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.440220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-socket\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.440377 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.440299    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-credential-socket\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.440377 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.440333    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-token\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.440377 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.440369    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istiod-ca-cert\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.440506 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.440403    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krjbl\" (UniqueName: \"kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-kube-api-access-krjbl\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.440506 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.440428    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-envoy\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.440506 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.440488    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-data\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.440652 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.440526    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-podinfo\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.541744 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.541702    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-envoy\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.541900 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.541788    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-data\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.541900 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.541855    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-podinfo\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.542022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.541905    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-certs\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.542022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.541972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-socket\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.542126 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.542033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-credential-socket\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.542126 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.542059    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-token\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.542126 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.542093    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istiod-ca-cert\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.542739 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.542136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krjbl\" (UniqueName: \"kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-kube-api-access-krjbl\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.542739 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.542202    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-data\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.542739 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.542310    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-certs\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.542739 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.542427    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-credential-socket\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.542739 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.542478    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-socket\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.542991 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.542974    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istiod-ca-cert\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.544625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.544598    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-envoy\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.544836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.544818    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-podinfo\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.549551 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.549525    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:11.550732 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.550696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-token\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.550847 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.550826    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krjbl\" (UniqueName: \"kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-kube-api-access-krjbl\") pod \"e2e-mt-944c275f-openshift-default-7d56f79856-5skm8\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") " pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.704128 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.704047    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:11.904396 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.904363    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7476-bacd46" podUID="44cf3898-f024-42e6-af64-75ccadc4643f" containerName="test-curl-7476-bacd46" containerID="cri-o://56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf" gracePeriod=2
Sep 15 11:45:11.991157 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.991130    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"]
Sep 15 11:45:11.997214 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.997170    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:45:11.997309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.997266    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:45:11.997348 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:11.997307    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:45:12.049265 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.049245    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-39fabe"
Sep 15 11:45:12.149087 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.149056    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brnps\" (UniqueName: \"kubernetes.io/projected/6ad0adbe-4bbb-4fe7-9d68-4c9604742c41-kube-api-access-brnps\") pod \"6ad0adbe-4bbb-4fe7-9d68-4c9604742c41\" (UID: \"6ad0adbe-4bbb-4fe7-9d68-4c9604742c41\") "
Sep 15 11:45:12.151059 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.151034    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ad0adbe-4bbb-4fe7-9d68-4c9604742c41-kube-api-access-brnps" (OuterVolumeSpecName: "kube-api-access-brnps") pod "6ad0adbe-4bbb-4fe7-9d68-4c9604742c41" (UID: "6ad0adbe-4bbb-4fe7-9d68-4c9604742c41"). InnerVolumeSpecName "kube-api-access-brnps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:12.250007 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.249917    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brnps\" (UniqueName: \"kubernetes.io/projected/6ad0adbe-4bbb-4fe7-9d68-4c9604742c41-kube-api-access-brnps\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:12.780890 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.780856    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ad0adbe-4bbb-4fe7-9d68-4c9604742c41" path="/var/lib/kubelet/pods/6ad0adbe-4bbb-4fe7-9d68-4c9604742c41/volumes"
Sep 15 11:45:12.913707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.913609    2570 generic.go:356] "Generic (PLEG): container finished" podID="6ad0adbe-4bbb-4fe7-9d68-4c9604742c41" containerID="eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045" exitCode=137
Sep 15 11:45:12.913707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.913665    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-39fabe"
Sep 15 11:45:12.914170 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.913668    2570 scope.go:117] "RemoveContainer" containerID="eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045"
Sep 15 11:45:12.915984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.915875    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" event={"ID":"31be8bf1-3b3c-4a65-943e-2b4d354b2df2","Type":"ContainerStarted","Data":"6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9"}
Sep 15 11:45:12.915984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.915935    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" event={"ID":"31be8bf1-3b3c-4a65-943e-2b4d354b2df2","Type":"ContainerStarted","Data":"bffdd69b763179cd09fc19daf78c625511299f6fb3ec70135e8fd1aa6bd24623"}
Sep 15 11:45:12.924027 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.924009    2570 scope.go:117] "RemoveContainer" containerID="eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045"
Sep 15 11:45:12.924340 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:12.924316    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045\": container with ID starting with eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045 not found: ID does not exist" containerID="eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045"
Sep 15 11:45:12.924416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.924348    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045"} err="failed to get container status \"eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045\": rpc error: code = NotFound desc = could not find container \"eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045\": container with ID starting with eb01fa0b63b41b85d169e3a44dfa75e62d4f480195bc22e625f308c2761f9045 not found: ID does not exist"
Sep 15 11:45:12.943226 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:12.943185    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" podStartSLOduration=1.943172806 podStartE2EDuration="1.943172806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:12.939992744 +0000 UTC m=+1214.696239141" watchObservedRunningTime="2026-09-15 11:45:12.943172806 +0000 UTC m=+1214.699419185"
Sep 15 11:45:13.705049 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:13.705008    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:13.709965 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:13.709942    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:13.923604 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:13.923578    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:13.924492 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:13.924473    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:14.090121 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.090097    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-bacd46"
Sep 15 11:45:14.181665 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.181639    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8pk4\" (UniqueName: \"kubernetes.io/projected/44cf3898-f024-42e6-af64-75ccadc4643f-kube-api-access-p8pk4\") pod \"44cf3898-f024-42e6-af64-75ccadc4643f\" (UID: \"44cf3898-f024-42e6-af64-75ccadc4643f\") "
Sep 15 11:45:14.183763 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.183738    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44cf3898-f024-42e6-af64-75ccadc4643f-kube-api-access-p8pk4" (OuterVolumeSpecName: "kube-api-access-p8pk4") pod "44cf3898-f024-42e6-af64-75ccadc4643f" (UID: "44cf3898-f024-42e6-af64-75ccadc4643f"). InnerVolumeSpecName "kube-api-access-p8pk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:14.282767 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.282689    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8pk4\" (UniqueName: \"kubernetes.io/projected/44cf3898-f024-42e6-af64-75ccadc4643f-kube-api-access-p8pk4\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:14.552724 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.552645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:14.780711 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.780680    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44cf3898-f024-42e6-af64-75ccadc4643f" path="/var/lib/kubelet/pods/44cf3898-f024-42e6-af64-75ccadc4643f/volumes"
Sep 15 11:45:14.867533 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.867453    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:14.933617 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.933582    2570 generic.go:356] "Generic (PLEG): container finished" podID="44cf3898-f024-42e6-af64-75ccadc4643f" containerID="56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf" exitCode=137
Sep 15 11:45:14.934043 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.933634    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-bacd46"
Sep 15 11:45:14.934043 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.933699    2570 scope.go:117] "RemoveContainer" containerID="56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf"
Sep 15 11:45:14.943628 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.943451    2570 scope.go:117] "RemoveContainer" containerID="56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf"
Sep 15 11:45:14.943738 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:14.943720    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf\": container with ID starting with 56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf not found: ID does not exist" containerID="56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf"
Sep 15 11:45:14.943783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.943746    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf"} err="failed to get container status \"56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf\": rpc error: code = NotFound desc = could not find container \"56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf\": container with ID starting with 56c1eea4b50aeb1386d777df6731304c2121a775d1cf4ee28bd136e91f045caf not found: ID does not exist"
Sep 15 11:45:14.970295 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:14.970258    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:15.896676 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:15.896638    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:16.373622 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:16.373583    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:16.592199 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:16.592169    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"]
Sep 15 11:45:16.592384 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:16.592363    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy" containerID="cri-o://6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370" gracePeriod=30
Sep 15 11:45:16.609398 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:16.609369    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:16.712216 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:16.712100    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:16.906611 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:16.906579    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"]
Sep 15 11:45:16.911658 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:16.911636    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"
Sep 15 11:45:16.914413 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:16.914386    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2w6g9\""
Sep 15 11:45:16.914746 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:16.914719    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:45:16.917513 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:16.917489    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"]
Sep 15 11:45:17.009979 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:17.009955    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57488961-81c0-453f-8f53-0ea98c8a465d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79\" (UID: \"57488961-81c0-453f-8f53-0ea98c8a465d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"
Sep 15 11:45:17.110989 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:17.110953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57488961-81c0-453f-8f53-0ea98c8a465d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79\" (UID: \"57488961-81c0-453f-8f53-0ea98c8a465d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"
Sep 15 11:45:17.111587 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:17.111543    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57488961-81c0-453f-8f53-0ea98c8a465d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79\" (UID: \"57488961-81c0-453f-8f53-0ea98c8a465d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"
Sep 15 11:45:17.223324 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:17.223285    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"
Sep 15 11:45:17.492677 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:17.492640    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:17.498014 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:17.497987    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"]
Sep 15 11:45:17.499047 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:45:17.499025    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57488961_81c0_453f_8f53_0ea98c8a465d.slice/crio-9bb3646da9f15e135ce79e24d5f964ec345d41442af59067bf7fa4cbc0f77b68 WatchSource:0}: Error finding container 9bb3646da9f15e135ce79e24d5f964ec345d41442af59067bf7fa4cbc0f77b68: Status 404 returned error can't find the container with id 9bb3646da9f15e135ce79e24d5f964ec345d41442af59067bf7fa4cbc0f77b68
Sep 15 11:45:17.956652 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:17.956622    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79" event={"ID":"57488961-81c0-453f-8f53-0ea98c8a465d","Type":"ContainerStarted","Data":"03dbebf6025c29058945cdf033b2563ebfdff348a7b93ee8b8b450b9cd22f08b"}
Sep 15 11:45:17.956808 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:17.956675    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79" event={"ID":"57488961-81c0-453f-8f53-0ea98c8a465d","Type":"ContainerStarted","Data":"9bb3646da9f15e135ce79e24d5f964ec345d41442af59067bf7fa4cbc0f77b68"}
Sep 15 11:45:17.974727 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:17.974681    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79" podStartSLOduration=1.974665892 podStartE2EDuration="1.974665892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:17.972220569 +0000 UTC m=+1219.728466948" watchObservedRunningTime="2026-09-15 11:45:17.974665892 +0000 UTC m=+1219.730912271"
Sep 15 11:45:18.304425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:18.304394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:18.968367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:18.968093    2570 generic.go:356] "Generic (PLEG): container finished" podID="57488961-81c0-453f-8f53-0ea98c8a465d" containerID="03dbebf6025c29058945cdf033b2563ebfdff348a7b93ee8b8b450b9cd22f08b" exitCode=0
Sep 15 11:45:18.968367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:18.968207    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79" event={"ID":"57488961-81c0-453f-8f53-0ea98c8a465d","Type":"ContainerDied","Data":"03dbebf6025c29058945cdf033b2563ebfdff348a7b93ee8b8b450b9cd22f08b"}
Sep 15 11:45:19.000382 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:19.000348    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:19.053662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:19.053626    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:19.269073 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:19.269039    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:19.442728 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:19.442695    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:19.539318 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:19.539234    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:19.974415 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:19.974306    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:20.113873 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:20.113847    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"
Sep 15 11:45:20.252441 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:20.252361    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57488961-81c0-453f-8f53-0ea98c8a465d-maas-api-service-ca\") pod \"57488961-81c0-453f-8f53-0ea98c8a465d\" (UID: \"57488961-81c0-453f-8f53-0ea98c8a465d\") "
Sep 15 11:45:20.252785 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:20.252762    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57488961-81c0-453f-8f53-0ea98c8a465d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "57488961-81c0-453f-8f53-0ea98c8a465d" (UID: "57488961-81c0-453f-8f53-0ea98c8a465d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:45:20.353385 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:20.353361    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57488961-81c0-453f-8f53-0ea98c8a465d-maas-api-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:20.631192 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:20.631159    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:20.991849 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:20.991763    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"
Sep 15 11:45:20.991849 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:20.991809    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79" event={"ID":"57488961-81c0-453f-8f53-0ea98c8a465d","Type":"ContainerDied","Data":"9bb3646da9f15e135ce79e24d5f964ec345d41442af59067bf7fa4cbc0f77b68"}
Sep 15 11:45:20.992275 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:20.991878    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bb3646da9f15e135ce79e24d5f964ec345d41442af59067bf7fa4cbc0f77b68"
Sep 15 11:45:21.301756 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.301719    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:21.838489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.838464    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:45:21.969173 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969100    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-certs\") pod \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") "
Sep 15 11:45:21.969173 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969132    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-envoy\") pod \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") "
Sep 15 11:45:21.969173 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969155    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-data\") pod \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") "
Sep 15 11:45:21.969450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969176    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-podinfo\") pod \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") "
Sep 15 11:45:21.969450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969210    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-token\") pod \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") "
Sep 15 11:45:21.969450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969266    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-socket\") pod \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") "
Sep 15 11:45:21.969450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969316    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr45c\" (UniqueName: \"kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-kube-api-access-jr45c\") pod \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") "
Sep 15 11:45:21.969450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969356    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istiod-ca-cert\") pod \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") "
Sep 15 11:45:21.969450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969382    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-credential-socket\") pod \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\" (UID: \"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea\") "
Sep 15 11:45:21.969450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969395    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" (UID: "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:21.969852 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969449    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-data" (OuterVolumeSpecName: "istio-data") pod "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" (UID: "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:21.969852 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969592    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" (UID: "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:21.969852 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969761    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" (UID: "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:21.969852 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969806    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" (UID: "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:45:21.970042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969939    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:21.970042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969959    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:21.970042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969973    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:21.970042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.969988    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:21.970042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.970002    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:21.971452 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.971423    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" (UID: "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:45:21.971581 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.971445    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-kube-api-access-jr45c" (OuterVolumeSpecName: "kube-api-access-jr45c") pod "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" (UID: "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea"). InnerVolumeSpecName "kube-api-access-jr45c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:21.971751 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.971731    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" (UID: "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:21.971828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:21.971765    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-token" (OuterVolumeSpecName: "istio-token") pod "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" (UID: "a156e1f7-2c3e-4b8a-ba3d-b18da873ceea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:22.000180 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.000152    2570 generic.go:356] "Generic (PLEG): container finished" podID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerID="6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370" exitCode=0
Sep 15 11:45:22.000512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.000203    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"
Sep 15 11:45:22.000512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.000239    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" event={"ID":"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea","Type":"ContainerDied","Data":"6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370"}
Sep 15 11:45:22.000512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.000310    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84" event={"ID":"a156e1f7-2c3e-4b8a-ba3d-b18da873ceea","Type":"ContainerDied","Data":"449f41f5e3031fb4760bee4cd8e4f1972c488e6c9a48b3ed0d98180c15f698f2"}
Sep 15 11:45:22.000512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.000344    2570 scope.go:117] "RemoveContainer" containerID="6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370"
Sep 15 11:45:22.010008 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.009991    2570 scope.go:117] "RemoveContainer" containerID="409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265"
Sep 15 11:45:22.018834 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.018812    2570 scope.go:117] "RemoveContainer" containerID="6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370"
Sep 15 11:45:22.019107 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:22.019091    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370\": container with ID starting with 6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370 not found: ID does not exist" containerID="6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370"
Sep 15 11:45:22.019156 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.019116    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370"} err="failed to get container status \"6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370\": rpc error: code = NotFound desc = could not find container \"6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370\": container with ID starting with 6325a7d328de3d6612048b3a1d5c0d8c7da9aac2b16ea4814abb9a8b06d32370 not found: ID does not exist"
Sep 15 11:45:22.019156 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.019133    2570 scope.go:117] "RemoveContainer" containerID="409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265"
Sep 15 11:45:22.019382 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:22.019365    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265\": container with ID starting with 409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265 not found: ID does not exist" containerID="409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265"
Sep 15 11:45:22.019426 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.019388    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265"} err="failed to get container status \"409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265\": rpc error: code = NotFound desc = could not find container \"409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265\": container with ID starting with 409c2c6454ca7abd5defac9d263027a7e36a6be2111f886f99594db4c81f6265 not found: ID does not exist"
Sep 15 11:45:22.023984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.023961    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"]
Sep 15 11:45:22.028622 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.028599    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84"]
Sep 15 11:45:22.070656 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.070629    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:22.070656 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.070656    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr45c\" (UniqueName: \"kubernetes.io/projected/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-kube-api-access-jr45c\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:22.070807 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.070670    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:22.070807 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.070683    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:22.113330 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.113310    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:22.727486 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.727450    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:22.781056 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:22.781018    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" path="/var/lib/kubelet/pods/a156e1f7-2c3e-4b8a-ba3d-b18da873ceea/volumes"
Sep 15 11:45:27.031183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:27.031147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:27.358140 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:27.358057    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"]
Sep 15 11:45:27.369987 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:27.369960    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:27.600997 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:27.600962    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:27.666773 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:27.666669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:27.722243 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:27.722197    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:27.776781 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:27.776740    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"]
Sep 15 11:45:27.778325 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:27.778296    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:27.779956 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:27.779934    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1358dc-xqj79"]
Sep 15 11:45:27.831621 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:27.831593    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:28.117841 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:28.117807    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:28.217767 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:28.217729    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:28.781269 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:28.781236    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57488961-81c0-453f-8f53-0ea98c8a465d" path="/var/lib/kubelet/pods/57488961-81c0-453f-8f53-0ea98c8a465d/volumes"
Sep 15 11:45:28.906197 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:28.906147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:29.585007 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:29.584967    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:30.757749 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:30.757710    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:30.908787 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:30.908734    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:31.544131 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:31.544100    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:32.905771 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:32.905736    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:34.191939 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:34.191902    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:34.293386 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:34.293354    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:34.667513 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:34.667476    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:34.811305 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:34.811272    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:45:35.101089 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:35.101053    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:35.936714 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:35.936672    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:36.708381 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:36.708345    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:38.753911 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:38.753874    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"]
Sep 15 11:45:38.759592 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:38.754436    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:38.764631 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:38.764597    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6" podUID="6c1ed411-712a-4824-a0fd-0d2b10eb20ff" containerName="istio-proxy" containerID="cri-o://4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910" gracePeriod=30
Sep 15 11:45:39.275454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:39.275423    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:39.591443 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:39.591342    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:41.783882 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:41.783845    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:42.378331 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.378259    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt" podUID="d895a11c-0a80-4c04-ac40-6dc3f1886844" containerName="main" containerID="cri-o://b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267" gracePeriod=45
Sep 15 11:45:42.656338 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.656312    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:45:42.805328 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.805298    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jg6h\" (UniqueName: \"kubernetes.io/projected/d895a11c-0a80-4c04-ac40-6dc3f1886844-kube-api-access-8jg6h\") pod \"d895a11c-0a80-4c04-ac40-6dc3f1886844\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") "
Sep 15 11:45:42.805800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.805346    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d895a11c-0a80-4c04-ac40-6dc3f1886844-tls-certs\") pod \"d895a11c-0a80-4c04-ac40-6dc3f1886844\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") "
Sep 15 11:45:42.805800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.805375    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-model-cache\") pod \"d895a11c-0a80-4c04-ac40-6dc3f1886844\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") "
Sep 15 11:45:42.805800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.805406    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-dshm\") pod \"d895a11c-0a80-4c04-ac40-6dc3f1886844\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") "
Sep 15 11:45:42.805800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.805492    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-tmp-dir\") pod \"d895a11c-0a80-4c04-ac40-6dc3f1886844\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") "
Sep 15 11:45:42.805800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.805597    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-home\") pod \"d895a11c-0a80-4c04-ac40-6dc3f1886844\" (UID: \"d895a11c-0a80-4c04-ac40-6dc3f1886844\") "
Sep 15 11:45:42.805800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.805695    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-model-cache" (OuterVolumeSpecName: "model-cache") pod "d895a11c-0a80-4c04-ac40-6dc3f1886844" (UID: "d895a11c-0a80-4c04-ac40-6dc3f1886844"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:42.806135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.805847    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d895a11c-0a80-4c04-ac40-6dc3f1886844" (UID: "d895a11c-0a80-4c04-ac40-6dc3f1886844"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:42.806135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.805943    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-home" (OuterVolumeSpecName: "home") pod "d895a11c-0a80-4c04-ac40-6dc3f1886844" (UID: "d895a11c-0a80-4c04-ac40-6dc3f1886844"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:42.806135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.806096    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-model-cache\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:42.806135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.806115    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-tmp-dir\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:42.806135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.806124    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-home\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:42.807722 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.807695    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-dshm" (OuterVolumeSpecName: "dshm") pod "d895a11c-0a80-4c04-ac40-6dc3f1886844" (UID: "d895a11c-0a80-4c04-ac40-6dc3f1886844"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:42.807853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.807789    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d895a11c-0a80-4c04-ac40-6dc3f1886844-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d895a11c-0a80-4c04-ac40-6dc3f1886844" (UID: "d895a11c-0a80-4c04-ac40-6dc3f1886844"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:45:42.807980 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.807961    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d895a11c-0a80-4c04-ac40-6dc3f1886844-kube-api-access-8jg6h" (OuterVolumeSpecName: "kube-api-access-8jg6h") pod "d895a11c-0a80-4c04-ac40-6dc3f1886844" (UID: "d895a11c-0a80-4c04-ac40-6dc3f1886844"). InnerVolumeSpecName "kube-api-access-8jg6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:42.907800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.907717    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d895a11c-0a80-4c04-ac40-6dc3f1886844-dshm\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:42.907800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.907745    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jg6h\" (UniqueName: \"kubernetes.io/projected/d895a11c-0a80-4c04-ac40-6dc3f1886844-kube-api-access-8jg6h\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:42.907800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:42.907762    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d895a11c-0a80-4c04-ac40-6dc3f1886844-tls-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:43.168000 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:43.167915    2570 generic.go:356] "Generic (PLEG): container finished" podID="d895a11c-0a80-4c04-ac40-6dc3f1886844" containerID="b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267" exitCode=0
Sep 15 11:45:43.168000 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:43.167964    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"
Sep 15 11:45:43.168212 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:43.167998    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt" event={"ID":"d895a11c-0a80-4c04-ac40-6dc3f1886844","Type":"ContainerDied","Data":"b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267"}
Sep 15 11:45:43.168212 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:43.168046    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt" event={"ID":"d895a11c-0a80-4c04-ac40-6dc3f1886844","Type":"ContainerDied","Data":"2c1f7fc6e4d448cbe6fcaf7c2318e61b7ca83ca28caec1ce7fb7f53f222fd1a2"}
Sep 15 11:45:43.168212 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:43.168064    2570 scope.go:117] "RemoveContainer" containerID="b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267"
Sep 15 11:45:43.178639 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:43.178620    2570 scope.go:117] "RemoveContainer" containerID="b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267"
Sep 15 11:45:43.178919 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:43.178903    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267\": container with ID starting with b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267 not found: ID does not exist" containerID="b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267"
Sep 15 11:45:43.178979 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:43.178929    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267"} err="failed to get container status \"b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267\": rpc error: code = NotFound desc = could not find container \"b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267\": container with ID starting with b40ac24f5f4f41ff5c55c2b2395fdf8d689604ea629223d6a007b809629c9267 not found: ID does not exist"
Sep 15 11:45:43.192933 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:43.192907    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"]
Sep 15 11:45:43.197612 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:43.197543    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-1358dc/test-model-1358dc-kserve-5f595f6477-fqdkt"]
Sep 15 11:45:44.003940 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.003912    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:45:44.099284 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.099130    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:44.121069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121038    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istiod-ca-cert\") pod \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") "
Sep 15 11:45:44.121244 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121079    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-socket\") pod \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") "
Sep 15 11:45:44.121244 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121112    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-podinfo\") pod \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") "
Sep 15 11:45:44.121244 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121153    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-data\") pod \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") "
Sep 15 11:45:44.121244 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121198    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-envoy\") pod \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") "
Sep 15 11:45:44.121497 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121273    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-certs\") pod \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") "
Sep 15 11:45:44.121497 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121296    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-credential-socket\") pod \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") "
Sep 15 11:45:44.121497 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121332    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-token\") pod \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") "
Sep 15 11:45:44.121497 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121369    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p7hp\" (UniqueName: \"kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-kube-api-access-2p7hp\") pod \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\" (UID: \"6c1ed411-712a-4824-a0fd-0d2b10eb20ff\") "
Sep 15 11:45:44.121497 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121387    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c1ed411-712a-4824-a0fd-0d2b10eb20ff" (UID: "6c1ed411-712a-4824-a0fd-0d2b10eb20ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:44.121811 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121526    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c1ed411-712a-4824-a0fd-0d2b10eb20ff" (UID: "6c1ed411-712a-4824-a0fd-0d2b10eb20ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:45:44.121811 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121552    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c1ed411-712a-4824-a0fd-0d2b10eb20ff" (UID: "6c1ed411-712a-4824-a0fd-0d2b10eb20ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:44.121811 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121625    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c1ed411-712a-4824-a0fd-0d2b10eb20ff" (UID: "6c1ed411-712a-4824-a0fd-0d2b10eb20ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:44.121811 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121652    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c1ed411-712a-4824-a0fd-0d2b10eb20ff" (UID: "6c1ed411-712a-4824-a0fd-0d2b10eb20ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:44.122033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121894    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:44.122033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121916    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:44.122033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121930    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:44.122033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121942    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:44.122033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.121954    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:44.123739 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.123714    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c1ed411-712a-4824-a0fd-0d2b10eb20ff" (UID: "6c1ed411-712a-4824-a0fd-0d2b10eb20ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:45:44.123968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.123937    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c1ed411-712a-4824-a0fd-0d2b10eb20ff" (UID: "6c1ed411-712a-4824-a0fd-0d2b10eb20ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:44.124073 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.124062    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-kube-api-access-2p7hp" (OuterVolumeSpecName: "kube-api-access-2p7hp") pod "6c1ed411-712a-4824-a0fd-0d2b10eb20ff" (UID: "6c1ed411-712a-4824-a0fd-0d2b10eb20ff"). InnerVolumeSpecName "kube-api-access-2p7hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:44.124140 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.124084    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c1ed411-712a-4824-a0fd-0d2b10eb20ff" (UID: "6c1ed411-712a-4824-a0fd-0d2b10eb20ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:44.176592 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.176533    2570 generic.go:356] "Generic (PLEG): container finished" podID="6c1ed411-712a-4824-a0fd-0d2b10eb20ff" containerID="4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910" exitCode=0
Sep 15 11:45:44.176829 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.176647    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"
Sep 15 11:45:44.176829 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.176674    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6" event={"ID":"6c1ed411-712a-4824-a0fd-0d2b10eb20ff","Type":"ContainerDied","Data":"4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910"}
Sep 15 11:45:44.176829 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.176745    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6" event={"ID":"6c1ed411-712a-4824-a0fd-0d2b10eb20ff","Type":"ContainerDied","Data":"7675f7122d20a102c8af23c13b8234fb432ca8eeec7d7df177d3b64e5ba3107b"}
Sep 15 11:45:44.176829 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.176775    2570 scope.go:117] "RemoveContainer" containerID="4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910"
Sep 15 11:45:44.189864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.189846    2570 scope.go:117] "RemoveContainer" containerID="4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910"
Sep 15 11:45:44.190177 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:45:44.190159    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910\": container with ID starting with 4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910 not found: ID does not exist" containerID="4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910"
Sep 15 11:45:44.190239 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.190185    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910"} err="failed to get container status \"4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910\": rpc error: code = NotFound desc = could not find container \"4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910\": container with ID starting with 4e05509f2faf2ba46a24c2050ddbedbb7dac6c8fe4842c1acb8a7845bb141910 not found: ID does not exist"
Sep 15 11:45:44.199975 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.199947    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"]
Sep 15 11:45:44.205755 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.205729    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6"]
Sep 15 11:45:44.222906 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.222867    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:44.222906 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.222898    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:44.223093 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.222913    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:44.223093 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.222927    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p7hp\" (UniqueName: \"kubernetes.io/projected/6c1ed411-712a-4824-a0fd-0d2b10eb20ff-kube-api-access-2p7hp\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:45:44.395280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.393844    2570 patch_prober.go:28] interesting pod/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": read tcp 10.132.0.2:37290->10.132.0.84:15021: read: connection reset by peer" start-of-body=
Sep 15 11:45:44.395280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.393925    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": read tcp 10.132.0.2:37290->10.132.0.84:15021: read: connection reset by peer"
Sep 15 11:45:44.781537 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.781501    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c1ed411-712a-4824-a0fd-0d2b10eb20ff" path="/var/lib/kubelet/pods/6c1ed411-712a-4824-a0fd-0d2b10eb20ff/volumes"
Sep 15 11:45:44.781968 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:44.781954    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d895a11c-0a80-4c04-ac40-6dc3f1886844" path="/var/lib/kubelet/pods/d895a11c-0a80-4c04-ac40-6dc3f1886844/volumes"
Sep 15 11:45:45.186513 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:45.186429    2570 generic.go:356] "Generic (PLEG): container finished" podID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerID="6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9" exitCode=0
Sep 15 11:45:45.186513 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:45.186499    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" event={"ID":"31be8bf1-3b3c-4a65-943e-2b4d354b2df2","Type":"ContainerDied","Data":"6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9"}
Sep 15 11:45:45.187137 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:45.186957    2570 scope.go:117] "RemoveContainer" containerID="6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9"
Sep 15 11:45:45.188191 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:45.188156    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:45:45.188293 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:45.188231    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:45:45.188293 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:45.188265    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:45:45.289192 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:45.289157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:46.197072 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:46.197035    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" event={"ID":"31be8bf1-3b3c-4a65-943e-2b4d354b2df2","Type":"ContainerStarted","Data":"b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875"}
Sep 15 11:45:46.704629 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:46.704584    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:46.704858 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:46.704834    2570 patch_prober.go:28] interesting pod/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 15 11:45:46.704917 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:46.704896    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 15 11:45:47.704509 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:47.704468    2570 patch_prober.go:28] interesting pod/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 15 11:45:47.705044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:47.704523    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 15 11:45:48.705265 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:48.705226    2570 patch_prober.go:28] interesting pod/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 15 11:45:48.705685 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:48.705289    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 15 11:45:49.705250 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:49.705213    2570 patch_prober.go:28] interesting pod/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 15 11:45:49.705452 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:49.705276    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 15 11:45:50.704409 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:50.704374    2570 patch_prober.go:28] interesting pod/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 15 11:45:50.704647 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:50.704429    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 15 11:45:51.704653 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:51.704611    2570 patch_prober.go:28] interesting pod/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 15 11:45:51.705080 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:51.704671    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 15 11:45:52.709314 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:52.709275    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:52.709801 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:52.709674    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:52.710380 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:52.710357    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:45:54.271723 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.271690    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"]
Sep 15 11:45:54.272199 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272183    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy"
Sep 15 11:45:54.272245 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272201    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy"
Sep 15 11:45:54.272245 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272214    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57488961-81c0-453f-8f53-0ea98c8a465d" containerName="revoke-keys"
Sep 15 11:45:54.272245 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272220    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="57488961-81c0-453f-8f53-0ea98c8a465d" containerName="revoke-keys"
Sep 15 11:45:54.272245 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272232    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy"
Sep 15 11:45:54.272245 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272238    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy"
Sep 15 11:45:54.272403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272246    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1ed411-712a-4824-a0fd-0d2b10eb20ff" containerName="istio-proxy"
Sep 15 11:45:54.272403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272253    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1ed411-712a-4824-a0fd-0d2b10eb20ff" containerName="istio-proxy"
Sep 15 11:45:54.272403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272271    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d895a11c-0a80-4c04-ac40-6dc3f1886844" containerName="main"
Sep 15 11:45:54.272403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272276    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d895a11c-0a80-4c04-ac40-6dc3f1886844" containerName="main"
Sep 15 11:45:54.272403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272341    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy"
Sep 15 11:45:54.272403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272348    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d895a11c-0a80-4c04-ac40-6dc3f1886844" containerName="main"
Sep 15 11:45:54.272403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272357    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1ed411-712a-4824-a0fd-0d2b10eb20ff" containerName="istio-proxy"
Sep 15 11:45:54.272403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.272363    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="57488961-81c0-453f-8f53-0ea98c8a465d" containerName="revoke-keys"
Sep 15 11:45:54.275697 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.275678    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.279460 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.279433    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"distinct-2-w0-9bd868-kserve-self-signed-certs\""
Sep 15 11:45:54.279605 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.279460    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"kube-root-ca.crt\""
Sep 15 11:45:54.279605 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.279522    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"default-dockercfg-d7rvg\""
Sep 15 11:45:54.279605 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.279548    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"openshift-service-ca.crt\""
Sep 15 11:45:54.286654 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.286627    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"]
Sep 15 11:45:54.298260 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.298226    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:54.431873 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.431837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-model-cache\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.432047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.431901    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-tmp-dir\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.432047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.432032    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ec658f4-4bb5-4924-8655-57bda4f451f4-tls-certs\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.432204 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.432189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-home\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.432270 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.432237    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-dshm\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.432270 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.432252    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlcvg\" (UniqueName: \"kubernetes.io/projected/6ec658f4-4bb5-4924-8655-57bda4f451f4-kube-api-access-xlcvg\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.533776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.533685    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-home\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.533776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.533751    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-dshm\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.534022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.533780    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlcvg\" (UniqueName: \"kubernetes.io/projected/6ec658f4-4bb5-4924-8655-57bda4f451f4-kube-api-access-xlcvg\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.534022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.533837    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-model-cache\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.534022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.533880    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-tmp-dir\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.534022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.533945    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ec658f4-4bb5-4924-8655-57bda4f451f4-tls-certs\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.534259 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.534096    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-home\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.534259 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.534224    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-model-cache\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.534259 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.534236    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-tmp-dir\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.535929 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.535910    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-dshm\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.536292 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.536274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ec658f4-4bb5-4924-8655-57bda4f451f4-tls-certs\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.542218 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.542197    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlcvg\" (UniqueName: \"kubernetes.io/projected/6ec658f4-4bb5-4924-8655-57bda4f451f4-kube-api-access-xlcvg\") pod \"distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.586337 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.586283    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:45:54.866204 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:54.866173    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"]
Sep 15 11:45:54.867407 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:45:54.867380    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ec658f4_4bb5_4924_8655_57bda4f451f4.slice/crio-edfd1a58000e56c335c05a89622d52dde2c9dfcb5f61290f07536a1b83b61ffe WatchSource:0}: Error finding container edfd1a58000e56c335c05a89622d52dde2c9dfcb5f61290f07536a1b83b61ffe: Status 404 returned error can't find the container with id edfd1a58000e56c335c05a89622d52dde2c9dfcb5f61290f07536a1b83b61ffe
Sep 15 11:45:55.262006 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:55.261975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc" event={"ID":"6ec658f4-4bb5-4924-8655-57bda4f451f4","Type":"ContainerStarted","Data":"00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2"}
Sep 15 11:45:55.262179 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:55.262016    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc" event={"ID":"6ec658f4-4bb5-4924-8655-57bda4f451f4","Type":"ContainerStarted","Data":"edfd1a58000e56c335c05a89622d52dde2c9dfcb5f61290f07536a1b83b61ffe"}
Sep 15 11:45:55.279253 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:55.279201    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc" podStartSLOduration=1.279187061 podStartE2EDuration="1.279187061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:55.278269586 +0000 UTC m=+1257.034515965" watchObservedRunningTime="2026-09-15 11:45:55.279187061 +0000 UTC m=+1257.035433437"
Sep 15 11:45:58.923104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:45:58.923072    2570 scope.go:117] "RemoveContainer" containerID="1fdf64f837bb59cba6ca6e1a53a91739305b504b9fb35ded729d3a2b71f0fa6b"
Sep 15 11:46:04.587177 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:04.587132    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:46:04.587602 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:04.587205    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:46:04.599809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:04.599783    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:46:05.343839 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:05.343807    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:46:09.100588 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:09.100542    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:46:10.482004 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:10.481959    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:10.729389 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:10.729358    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"]
Sep 15 11:46:10.729643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:10.729599    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy" containerID="cri-o://bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480" gracePeriod=30
Sep 15 11:46:10.747885 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:10.747789    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:11.301925 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.301890    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:11.579140 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.579056    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"]
Sep 15 11:46:11.579645 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.579628    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a156e1f7-2c3e-4b8a-ba3d-b18da873ceea" containerName="istio-proxy"
Sep 15 11:46:11.584876 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.584853    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.587402 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.587368    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-26f1b0-openshift-default-dockercfg-95zqx\""
Sep 15 11:46:11.596978 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.596953    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"]
Sep 15 11:46:11.612189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.612159    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:11.707425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.707367    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-data\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.707664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.707450    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxkw6\" (UniqueName: \"kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-kube-api-access-sxkw6\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.707664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.707521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-token\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.707664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.707598    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-podinfo\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.707664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.707640    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-envoy\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.707913 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.707670    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-credential-socket\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.707913 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.707694    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-certs\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.707913 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.707758    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-socket\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.707913 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.707784    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istiod-ca-cert\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.808652 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.808618    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-data\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.808652 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.808657    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxkw6\" (UniqueName: \"kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-kube-api-access-sxkw6\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.808912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.808696    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-token\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.808912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.808741    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-podinfo\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.808912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.808778    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-envoy\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.808912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.808806    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-credential-socket\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.809136 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.808955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-certs\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.809136 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.809049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-socket\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.809136 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.809082    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-data\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.809136 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.809088    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istiod-ca-cert\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.809354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.809246    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-credential-socket\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.809354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.809329    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-certs\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.809469 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.809410    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-socket\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.809954 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.809933    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istiod-ca-cert\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.811334 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.811311    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-podinfo\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.811433 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.811392    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-envoy\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.816941 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.816912    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-token\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.817281 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.817259    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxkw6\" (UniqueName: \"kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-kube-api-access-sxkw6\") pod \"e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") " pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.896980 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.896885    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:11.933412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:11.933373    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:12.179033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:12.179003    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"]
Sep 15 11:46:12.180834 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:46:12.180809    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847ebb4f_8b5a_4ab7_8457_f0e88b54c4de.slice/crio-6e7ad322a52b7c05375948cea9ad74cc2e3946e06e3ea458156fa64a07f16153 WatchSource:0}: Error finding container 6e7ad322a52b7c05375948cea9ad74cc2e3946e06e3ea458156fa64a07f16153: Status 404 returned error can't find the container with id 6e7ad322a52b7c05375948cea9ad74cc2e3946e06e3ea458156fa64a07f16153
Sep 15 11:46:12.183526 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:12.183487    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:46:12.183651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:12.183589    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:46:12.183717 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:12.183660    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:46:12.379719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:12.379682    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" event={"ID":"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de","Type":"ContainerStarted","Data":"1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0"}
Sep 15 11:46:12.379907 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:12.379748    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" event={"ID":"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de","Type":"ContainerStarted","Data":"6e7ad322a52b7c05375948cea9ad74cc2e3946e06e3ea458156fa64a07f16153"}
Sep 15 11:46:12.399786 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:12.399730    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" podStartSLOduration=1.399709993 podStartE2EDuration="1.399709993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:46:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:46:12.398857867 +0000 UTC m=+1274.155104270" watchObservedRunningTime="2026-09-15 11:46:12.399709993 +0000 UTC m=+1274.155956373"
Sep 15 11:46:12.897006 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:12.896952    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:13.611185 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:13.611145    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:13.903039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:13.902951    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:14.308478 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:14.308434    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:14.395369 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:14.395334    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:14.396302 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:14.396280    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:14.400539 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:14.400513    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:15.213088 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:15.213056    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:15.893208 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:15.893177    2570 patch_prober.go:28] interesting pod/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 15 11:46:15.893367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:15.893234    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 15 11:46:15.987081 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:15.987051    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:46:16.060498 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.060465    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-data\") pod \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") "
Sep 15 11:46:16.060716 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.060508    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-podinfo\") pod \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") "
Sep 15 11:46:16.060716 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.060551    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istiod-ca-cert\") pod \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") "
Sep 15 11:46:16.060716 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.060592    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh4pr\" (UniqueName: \"kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-kube-api-access-dh4pr\") pod \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") "
Sep 15 11:46:16.060716 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.060627    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-certs\") pod \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") "
Sep 15 11:46:16.060716 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.060651    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-envoy\") pod \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") "
Sep 15 11:46:16.061001 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.060729    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-credential-socket\") pod \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") "
Sep 15 11:46:16.061001 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.060770    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-socket\") pod \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") "
Sep 15 11:46:16.061001 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.060807    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" (UID: "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:16.061001 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.060839    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-token\") pod \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\" (UID: \"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84\") "
Sep 15 11:46:16.061233 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.061079    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" (UID: "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:46:16.061288 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.061275    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:16.061340 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.061296    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:16.061742 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.061426    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" (UID: "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:16.061742 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.061507    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" (UID: "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:16.061742 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.061586    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" (UID: "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:16.063264 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.063235    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" (UID: "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:46:16.063264 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.063254    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" (UID: "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:46:16.063531 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.063514    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" (UID: "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:16.063702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.063678    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-kube-api-access-dh4pr" (OuterVolumeSpecName: "kube-api-access-dh4pr") pod "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" (UID: "ed5a3322-ea58-4ba1-85f2-9a492d5c7a84"). InnerVolumeSpecName "kube-api-access-dh4pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:46:16.114322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.114290    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:16.162962 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.162928    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:16.162962 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.162961    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:16.163183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.162976    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:16.163183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.162987    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh4pr\" (UniqueName: \"kubernetes.io/projected/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-kube-api-access-dh4pr\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:16.163183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.163000    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:16.163183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.163012    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:16.163183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.163028    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:16.411277 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.411190    2570 generic.go:356] "Generic (PLEG): container finished" podID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerID="bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480" exitCode=0
Sep 15 11:46:16.411277 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.411234    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"
Sep 15 11:46:16.411807 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.411276    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" event={"ID":"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84","Type":"ContainerDied","Data":"bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480"}
Sep 15 11:46:16.411807 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.411329    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx" event={"ID":"ed5a3322-ea58-4ba1-85f2-9a492d5c7a84","Type":"ContainerDied","Data":"5268e432d9f77a1cd8b53d5f5d9d51f78fb0cc36f2abd69e2b77e53164bdf044"}
Sep 15 11:46:16.411807 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.411351    2570 scope.go:117] "RemoveContainer" containerID="bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480"
Sep 15 11:46:16.421885 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.421864    2570 scope.go:117] "RemoveContainer" containerID="80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417"
Sep 15 11:46:16.431778 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.431754    2570 scope.go:117] "RemoveContainer" containerID="bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480"
Sep 15 11:46:16.432106 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:46:16.432084    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480\": container with ID starting with bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480 not found: ID does not exist" containerID="bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480"
Sep 15 11:46:16.432199 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.432119    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480"} err="failed to get container status \"bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480\": rpc error: code = NotFound desc = could not find container \"bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480\": container with ID starting with bc8b99a6da6806684280c01e96069a98bb733eb036a7b141d4575b5a02ef9480 not found: ID does not exist"
Sep 15 11:46:16.432199 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.432148    2570 scope.go:117] "RemoveContainer" containerID="80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417"
Sep 15 11:46:16.432445 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:46:16.432426    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417\": container with ID starting with 80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417 not found: ID does not exist" containerID="80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417"
Sep 15 11:46:16.432532 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.432451    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417"} err="failed to get container status \"80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417\": rpc error: code = NotFound desc = could not find container \"80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417\": container with ID starting with 80bfd03b66a6f13e8c93a2418e50d314159d551b44bdd3ab5799b37ebfcbf417 not found: ID does not exist"
Sep 15 11:46:16.437186 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.437157    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"]
Sep 15 11:46:16.441567 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.441529    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx"]
Sep 15 11:46:16.780658 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.780628    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" path="/var/lib/kubelet/pods/ed5a3322-ea58-4ba1-85f2-9a492d5c7a84/volumes"
Sep 15 11:46:16.926707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:16.926667    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:17.674348 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:17.674313    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:18.346810 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:18.346772    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:18.446470 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:18.446432    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:18.507659 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:18.507628    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:18.850149 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:18.850113    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:18.922053 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:18.922012    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:21.093950 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:21.093909    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:24.068492 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:24.068460    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:26.671165 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:26.671116    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:31.091055 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:31.091016    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:46:40.297970 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:40.297937    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:41.126801 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:41.126747    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:41.620474 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:41.620440    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"]
Sep 15 11:46:41.620922 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:41.620544    2570 generic.go:356] "Generic (PLEG): container finished" podID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerID="1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0" exitCode=0
Sep 15 11:46:41.620922 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:41.620645    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" event={"ID":"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de","Type":"ContainerDied","Data":"1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0"}
Sep 15 11:46:41.621145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:41.621129    2570 scope.go:117] "RemoveContainer" containerID="1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0"
Sep 15 11:46:41.622391 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:41.622354    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:46:41.622511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:41.622446    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:46:41.622511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:41.622491    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:46:41.640029 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:41.640000    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:41.893717 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:41.893627    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:42.592324 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:42.592288    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:42.640643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:42.640598    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" event={"ID":"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de","Type":"ContainerStarted","Data":"7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210"}
Sep 15 11:46:42.897321 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:42.897222    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:42.898395 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:42.898368    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Sep 15 11:46:42.898520 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:42.898417    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Sep 15 11:46:43.262961 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:43.262934    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:43.898157 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:43.898117    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Sep 15 11:46:43.898549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:43.898184    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Sep 15 11:46:43.998540 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:43.998505    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:44.298760 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.298723    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:44.395895 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.395861    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:44.634333 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.634226    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:44.743453 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.743421    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:44.897437 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.897336    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Sep 15 11:46:44.897437 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.897404    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Sep 15 11:46:44.922537 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.922506    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"]
Sep 15 11:46:44.929591 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.923208    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy"
Sep 15 11:46:44.929834 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.929808    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy"
Sep 15 11:46:44.929961 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.929945    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy"
Sep 15 11:46:44.930056 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.930046    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy"
Sep 15 11:46:44.930316 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.930302    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy"
Sep 15 11:46:44.930417 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.930406    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed5a3322-ea58-4ba1-85f2-9a492d5c7a84" containerName="istio-proxy"
Sep 15 11:46:44.951579 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.948735    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:44.971290 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.971256    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:44.974120 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.973938    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-dd6959-openshift-default-dockercfg-t99k8\""
Sep 15 11:46:44.979874 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:44.979265    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"]
Sep 15 11:46:45.071663 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.071609    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-credential-socket\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.072011 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.071987    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-envoy\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.072232 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.072191    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn999\" (UniqueName: \"kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-kube-api-access-mn999\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.072466 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.072448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a20bd381-ab4b-491d-b5af-2df04bda447c-istiod-ca-cert\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.072615 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.072599    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-certs\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.072784 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.072763    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-podinfo\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.072923 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.072909    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-data\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.073131 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.073110    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-token\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.073314 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.073290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-socket\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.174489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.174382    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-token\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.174489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.174429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-socket\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.174489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.174479    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-credential-socket\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.174831 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.174499    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-envoy\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.174831 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.174520    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn999\" (UniqueName: \"kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-kube-api-access-mn999\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.174831 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.174595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a20bd381-ab4b-491d-b5af-2df04bda447c-istiod-ca-cert\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.174831 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.174630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-certs\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.174831 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.174678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-podinfo\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.174831 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.174706    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-data\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.175155 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.174956    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-socket\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.175155 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.175020    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-credential-socket\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.175155 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.175144    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-data\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.175318 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.175256    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-certs\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.175430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.175409    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a20bd381-ab4b-491d-b5af-2df04bda447c-istiod-ca-cert\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.176889 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.176868    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-envoy\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.177297 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.177279    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-podinfo\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.181833 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.181814    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-token\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.181924 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.181878    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn999\" (UniqueName: \"kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-kube-api-access-mn999\") pod \"e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") " pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.286064 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.286033    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:45.286903 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.286870    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:45.603743 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.603715    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"]
Sep 15 11:46:45.604844 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:46:45.604820    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20bd381_ab4b_491d_b5af_2df04bda447c.slice/crio-16642b0fd00d0239d3bc1f4da4f8ce36bbf94b6eef316de51a9574cd97944fff WatchSource:0}: Error finding container 16642b0fd00d0239d3bc1f4da4f8ce36bbf94b6eef316de51a9574cd97944fff: Status 404 returned error can't find the container with id 16642b0fd00d0239d3bc1f4da4f8ce36bbf94b6eef316de51a9574cd97944fff
Sep 15 11:46:45.611107 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.611067    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:46:45.611214 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.611136    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:46:45.611214 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.611168    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:46:45.666595 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.666537    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" event={"ID":"a20bd381-ab4b-491d-b5af-2df04bda447c","Type":"ContainerStarted","Data":"16642b0fd00d0239d3bc1f4da4f8ce36bbf94b6eef316de51a9574cd97944fff"}
Sep 15 11:46:45.897881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.897798    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Sep 15 11:46:45.897881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:45.897856    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Sep 15 11:46:46.675059 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:46.675017    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" event={"ID":"a20bd381-ab4b-491d-b5af-2df04bda447c","Type":"ContainerStarted","Data":"b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76"}
Sep 15 11:46:46.696082 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:46.696028    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" podStartSLOduration=2.69600874 podStartE2EDuration="2.69600874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:46:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:46:46.694095964 +0000 UTC m=+1308.450342355" watchObservedRunningTime="2026-09-15 11:46:46.69600874 +0000 UTC m=+1308.452255120"
Sep 15 11:46:46.897531 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:46.897489    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Sep 15 11:46:46.897777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:46.897549    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Sep 15 11:46:47.287016 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:47.286979    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:47.292261 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:47.292238    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:47.683065 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:47.682981    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:47.684025 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:47.684006    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:46:47.902303 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:47.902270    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:47.903457 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:47.903432    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 11:46:48.002005 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:48.001914    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:48.631518 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:48.631475    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:48.725450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:48.725420    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:49.697611 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:49.697575    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:50.389208 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:50.389145    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:51.027860 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:51.027826    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:51.689309 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:51.689277    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:52.302621 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:52.302580    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:53.084132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.084098    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"]
Sep 15 11:46:53.088876 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.088848    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.091269 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.091247    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-dd6959-serving-cert\""
Sep 15 11:46:53.092865 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.091581    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 11:46:53.093116 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.092574    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 11:46:53.093593 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.093365    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:46:53.093593 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.093421    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-x24k9\""
Sep 15 11:46:53.097312 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.097288    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"]
Sep 15 11:46:53.110599 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.110571    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:53.158046 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.158012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pthfl\" (UniqueName: \"kubernetes.io/projected/538a14e5-c871-48e0-b547-ca4a79b55039-kube-api-access-pthfl\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.158198 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.158075    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/538a14e5-c871-48e0-b547-ca4a79b55039-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.158198 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.158134    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.158198 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.158183    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.166454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.166426    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:53.259423 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.259384    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/538a14e5-c871-48e0-b547-ca4a79b55039-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.259658 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.259451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.259658 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.259503    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.259658 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.259630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pthfl\" (UniqueName: \"kubernetes.io/projected/538a14e5-c871-48e0-b547-ca4a79b55039-kube-api-access-pthfl\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.260279 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.260251    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/538a14e5-c871-48e0-b547-ca4a79b55039-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.262074 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.262051    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.262198 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.262183    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.267398 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.267370    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:53.268246 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.268218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pthfl\" (UniqueName: \"kubernetes.io/projected/538a14e5-c871-48e0-b547-ca4a79b55039-kube-api-access-pthfl\") pod \"maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.404798 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.404716    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:53.572320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.572269    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:53.652268 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.652233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:53.725721 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.725687    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"]
Sep 15 11:46:53.726121 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:53.726092    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:46:54.743023 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:54.742977    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8" event={"ID":"538a14e5-c871-48e0-b547-ca4a79b55039","Type":"ContainerStarted","Data":"b457702943ab13288b83d3476868fffb9a32c2cd2a4d69a62d7d72940561c71b"}
Sep 15 11:46:56.641445 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:56.641389    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf" podUID="1d470695-d3c3-44d0-ac2c-6ed763949075" containerName="main" containerID="cri-o://998668b1e14855720eb75028a3b1b484f3cece879833ba60c6242ae55a77e3b5" gracePeriod=45
Sep 15 11:46:56.763329 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:56.763297    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8" event={"ID":"538a14e5-c871-48e0-b547-ca4a79b55039","Type":"ContainerStarted","Data":"18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5"}
Sep 15 11:46:56.763679 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:56.763658    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:46:56.765409 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:56.765383    2570 generic.go:356] "Generic (PLEG): container finished" podID="1d470695-d3c3-44d0-ac2c-6ed763949075" containerID="998668b1e14855720eb75028a3b1b484f3cece879833ba60c6242ae55a77e3b5" exitCode=0
Sep 15 11:46:56.765500 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:56.765409    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf" event={"ID":"1d470695-d3c3-44d0-ac2c-6ed763949075","Type":"ContainerDied","Data":"998668b1e14855720eb75028a3b1b484f3cece879833ba60c6242ae55a77e3b5"}
Sep 15 11:46:56.781883 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:56.781833    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8" podStartSLOduration=1.505153681 podStartE2EDuration="3.781815859s" totalImagesPullingTime="2.276662178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:46:56.779665299 +0000 UTC m=+1318.535911688" watchObservedRunningTime="2026-09-15 11:46:56.781815859 +0000 UTC m=+1318.538062238"
Sep 15 11:46:56.897829 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:56.897759    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:46:57.003443 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.003406    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-tmp-dir\") pod \"1d470695-d3c3-44d0-ac2c-6ed763949075\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") "
Sep 15 11:46:57.003670 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.003499    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qhnd\" (UniqueName: \"kubernetes.io/projected/1d470695-d3c3-44d0-ac2c-6ed763949075-kube-api-access-8qhnd\") pod \"1d470695-d3c3-44d0-ac2c-6ed763949075\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") "
Sep 15 11:46:57.003670 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.003586    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-home\") pod \"1d470695-d3c3-44d0-ac2c-6ed763949075\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") "
Sep 15 11:46:57.003670 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.003622    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-model-cache\") pod \"1d470695-d3c3-44d0-ac2c-6ed763949075\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") "
Sep 15 11:46:57.003895 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.003682    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d470695-d3c3-44d0-ac2c-6ed763949075-tls-certs\") pod \"1d470695-d3c3-44d0-ac2c-6ed763949075\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") "
Sep 15 11:46:57.003895 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.003685    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1d470695-d3c3-44d0-ac2c-6ed763949075" (UID: "1d470695-d3c3-44d0-ac2c-6ed763949075"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:57.003895 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.003713    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-dshm\") pod \"1d470695-d3c3-44d0-ac2c-6ed763949075\" (UID: \"1d470695-d3c3-44d0-ac2c-6ed763949075\") "
Sep 15 11:46:57.004056 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.003903    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-model-cache" (OuterVolumeSpecName: "model-cache") pod "1d470695-d3c3-44d0-ac2c-6ed763949075" (UID: "1d470695-d3c3-44d0-ac2c-6ed763949075"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:57.004056 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.004027    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-home" (OuterVolumeSpecName: "home") pod "1d470695-d3c3-44d0-ac2c-6ed763949075" (UID: "1d470695-d3c3-44d0-ac2c-6ed763949075"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:57.004189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.004168    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-tmp-dir\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:57.004259 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.004197    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-home\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:57.004259 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.004211    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-model-cache\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:57.006401 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.006378    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-dshm" (OuterVolumeSpecName: "dshm") pod "1d470695-d3c3-44d0-ac2c-6ed763949075" (UID: "1d470695-d3c3-44d0-ac2c-6ed763949075"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:57.006688 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.006582    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d470695-d3c3-44d0-ac2c-6ed763949075-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1d470695-d3c3-44d0-ac2c-6ed763949075" (UID: "1d470695-d3c3-44d0-ac2c-6ed763949075"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:46:57.006688 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.006658    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d470695-d3c3-44d0-ac2c-6ed763949075-kube-api-access-8qhnd" (OuterVolumeSpecName: "kube-api-access-8qhnd") pod "1d470695-d3c3-44d0-ac2c-6ed763949075" (UID: "1d470695-d3c3-44d0-ac2c-6ed763949075"). InnerVolumeSpecName "kube-api-access-8qhnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:46:57.104985 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.104947    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qhnd\" (UniqueName: \"kubernetes.io/projected/1d470695-d3c3-44d0-ac2c-6ed763949075-kube-api-access-8qhnd\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:57.104985 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.104987    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d470695-d3c3-44d0-ac2c-6ed763949075-tls-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:57.105206 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.105003    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d470695-d3c3-44d0-ac2c-6ed763949075-dshm\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:46:57.774825 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.774800    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"
Sep 15 11:46:57.775249 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.774841    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf" event={"ID":"1d470695-d3c3-44d0-ac2c-6ed763949075","Type":"ContainerDied","Data":"f4dcbdf5cbbe535447888c517166c4d2ee957bc7d68608b43b94349411041dd3"}
Sep 15 11:46:57.775249 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.774887    2570 scope.go:117] "RemoveContainer" containerID="998668b1e14855720eb75028a3b1b484f3cece879833ba60c6242ae55a77e3b5"
Sep 15 11:46:57.798344 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.798319    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"]
Sep 15 11:46:57.803817 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:57.803794    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/e2e-conflict-a-f81d2f5d-kserve-5448d596b7-cpwpf"]
Sep 15 11:46:58.782619 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:58.782586    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d470695-d3c3-44d0-ac2c-6ed763949075" path="/var/lib/kubelet/pods/1d470695-d3c3-44d0-ac2c-6ed763949075/volumes"
Sep 15 11:46:58.981208 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:58.981177    2570 scope.go:117] "RemoveContainer" containerID="1c644244d478ffb475988d64a3834a11a798feff95a73885ef0eaa451e978c85"
Sep 15 11:46:58.990288 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:46:58.990270    2570 scope.go:117] "RemoveContainer" containerID="8739a072a64b2e2bb1128837577fbe7f3fecbf2f6490c1c08095146f382a1149"
Sep 15 11:47:02.781708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:02.781682    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 11:47:04.008269 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:04.008229    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:12.095040 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:12.094998    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:47:15.260001 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:15.259963    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:15.918248 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:15.918207    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:16.594343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:16.594307    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:17.315780 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:17.315741    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:17.971872 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:17.971838    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:18.714422 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:18.714384    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:18.842667 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:18.842623    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:19.528723 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:19.528687    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:20.477106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:20.477069    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:21.270126 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:21.270037    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:22.083671 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:22.083638    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:22.705243 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:22.705210    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:23.430821 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:23.430779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:23.959283 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:23.959196    2570 generic.go:356] "Generic (PLEG): container finished" podID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerID="b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76" exitCode=0
Sep 15 11:47:23.959747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:23.959275    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" event={"ID":"a20bd381-ab4b-491d-b5af-2df04bda447c","Type":"ContainerDied","Data":"b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76"}
Sep 15 11:47:23.959747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:23.959737    2570 scope.go:117] "RemoveContainer" containerID="b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76"
Sep 15 11:47:23.961033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:23.960997    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:47:23.961103 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:23.961079    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:47:23.961140 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:23.961110    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:47:24.269471 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.269430    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:24.572140 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.572048    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"]
Sep 15 11:47:24.572851 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.572833    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d470695-d3c3-44d0-ac2c-6ed763949075" containerName="main"
Sep 15 11:47:24.572851 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.572853    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d470695-d3c3-44d0-ac2c-6ed763949075" containerName="main"
Sep 15 11:47:24.572961 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.572924    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d470695-d3c3-44d0-ac2c-6ed763949075" containerName="main"
Sep 15 11:47:24.576241 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.576219    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.578828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.578803    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2fab1f\"/\"kube-root-ca.crt\""
Sep 15 11:47:24.578998 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.578879    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2fab1f\"/\"distinct-w4-2fab1f-kserve-self-signed-certs\""
Sep 15 11:47:24.579080 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.579064    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2fab1f\"/\"openshift-service-ca.crt\""
Sep 15 11:47:24.580024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.579989    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2fab1f\"/\"default-dockercfg-q727f\""
Sep 15 11:47:24.583710 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.583686    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"]
Sep 15 11:47:24.717499 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.717462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4g9m\" (UniqueName: \"kubernetes.io/projected/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-kube-api-access-h4g9m\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.717719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.717529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tls-certs\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.717719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.717583    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-home\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.717719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.717646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tmp-dir\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.717719 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.717683    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-model-cache\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.717867 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.717725    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-dshm\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.819067 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.819025    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-dshm\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.819280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.819112    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4g9m\" (UniqueName: \"kubernetes.io/projected/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-kube-api-access-h4g9m\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.819280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.819188    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tls-certs\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.819280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.819226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-home\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.819457 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.819299    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tmp-dir\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.819457 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.819339    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-model-cache\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.819707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.819676    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-home\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.819828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.819750    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tmp-dir\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.819828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.819759    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-model-cache\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.827389 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.827300    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tls-certs\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.827547 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.827534    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-dshm\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.830625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.830580    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4g9m\" (UniqueName: \"kubernetes.io/projected/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-kube-api-access-h4g9m\") pod \"distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") " pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.863144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.863090    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:24.887441 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.887404    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:24.975692 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.974953    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" event={"ID":"a20bd381-ab4b-491d-b5af-2df04bda447c","Type":"ContainerStarted","Data":"01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa"}
Sep 15 11:47:24.990761 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:24.990576    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:25.195206 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:25.195175    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"]
Sep 15 11:47:25.196019 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:47:25.195987    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e7987dd_220c_4829_9ba8_aa1a7b2ff040.slice/crio-4198f626fb2b08b95d1fe47eb1532773929c51eaec2353769d69c6073b51c1e6 WatchSource:0}: Error finding container 4198f626fb2b08b95d1fe47eb1532773929c51eaec2353769d69c6073b51c1e6: Status 404 returned error can't find the container with id 4198f626fb2b08b95d1fe47eb1532773929c51eaec2353769d69c6073b51c1e6
Sep 15 11:47:25.286191 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:25.286148    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:47:25.286398 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:25.286375    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Sep 15 11:47:25.286498 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:25.286430    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Sep 15 11:47:25.794751 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:25.794714    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:25.983984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:25.983939    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b" event={"ID":"7e7987dd-220c-4829-9ba8-aa1a7b2ff040","Type":"ContainerStarted","Data":"d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e"}
Sep 15 11:47:25.983984 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:25.983989    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b" event={"ID":"7e7987dd-220c-4829-9ba8-aa1a7b2ff040","Type":"ContainerStarted","Data":"4198f626fb2b08b95d1fe47eb1532773929c51eaec2353769d69c6073b51c1e6"}
Sep 15 11:47:26.003794 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:26.003741    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b" podStartSLOduration=2.003722791 podStartE2EDuration="2.003722791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:47:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:47:26.000376664 +0000 UTC m=+1347.756623065" watchObservedRunningTime="2026-09-15 11:47:26.003722791 +0000 UTC m=+1347.759969170"
Sep 15 11:47:26.286420 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:26.286376    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Sep 15 11:47:26.286680 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:26.286456    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Sep 15 11:47:26.440860 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:26.440820    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:27.287143 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:27.287107    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Sep 15 11:47:27.287679 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:27.287170    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Sep 15 11:47:27.335090 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:27.335034    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:28.286576 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:28.286531    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Sep 15 11:47:28.286762 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:28.286613    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Sep 15 11:47:29.287032 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:29.286985    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Sep 15 11:47:29.287493 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:29.287068    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Sep 15 11:47:30.290657 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:30.290616    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:47:30.291054 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:30.290979    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:47:30.291690 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:30.291668    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 11:47:31.014203 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:31.014160    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:34.887586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:34.887530    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:34.887990 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:34.887598    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:34.899847 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:34.899822    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:35.052721 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:35.052691    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:47:36.603789 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:36.603755    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:36.707669 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:36.707615    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:36.795682 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:36.795646    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:36.857459 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:36.857367    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:37.272069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:37.272036    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:37.901693 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:37.901662    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:38.699442 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:38.699405    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:39.390142 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:39.390109    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:39.913453 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:39.913422    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:40.181347 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:40.181254    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:40.838481 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:40.838451    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:41.497504 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:41.497464    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:44.930810 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:44.930769    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:47.397751 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:47.397713    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:47:49.180083 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:49.179867    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:59.025703 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:59.025664    2570 scope.go:117] "RemoveContainer" containerID="2ac96b5571606754a3bdaa56e445baa23e216c1566c92fe77918863948a09f31"
Sep 15 11:47:59.036313 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:47:59.036291    2570 scope.go:117] "RemoveContainer" containerID="6aa9358ed1baf2f30f8d397cba876a13070240f1880d2ac115b7e18afdc35638"
Sep 15 11:48:18.383836 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:18.383801    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:48:22.170314 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:22.170278    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:22.508827 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:22.508787    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:25.709189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:25.709153    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:28.128246 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:28.128205    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:33.786632 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:33.786554    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:42.489743 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:42.489706    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:42.590128 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:42.590089    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:42.736922 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:42.736887    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"]
Sep 15 11:48:42.737223 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:42.737189    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy" containerID="cri-o://b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875" gracePeriod=30
Sep 15 11:48:42.752779 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:42.752703    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:44.032253 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:44.032218    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:44.117611 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:44.117580    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:44.235135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:44.235094    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:44.814010 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:44.813974    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:44.917985 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:44.917950    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:45.225783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:45.225686    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:46.252708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:46.252672    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:47.990392 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:47.990365    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:48:48.021652 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.021617    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-certs\") pod \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") "
Sep 15 11:48:48.021652 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.021655    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-envoy\") pod \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") "
Sep 15 11:48:48.021909 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.021691    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-data\") pod \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") "
Sep 15 11:48:48.021909 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.021752    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-socket\") pod \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") "
Sep 15 11:48:48.021909 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.021778    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-token\") pod \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") "
Sep 15 11:48:48.021909 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.021821    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-podinfo\") pod \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") "
Sep 15 11:48:48.021909 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.021857    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krjbl\" (UniqueName: \"kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-kube-api-access-krjbl\") pod \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") "
Sep 15 11:48:48.022180 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.021922    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31be8bf1-3b3c-4a65-943e-2b4d354b2df2" (UID: "31be8bf1-3b3c-4a65-943e-2b4d354b2df2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:48:48.022180 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.021980    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istiod-ca-cert\") pod \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") "
Sep 15 11:48:48.022180 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.022027    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-credential-socket\") pod \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\" (UID: \"31be8bf1-3b3c-4a65-943e-2b4d354b2df2\") "
Sep 15 11:48:48.022180 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.022154    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31be8bf1-3b3c-4a65-943e-2b4d354b2df2" (UID: "31be8bf1-3b3c-4a65-943e-2b4d354b2df2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:48:48.022398 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.022354    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31be8bf1-3b3c-4a65-943e-2b4d354b2df2" (UID: "31be8bf1-3b3c-4a65-943e-2b4d354b2df2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:48:48.022456 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.022434    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:48:48.022517 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.022458    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:48:48.022517 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.022473    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:48:48.022966 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.022915    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-data" (OuterVolumeSpecName: "istio-data") pod "31be8bf1-3b3c-4a65-943e-2b4d354b2df2" (UID: "31be8bf1-3b3c-4a65-943e-2b4d354b2df2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:48:48.024963 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.024935    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-token" (OuterVolumeSpecName: "istio-token") pod "31be8bf1-3b3c-4a65-943e-2b4d354b2df2" (UID: "31be8bf1-3b3c-4a65-943e-2b4d354b2df2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:48:48.025086 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.024965    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-kube-api-access-krjbl" (OuterVolumeSpecName: "kube-api-access-krjbl") pod "31be8bf1-3b3c-4a65-943e-2b4d354b2df2" (UID: "31be8bf1-3b3c-4a65-943e-2b4d354b2df2"). InnerVolumeSpecName "kube-api-access-krjbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:48:48.025494 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.025365    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31be8bf1-3b3c-4a65-943e-2b4d354b2df2" (UID: "31be8bf1-3b3c-4a65-943e-2b4d354b2df2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:48:48.025494 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.025375    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31be8bf1-3b3c-4a65-943e-2b4d354b2df2" (UID: "31be8bf1-3b3c-4a65-943e-2b4d354b2df2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:48:48.025494 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.025462    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31be8bf1-3b3c-4a65-943e-2b4d354b2df2" (UID: "31be8bf1-3b3c-4a65-943e-2b4d354b2df2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:48:48.124022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.123990    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:48:48.124022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.124017    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:48:48.124022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.124026    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:48:48.124255 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.124035    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krjbl\" (UniqueName: \"kubernetes.io/projected/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-kube-api-access-krjbl\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:48:48.124255 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.124046    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:48:48.124255 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.124055    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31be8bf1-3b3c-4a65-943e-2b4d354b2df2-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:48:48.544144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.544111    2570 generic.go:356] "Generic (PLEG): container finished" podID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerID="b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875" exitCode=0
Sep 15 11:48:48.544367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.544161    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"
Sep 15 11:48:48.544367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.544197    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" event={"ID":"31be8bf1-3b3c-4a65-943e-2b4d354b2df2","Type":"ContainerDied","Data":"b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875"}
Sep 15 11:48:48.544367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.544251    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8" event={"ID":"31be8bf1-3b3c-4a65-943e-2b4d354b2df2","Type":"ContainerDied","Data":"bffdd69b763179cd09fc19daf78c625511299f6fb3ec70135e8fd1aa6bd24623"}
Sep 15 11:48:48.544367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.544275    2570 scope.go:117] "RemoveContainer" containerID="b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875"
Sep 15 11:48:48.556973 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.556955    2570 scope.go:117] "RemoveContainer" containerID="6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9"
Sep 15 11:48:48.565684 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.565668    2570 scope.go:117] "RemoveContainer" containerID="b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875"
Sep 15 11:48:48.565956 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:48:48.565940    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875\": container with ID starting with b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875 not found: ID does not exist" containerID="b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875"
Sep 15 11:48:48.566002 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.565963    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875"} err="failed to get container status \"b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875\": rpc error: code = NotFound desc = could not find container \"b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875\": container with ID starting with b1216cba0d686f963148c9ace688728422e2daffdb763b90a70394c039744875 not found: ID does not exist"
Sep 15 11:48:48.566002 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.565980    2570 scope.go:117] "RemoveContainer" containerID="6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9"
Sep 15 11:48:48.566210 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:48:48.566196    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9\": container with ID starting with 6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9 not found: ID does not exist" containerID="6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9"
Sep 15 11:48:48.566247 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.566214    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9"} err="failed to get container status \"6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9\": rpc error: code = NotFound desc = could not find container \"6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9\": container with ID starting with 6fe456fdd2208e4f6334bf8ac2a5ef4c6ea7cc9a5e8db0c01d74b7a4889bc4c9 not found: ID does not exist"
Sep 15 11:48:48.571537 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.571516    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"]
Sep 15 11:48:48.579355 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.579326    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8"]
Sep 15 11:48:48.781574 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:48.781529    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" path="/var/lib/kubelet/pods/31be8bf1-3b3c-4a65-943e-2b4d354b2df2/volumes"
Sep 15 11:48:50.493773 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:50.493740    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:48:52.725851 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:52.725764    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:52.827588 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:52.827530    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:53.433073 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:53.433038    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:59.063003 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:59.062967    2570 scope.go:117] "RemoveContainer" containerID="b7c2b0ab25024726526593da08da712fad0ba630553795eeeb9968c0774178bb"
Sep 15 11:48:59.162070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:59.162015    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:59.240855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:59.240818    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:59.347147 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:59.347062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:59.445895 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:48:59.445853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:05.413335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:05.413292    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:06.534912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:06.534872    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:09.877652 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:09.877604    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:10.104391 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:10.104353    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:17.593206 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:17.593163    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:31.013435 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:31.013391    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:32.486527 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:32.486490    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:49:36.929245 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:36.929202    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:37.028895 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.028850    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:37.267727 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.267691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:37.542426 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.542342    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"]
Sep 15 11:49:37.543018 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.543003    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy"
Sep 15 11:49:37.543069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.543023    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy"
Sep 15 11:49:37.543069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.543037    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy"
Sep 15 11:49:37.543069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.543045    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy"
Sep 15 11:49:37.543182 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.543144    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy"
Sep 15 11:49:37.543182 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.543159    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="31be8bf1-3b3c-4a65-943e-2b4d354b2df2" containerName="istio-proxy"
Sep 15 11:49:37.546939 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.546916    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.549588 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.549553    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-01df46-openshift-default-dockercfg-kdd2h\""
Sep 15 11:49:37.561086 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.561062    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"]
Sep 15 11:49:37.564996 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.564955    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:37.627103 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.627066    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:37.664296 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.664265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-credential-socket\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.664454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.664330    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-data\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.664454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.664400    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-token\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.664454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.664428    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-socket\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.664454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.664451    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cqvz\" (UniqueName: \"kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-kube-api-access-7cqvz\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.664620 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.664478    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df21e3a-55c6-4943-a159-14fd5c565c71-istiod-ca-cert\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.664620 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.664548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-podinfo\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.664620 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.664609    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-certs\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.664716 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.664628    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-envoy\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.767124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.767087    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-data\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.767438 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.767416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-token\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.767601 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.767580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-socket\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.767737 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.767721    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqvz\" (UniqueName: \"kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-kube-api-access-7cqvz\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.767835 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.767514    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-data\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.767945 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.767853    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df21e3a-55c6-4943-a159-14fd5c565c71-istiod-ca-cert\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.768085 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.768067    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-podinfo\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.768233 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.768218    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-certs\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.768353 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.768334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-envoy\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.768511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.768495    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-credential-socket\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.768703 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.768521    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df21e3a-55c6-4943-a159-14fd5c565c71-istiod-ca-cert\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.768820 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.768778    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-socket\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.769600 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.769578    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-credential-socket\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.770070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.770015    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-certs\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.772873 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.772851    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-envoy\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.781070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.781033    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-token\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.782842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.781701    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cqvz\" (UniqueName: \"kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-kube-api-access-7cqvz\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.783374 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.783350    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-podinfo\") pod \"e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") " pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:37.857793 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:37.857695    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:38.141006 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:49:38.140972    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df21e3a_55c6_4943_a159_14fd5c565c71.slice/crio-515d76117cbc263be03488225e5d80e34882ee42924f29ab1fbf6f3cc07ab450 WatchSource:0}: Error finding container 515d76117cbc263be03488225e5d80e34882ee42924f29ab1fbf6f3cc07ab450: Status 404 returned error can't find the container with id 515d76117cbc263be03488225e5d80e34882ee42924f29ab1fbf6f3cc07ab450
Sep 15 11:49:38.141419 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:38.141377    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"]
Sep 15 11:49:38.143781 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:38.143748    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:49:38.143890 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:38.143826    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:49:38.143890 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:38.143871    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:49:38.874210 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:38.874168    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" event={"ID":"2df21e3a-55c6-4943-a159-14fd5c565c71","Type":"ContainerStarted","Data":"ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637"}
Sep 15 11:49:38.874409 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:38.874231    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" event={"ID":"2df21e3a-55c6-4943-a159-14fd5c565c71","Type":"ContainerStarted","Data":"515d76117cbc263be03488225e5d80e34882ee42924f29ab1fbf6f3cc07ab450"}
Sep 15 11:49:38.895950 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:38.895901    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" podStartSLOduration=1.895886763 podStartE2EDuration="1.895886763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:49:38.893364023 +0000 UTC m=+1480.649610403" watchObservedRunningTime="2026-09-15 11:49:38.895886763 +0000 UTC m=+1480.652133141"
Sep 15 11:49:38.974414 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:38.974378    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:39.648637 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:39.648600    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:39.858782 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:39.858736    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:39.864077 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:39.864047    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:39.881261 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:39.881234    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:39.882289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:39.882269    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:49:40.194317 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:40.194283    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:40.830429 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:40.830393    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:40.925033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:40.924994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:41.557571 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:41.557523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:42.273489 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:42.273457    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:42.972093 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:42.972062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:43.741043 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:43.740994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:44.498708 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:44.498664    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:45.168470 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.168422    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"]
Sep 15 11:49:45.173253 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.173222    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.176403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.176377    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-01df46-serving-cert\""
Sep 15 11:49:45.187503 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.187474    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"]
Sep 15 11:49:45.201316 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.201282    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:45.260241 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.260203    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpg7b\" (UniqueName: \"kubernetes.io/projected/c72186e8-5a83-4a21-bf4f-27f0cd397dde-kube-api-access-rpg7b\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.260430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.260338    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-maas-api-tls\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.260430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.260376    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72186e8-5a83-4a21-bf4f-27f0cd397dde-openshift-service-ca\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.260430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.260412    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-metrics-certs\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.283927 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.283869    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:45.362090 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.362052    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpg7b\" (UniqueName: \"kubernetes.io/projected/c72186e8-5a83-4a21-bf4f-27f0cd397dde-kube-api-access-rpg7b\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.362289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.362165    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-maas-api-tls\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.362289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.362199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72186e8-5a83-4a21-bf4f-27f0cd397dde-openshift-service-ca\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.362289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.362237    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-metrics-certs\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.362871 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.362843    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72186e8-5a83-4a21-bf4f-27f0cd397dde-openshift-service-ca\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.364798 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.364774    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-maas-api-tls\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.364898 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.364825    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-metrics-certs\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.369879 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.369856    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpg7b\" (UniqueName: \"kubernetes.io/projected/c72186e8-5a83-4a21-bf4f-27f0cd397dde-kube-api-access-rpg7b\") pod \"maas-api-e2e-api-a-01df46-645d65847-zx78g\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.377868 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.377839    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:45.488389 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.488290    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:45.752810 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.752723    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:45.767070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.767042    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"]
Sep 15 11:49:45.767496 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:49:45.767471    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72186e8_5a83_4a21_bf4f_27f0cd397dde.slice/crio-2e6fd2d619b7c01aafb8bea351de5b147dcb3b7e10a90c4d1f3bf63ea6e11d6c WatchSource:0}: Error finding container 2e6fd2d619b7c01aafb8bea351de5b147dcb3b7e10a90c4d1f3bf63ea6e11d6c: Status 404 returned error can't find the container with id 2e6fd2d619b7c01aafb8bea351de5b147dcb3b7e10a90c4d1f3bf63ea6e11d6c
Sep 15 11:49:45.834791 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.834757    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:45.921553 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:45.921520    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g" event={"ID":"c72186e8-5a83-4a21-bf4f-27f0cd397dde","Type":"ContainerStarted","Data":"2e6fd2d619b7c01aafb8bea351de5b147dcb3b7e10a90c4d1f3bf63ea6e11d6c"}
Sep 15 11:49:46.930050 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:46.930011    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g" event={"ID":"c72186e8-5a83-4a21-bf4f-27f0cd397dde","Type":"ContainerStarted","Data":"32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d"}
Sep 15 11:49:46.930463 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:46.930088    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:46.950983 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:46.950928    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g" podStartSLOduration=1.399121366 podStartE2EDuration="1.950912127s" totalImagesPullingTime="551.790761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:49:46.94709133 +0000 UTC m=+1488.703337748" watchObservedRunningTime="2026-09-15 11:49:46.950912127 +0000 UTC m=+1488.707158507"
Sep 15 11:49:52.941999 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:52.941969    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:49:56.581933 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:56.581893    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:59.090775 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:49:59.090745    2570 scope.go:117] "RemoveContainer" containerID="a0789479f4ad1184ccc1947659d9a7c50e7279ebdf24e5a1579de23c86eaa8ea"
Sep 15 11:50:05.275707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:05.275670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:05.330552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:05.330513    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:06.367526 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:06.367492    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:07.626392 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:07.626355    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:08.613913 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:08.613872    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:09.037345 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:09.037312    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:09.670693 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:09.670656    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:10.420245 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:10.420209    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:10.873641 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:10.873607    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:11.094322 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.094276    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:11.095603 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.095573    2570 generic.go:356] "Generic (PLEG): container finished" podID="3fa13815-c567-406f-b3e7-368753cf3eb0" containerID="794e0616b82ba62b8f1054ba046f4c9b063068422954189fb67e5aee67c66e67" exitCode=137
Sep 15 11:50:11.095704 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.095628    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44" event={"ID":"3fa13815-c567-406f-b3e7-368753cf3eb0","Type":"ContainerDied","Data":"794e0616b82ba62b8f1054ba046f4c9b063068422954189fb67e5aee67c66e67"}
Sep 15 11:50:11.095960 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.095947    2570 scope.go:117] "RemoveContainer" containerID="794e0616b82ba62b8f1054ba046f4c9b063068422954189fb67e5aee67c66e67"
Sep 15 11:50:11.356585 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.356466    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:11.629661 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.629574    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"]
Sep 15 11:50:11.633430 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.633403    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.636354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.636335    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f3e7da-openshift-default-dockercfg-9vhtt\""
Sep 15 11:50:11.647281 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.647256    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"]
Sep 15 11:50:11.677524 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.677492    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:11.750016 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.749969    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-credential-socket\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.750209 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.750024    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-certs\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.750209 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.750095    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-podinfo\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.750209 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.750124    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-envoy\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.750209 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.750155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-token\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.750209 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.750175    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7316c42-8124-42e2-b76c-c55a9d323cfe-istiod-ca-cert\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.750462 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.750216    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-data\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.750462 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.750291    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-socket\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.750462 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.750344    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntx8j\" (UniqueName: \"kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-kube-api-access-ntx8j\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.851844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.851809    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-data\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.851995 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.851872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-socket\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.851995 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.851912    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntx8j\" (UniqueName: \"kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-kube-api-access-ntx8j\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.851995 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.851967    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-credential-socket\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.851995 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.851984    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-certs\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.852212 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.852034    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-podinfo\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.852212 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.852064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-envoy\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.852212 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.852096    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-token\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.852212 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.852118    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7316c42-8124-42e2-b76c-c55a9d323cfe-istiod-ca-cert\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.852424 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.852244    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-data\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.852424 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.852261    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-socket\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.852424 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.852358    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-credential-socket\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.852424 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.852412    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-certs\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.852773 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.852751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7316c42-8124-42e2-b76c-c55a9d323cfe-istiod-ca-cert\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.854459 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.854438    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-envoy\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.854577 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.854538    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-podinfo\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.866343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.866317    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-token\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.869678 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.869655    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntx8j\" (UniqueName: \"kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-kube-api-access-ntx8j\") pod \"e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") " pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:11.915327 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.915259    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:11.944605 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:11.944581    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:12.076453 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:12.076420    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:12.112180 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:12.112145    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44" event={"ID":"3fa13815-c567-406f-b3e7-368753cf3eb0","Type":"ContainerStarted","Data":"85cf3ff1a6850c2d0978b269738f8a61ab6d655b0ff8ae31dbc7ffd92571a102"}
Sep 15 11:50:12.112391 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:12.112373    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:50:12.230648 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:12.230620    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"]
Sep 15 11:50:12.231827 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:50:12.231798    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7316c42_8124_42e2_b76c_c55a9d323cfe.slice/crio-45051faa8349f221d018115f60be8ead21c1db5f6894a2305936586efd047270 WatchSource:0}: Error finding container 45051faa8349f221d018115f60be8ead21c1db5f6894a2305936586efd047270: Status 404 returned error can't find the container with id 45051faa8349f221d018115f60be8ead21c1db5f6894a2305936586efd047270
Sep 15 11:50:12.234658 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:12.234620    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:12.234737 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:12.234712    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:12.234783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:12.234763    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:13.059597 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:13.059548    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:13.127992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:13.127952    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" event={"ID":"b7316c42-8124-42e2-b76c-c55a9d323cfe","Type":"ContainerStarted","Data":"95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5"}
Sep 15 11:50:13.128187 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:13.128022    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" event={"ID":"b7316c42-8124-42e2-b76c-c55a9d323cfe","Type":"ContainerStarted","Data":"45051faa8349f221d018115f60be8ead21c1db5f6894a2305936586efd047270"}
Sep 15 11:50:13.153754 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:13.153704    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" podStartSLOduration=2.153688567 podStartE2EDuration="2.153688567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:13.152816902 +0000 UTC m=+1514.909063281" watchObservedRunningTime="2026-09-15 11:50:13.153688567 +0000 UTC m=+1514.909934944"
Sep 15 11:50:13.945026 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:13.944993    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:13.950208 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:13.950181    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:14.135205 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:14.135172    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:14.136097 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:14.136079    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:14.511870 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:14.511836    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:15.196859 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:15.196820    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:15.551824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:15.551774    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:16.141432 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:16.141397    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:16.929537 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:16.929501    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:17.797784 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:17.797749    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:18.461325 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:18.461288    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:19.284575 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:19.284524    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:19.929448 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:19.929418    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:20.572856 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.572816    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"]
Sep 15 11:50:20.578038 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.578011    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.580702 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.580672    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f3e7da-serving-cert\""
Sep 15 11:50:20.587509 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.587481    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"]
Sep 15 11:50:20.605935 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.605894    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:20.644202 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.644162    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-metrics-certs\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.644402 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.644287    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d26b68f-7174-4d4a-b60e-2643199a43d0-openshift-service-ca\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.644402 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.644357    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-maas-api-tls\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.644487 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.644420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmkl9\" (UniqueName: \"kubernetes.io/projected/9d26b68f-7174-4d4a-b60e-2643199a43d0-kube-api-access-hmkl9\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.707315 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.707274    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:20.745122 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.745093    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d26b68f-7174-4d4a-b60e-2643199a43d0-openshift-service-ca\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.745318 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.745158    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-maas-api-tls\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.745318 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.745208    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmkl9\" (UniqueName: \"kubernetes.io/projected/9d26b68f-7174-4d4a-b60e-2643199a43d0-kube-api-access-hmkl9\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.745318 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.745259    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-metrics-certs\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.745818 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.745789    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d26b68f-7174-4d4a-b60e-2643199a43d0-openshift-service-ca\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.747870 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.747846    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-maas-api-tls\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.747962 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.747854    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-metrics-certs\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.753017 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.752991    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmkl9\" (UniqueName: \"kubernetes.io/projected/9d26b68f-7174-4d4a-b60e-2643199a43d0-kube-api-access-hmkl9\") pod \"maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:20.837024 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.836931    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:20.892718 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:20.892679    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:21.068449 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:21.068371    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:21.173097 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:21.173065    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"]
Sep 15 11:50:21.174835 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:50:21.174809    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d26b68f_7174_4d4a_b60e_2643199a43d0.slice/crio-59af6bb7545f7b4065189353e23f61e596165938c736bbfc924bea97d1ab4acc WatchSource:0}: Error finding container 59af6bb7545f7b4065189353e23f61e596165938c736bbfc924bea97d1ab4acc: Status 404 returned error can't find the container with id 59af6bb7545f7b4065189353e23f61e596165938c736bbfc924bea97d1ab4acc
Sep 15 11:50:21.180042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:21.179968    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:21.186942 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:21.186918    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn" event={"ID":"9d26b68f-7174-4d4a-b60e-2643199a43d0","Type":"ContainerStarted","Data":"59af6bb7545f7b4065189353e23f61e596165938c736bbfc924bea97d1ab4acc"}
Sep 15 11:50:22.194441 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:22.194402    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn" event={"ID":"9d26b68f-7174-4d4a-b60e-2643199a43d0","Type":"ContainerStarted","Data":"8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551"}
Sep 15 11:50:22.194893 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:22.194464    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:22.217097 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:22.217046    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn" podStartSLOduration=1.8127550879999998 podStartE2EDuration="2.217022752s" totalImagesPullingTime="404.267664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:22.214615879 +0000 UTC m=+1523.970862258" watchObservedRunningTime="2026-09-15 11:50:22.217022752 +0000 UTC m=+1523.973269123"
Sep 15 11:50:23.130289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:23.130258    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 11:50:28.205788 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:28.205760    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:50:41.200211 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:41.200166    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:50:42.766855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:42.766815    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:44.325253 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:44.325203    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:44.983023 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:44.982958    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:45.377948 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:45.377919    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:45.935330 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:45.935247    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:46.718376 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:46.718341    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:47.677648 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:47.677609    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:48.238136 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:48.238069    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:48.973982 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:48.973938    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:49.698209 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:49.698178    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:50.395146 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:50.395073    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:51.051842 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:51.051783    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:51.909622 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:51.909576    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:52.415835 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:52.415803    2570 generic.go:356] "Generic (PLEG): container finished" podID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerID="95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5" exitCode=0
Sep 15 11:50:52.416173 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:52.415877    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" event={"ID":"b7316c42-8124-42e2-b76c-c55a9d323cfe","Type":"ContainerDied","Data":"95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5"}
Sep 15 11:50:52.416371 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:52.416355    2570 scope.go:117] "RemoveContainer" containerID="95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5"
Sep 15 11:50:52.418363 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:52.418311    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:52.418508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:52.418479    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:52.422595 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:52.418663    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:52.557083 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:52.556988    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:53.175250 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.175218    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:53.424753 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.424711    2570 generic.go:356] "Generic (PLEG): container finished" podID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerID="ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637" exitCode=0
Sep 15 11:50:53.425230 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.424928    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" event={"ID":"2df21e3a-55c6-4943-a159-14fd5c565c71","Type":"ContainerDied","Data":"ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637"}
Sep 15 11:50:53.425506 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.425446    2570 scope.go:117] "RemoveContainer" containerID="ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637"
Sep 15 11:50:53.428885 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.428841    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:53.429050 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.429006    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:53.429137 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.429113    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:53.429311 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.429287    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" event={"ID":"b7316c42-8124-42e2-b76c-c55a9d323cfe","Type":"ContainerStarted","Data":"c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb"}
Sep 15 11:50:53.945577 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.945525    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:53.945876 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.945607    2570 patch_prober.go:28] interesting pod/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Sep 15 11:50:53.946039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.946014    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Sep 15 11:50:53.990434 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:53.990401    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:54.443578 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:54.443527    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" event={"ID":"2df21e3a-55c6-4943-a159-14fd5c565c71","Type":"ContainerStarted","Data":"c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4"}
Sep 15 11:50:54.692967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:54.692935    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:54.858641 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:54.858606    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:50:54.859938 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:54.859912    2570 patch_prober.go:28] interesting pod/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 15 11:50:54.860036 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:54.859966    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 15 11:50:54.881807 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:54.881783    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:50:54.945393 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:54.945362    2570 patch_prober.go:28] interesting pod/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Sep 15 11:50:54.945641 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:54.945615    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Sep 15 11:50:55.858809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:55.858769    2570 patch_prober.go:28] interesting pod/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 15 11:50:55.859423 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:55.859387    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 15 11:50:55.945768 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:55.945723    2570 patch_prober.go:28] interesting pod/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Sep 15 11:50:55.945979 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:55.945792    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Sep 15 11:50:56.858687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:56.858643    2570 patch_prober.go:28] interesting pod/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 15 11:50:56.858898 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:56.858710    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 15 11:50:56.945432 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:56.945385    2570 patch_prober.go:28] interesting pod/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Sep 15 11:50:56.945629 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:56.945456    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Sep 15 11:50:57.858388 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:57.858333    2570 patch_prober.go:28] interesting pod/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 15 11:50:57.858717 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:57.858684    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 15 11:50:57.945450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:57.945402    2570 patch_prober.go:28] interesting pod/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Sep 15 11:50:57.946058 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:57.946009    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Sep 15 11:50:58.500695 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:58.500645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:58.858185 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:58.858150    2570 patch_prober.go:28] interesting pod/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 15 11:50:58.858353 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:58.858223    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 15 11:50:58.954899 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:58.954867    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:58.955335 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:58.955287    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:58.956127 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:58.956103    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:50:59.114190 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:59.114100    2570 scope.go:117] "RemoveContainer" containerID="2e62fd459c871d5bca1ce42bfc715a1f76e79351d8cc395376f09f21eac25382"
Sep 15 11:50:59.858628 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:59.858592    2570 patch_prober.go:28] interesting pod/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 15 11:50:59.858809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:50:59.858648    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 15 11:51:00.862051 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:00.862020    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:51:00.863100 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:00.863081    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:51:04.038518 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.038470    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"]
Sep 15 11:51:04.039018 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.038727    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g" podUID="c72186e8-5a83-4a21-bf4f-27f0cd397dde" containerName="maas-api" containerID="cri-o://32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d" gracePeriod=30
Sep 15 11:51:04.065535 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.065506    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:04.164853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.164809    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:04.256551 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.256522    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:04.290951 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.290894    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:51:04.315110 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.315088    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpg7b\" (UniqueName: \"kubernetes.io/projected/c72186e8-5a83-4a21-bf4f-27f0cd397dde-kube-api-access-rpg7b\") pod \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") "
Sep 15 11:51:04.315239 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.315146    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-maas-api-tls\") pod \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") "
Sep 15 11:51:04.315308 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.315236    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72186e8-5a83-4a21-bf4f-27f0cd397dde-openshift-service-ca\") pod \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") "
Sep 15 11:51:04.315308 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.315265    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-metrics-certs\") pod \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\" (UID: \"c72186e8-5a83-4a21-bf4f-27f0cd397dde\") "
Sep 15 11:51:04.315887 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.315860    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c72186e8-5a83-4a21-bf4f-27f0cd397dde-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c72186e8-5a83-4a21-bf4f-27f0cd397dde" (UID: "c72186e8-5a83-4a21-bf4f-27f0cd397dde"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:04.317748 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.317723    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c72186e8-5a83-4a21-bf4f-27f0cd397dde" (UID: "c72186e8-5a83-4a21-bf4f-27f0cd397dde"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:04.317856 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.317748    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c72186e8-5a83-4a21-bf4f-27f0cd397dde" (UID: "c72186e8-5a83-4a21-bf4f-27f0cd397dde"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:04.317856 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.317804    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c72186e8-5a83-4a21-bf4f-27f0cd397dde-kube-api-access-rpg7b" (OuterVolumeSpecName: "kube-api-access-rpg7b") pod "c72186e8-5a83-4a21-bf4f-27f0cd397dde" (UID: "c72186e8-5a83-4a21-bf4f-27f0cd397dde"). InnerVolumeSpecName "kube-api-access-rpg7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:04.329655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.329620    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:04.416969 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.416941    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpg7b\" (UniqueName: \"kubernetes.io/projected/c72186e8-5a83-4a21-bf4f-27f0cd397dde-kube-api-access-rpg7b\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:04.416969 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.416967    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-maas-api-tls\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:04.417112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.416977    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72186e8-5a83-4a21-bf4f-27f0cd397dde-openshift-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:04.417112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.416985    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72186e8-5a83-4a21-bf4f-27f0cd397dde-metrics-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:04.537022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.536988    2570 generic.go:356] "Generic (PLEG): container finished" podID="c72186e8-5a83-4a21-bf4f-27f0cd397dde" containerID="32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d" exitCode=0
Sep 15 11:51:04.537206 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.537036    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"
Sep 15 11:51:04.537206 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.537067    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g" event={"ID":"c72186e8-5a83-4a21-bf4f-27f0cd397dde","Type":"ContainerDied","Data":"32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d"}
Sep 15 11:51:04.537206 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.537123    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g" event={"ID":"c72186e8-5a83-4a21-bf4f-27f0cd397dde","Type":"ContainerDied","Data":"2e6fd2d619b7c01aafb8bea351de5b147dcb3b7e10a90c4d1f3bf63ea6e11d6c"}
Sep 15 11:51:04.537206 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.537145    2570 scope.go:117] "RemoveContainer" containerID="32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d"
Sep 15 11:51:04.547350 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.547333    2570 scope.go:117] "RemoveContainer" containerID="32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d"
Sep 15 11:51:04.547705 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:51:04.547680    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d\": container with ID starting with 32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d not found: ID does not exist" containerID="32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d"
Sep 15 11:51:04.547778 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.547719    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d"} err="failed to get container status \"32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d\": rpc error: code = NotFound desc = could not find container \"32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d\": container with ID starting with 32ac7015c83b8890c45ba2c769d3bcb67b5d30c2a39783e0b49e765ac017ca0d not found: ID does not exist"
Sep 15 11:51:04.561268 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.561244    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"]
Sep 15 11:51:04.564967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.564946    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01df46-645d65847-zx78g"]
Sep 15 11:51:04.601651 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.601618    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:04.710528 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.710486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:04.784385 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:04.784350    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c72186e8-5a83-4a21-bf4f-27f0cd397dde" path="/var/lib/kubelet/pods/c72186e8-5a83-4a21-bf4f-27f0cd397dde/volumes"
Sep 15 11:51:05.389542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:05.389501    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:06.011950 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:06.011916    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:06.113236 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:06.113186    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:06.212408 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:06.212376    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:06.783325 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:06.783292    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:07.770775 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:07.770736    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:08.265364 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:08.265323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:08.606070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:08.605974    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:09.214483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:09.214451    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:10.008115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:10.008076    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:10.627196 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:10.627166    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:10.725588 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:10.725536    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:10.853503 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:10.853473    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"]
Sep 15 11:51:10.853748 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:10.853721    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy" containerID="cri-o://c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4" gracePeriod=30
Sep 15 11:51:10.875822 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:10.875779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:11.697099 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:11.697063    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:12.517872 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:12.517835    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:13.203793 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:13.203762    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:13.585413 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:13.585378    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"]
Sep 15 11:51:13.684112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:13.684078    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:14.004521 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:14.004433    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:14.707707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:14.707675    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:15.391207 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:15.391172    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:15.722607 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:15.722491    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:51:15.864289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:15.864065    2570 patch_prober.go:28] interesting pod/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 15 11:51:15.864289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:15.864138    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 15 11:51:16.114869 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.114843    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:51:16.249572 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.249524    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-data\") pod \"2df21e3a-55c6-4943-a159-14fd5c565c71\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") "
Sep 15 11:51:16.249765 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.249588    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cqvz\" (UniqueName: \"kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-kube-api-access-7cqvz\") pod \"2df21e3a-55c6-4943-a159-14fd5c565c71\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") "
Sep 15 11:51:16.249765 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.249616    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-envoy\") pod \"2df21e3a-55c6-4943-a159-14fd5c565c71\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") "
Sep 15 11:51:16.249765 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.249658    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-token\") pod \"2df21e3a-55c6-4943-a159-14fd5c565c71\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") "
Sep 15 11:51:16.249765 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.249685    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-podinfo\") pod \"2df21e3a-55c6-4943-a159-14fd5c565c71\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") "
Sep 15 11:51:16.249765 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.249727    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df21e3a-55c6-4943-a159-14fd5c565c71-istiod-ca-cert\") pod \"2df21e3a-55c6-4943-a159-14fd5c565c71\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") "
Sep 15 11:51:16.250039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.249788    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-socket\") pod \"2df21e3a-55c6-4943-a159-14fd5c565c71\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") "
Sep 15 11:51:16.250039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.249830    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-certs\") pod \"2df21e3a-55c6-4943-a159-14fd5c565c71\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") "
Sep 15 11:51:16.250039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.249852    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-data" (OuterVolumeSpecName: "istio-data") pod "2df21e3a-55c6-4943-a159-14fd5c565c71" (UID: "2df21e3a-55c6-4943-a159-14fd5c565c71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:16.250039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.249903    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-credential-socket\") pod \"2df21e3a-55c6-4943-a159-14fd5c565c71\" (UID: \"2df21e3a-55c6-4943-a159-14fd5c565c71\") "
Sep 15 11:51:16.250246 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.250085    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2df21e3a-55c6-4943-a159-14fd5c565c71" (UID: "2df21e3a-55c6-4943-a159-14fd5c565c71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:16.250246 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.250211    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2df21e3a-55c6-4943-a159-14fd5c565c71" (UID: "2df21e3a-55c6-4943-a159-14fd5c565c71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:16.250357 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.250268    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2df21e3a-55c6-4943-a159-14fd5c565c71" (UID: "2df21e3a-55c6-4943-a159-14fd5c565c71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:16.250412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.250382    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df21e3a-55c6-4943-a159-14fd5c565c71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2df21e3a-55c6-4943-a159-14fd5c565c71" (UID: "2df21e3a-55c6-4943-a159-14fd5c565c71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:16.250412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.250386    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:16.250507 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.250414    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:16.250507 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.250427    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:16.250507 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.250436    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:16.251991 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.251965    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-token" (OuterVolumeSpecName: "istio-token") pod "2df21e3a-55c6-4943-a159-14fd5c565c71" (UID: "2df21e3a-55c6-4943-a159-14fd5c565c71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:16.252112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.252046    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2df21e3a-55c6-4943-a159-14fd5c565c71" (UID: "2df21e3a-55c6-4943-a159-14fd5c565c71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:16.252248 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.252228    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2df21e3a-55c6-4943-a159-14fd5c565c71" (UID: "2df21e3a-55c6-4943-a159-14fd5c565c71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:51:16.252248 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.252228    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-kube-api-access-7cqvz" (OuterVolumeSpecName: "kube-api-access-7cqvz") pod "2df21e3a-55c6-4943-a159-14fd5c565c71" (UID: "2df21e3a-55c6-4943-a159-14fd5c565c71"). InnerVolumeSpecName "kube-api-access-7cqvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:16.270570 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.270531    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:16.352104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.352016    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cqvz\" (UniqueName: \"kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-kube-api-access-7cqvz\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:16.352104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.352050    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:16.352104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.352058    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:16.352104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.352066    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df21e3a-55c6-4943-a159-14fd5c565c71-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:16.352104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.352073    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df21e3a-55c6-4943-a159-14fd5c565c71-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:16.633643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.630387    2570 generic.go:356] "Generic (PLEG): container finished" podID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerID="c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4" exitCode=0
Sep 15 11:51:16.633643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.630521    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" event={"ID":"2df21e3a-55c6-4943-a159-14fd5c565c71","Type":"ContainerDied","Data":"c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4"}
Sep 15 11:51:16.633643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.630591    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h" event={"ID":"2df21e3a-55c6-4943-a159-14fd5c565c71","Type":"ContainerDied","Data":"515d76117cbc263be03488225e5d80e34882ee42924f29ab1fbf6f3cc07ab450"}
Sep 15 11:51:16.633643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.630624    2570 scope.go:117] "RemoveContainer" containerID="c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4"
Sep 15 11:51:16.633643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.630796    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"
Sep 15 11:51:16.650387 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.649592    2570 scope.go:117] "RemoveContainer" containerID="ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637"
Sep 15 11:51:16.661407 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.661378    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"]
Sep 15 11:51:16.663469 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.663450    2570 scope.go:117] "RemoveContainer" containerID="c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4"
Sep 15 11:51:16.663812 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:51:16.663790    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4\": container with ID starting with c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4 not found: ID does not exist" containerID="c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4"
Sep 15 11:51:16.663877 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.663823    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4"} err="failed to get container status \"c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4\": rpc error: code = NotFound desc = could not find container \"c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4\": container with ID starting with c945d76c53f9213f6e5a255478b929fbe6936d15b1f1e3d8465354c03b0c5ef4 not found: ID does not exist"
Sep 15 11:51:16.663877 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.663841    2570 scope.go:117] "RemoveContainer" containerID="ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637"
Sep 15 11:51:16.664125 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:51:16.664108    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637\": container with ID starting with ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637 not found: ID does not exist" containerID="ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637"
Sep 15 11:51:16.664180 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.664136    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637"} err="failed to get container status \"ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637\": rpc error: code = NotFound desc = could not find container \"ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637\": container with ID starting with ee6c6c35f1efd406cae9bc4e679377fe36cd77c6352f79ad8cdeb894c0193637 not found: ID does not exist"
Sep 15 11:51:16.666123 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.666102    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h"]
Sep 15 11:51:16.782767 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.782729    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" path="/var/lib/kubelet/pods/2df21e3a-55c6-4943-a159-14fd5c565c71/volumes"
Sep 15 11:51:16.915490 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:16.915397    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:18.914072 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:18.914019    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:21.433864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:21.433825    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:24.553586 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:24.553538    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:24.558205 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:24.558176    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll"]
Sep 15 11:51:24.560894 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:24.560873    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9bd868-29824545-j4qll"]
Sep 15 11:51:24.621847 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:24.621813    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:24.687391 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:24.687357    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:24.764115 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:24.764086    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:24.780630 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:24.780604    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="521711a5-bb31-43fd-bf34-ebc51c5e8287" path="/var/lib/kubelet/pods/521711a5-bb31-43fd-bf34-ebc51c5e8287/volumes"
Sep 15 11:51:24.856020 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:24.855925    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:25.094989 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:25.094950    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:25.202077 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:25.201986    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:25.902161 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:25.902125    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:26.573992 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:26.573959    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:27.399850 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:27.399816    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:27.930113 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:27.930080    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"]
Sep 15 11:51:27.930339 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:27.930310    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn" podUID="9d26b68f-7174-4d4a-b60e-2643199a43d0" containerName="maas-api" containerID="cri-o://8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551" gracePeriod=30
Sep 15 11:51:27.954471 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:27.954417    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:28.034095 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.034040    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:28.101239 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.101158    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:28.169801 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.169771    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:28.179179 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.179158    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:51:28.260885 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.260856    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:28.281997 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.281975    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d26b68f-7174-4d4a-b60e-2643199a43d0-openshift-service-ca\") pod \"9d26b68f-7174-4d4a-b60e-2643199a43d0\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") "
Sep 15 11:51:28.282106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.282077    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-metrics-certs\") pod \"9d26b68f-7174-4d4a-b60e-2643199a43d0\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") "
Sep 15 11:51:28.282184 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.282166    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmkl9\" (UniqueName: \"kubernetes.io/projected/9d26b68f-7174-4d4a-b60e-2643199a43d0-kube-api-access-hmkl9\") pod \"9d26b68f-7174-4d4a-b60e-2643199a43d0\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") "
Sep 15 11:51:28.282251 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.282238    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-maas-api-tls\") pod \"9d26b68f-7174-4d4a-b60e-2643199a43d0\" (UID: \"9d26b68f-7174-4d4a-b60e-2643199a43d0\") "
Sep 15 11:51:28.282358 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.282339    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d26b68f-7174-4d4a-b60e-2643199a43d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9d26b68f-7174-4d4a-b60e-2643199a43d0" (UID: "9d26b68f-7174-4d4a-b60e-2643199a43d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:28.282628 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.282613    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d26b68f-7174-4d4a-b60e-2643199a43d0-openshift-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.284200 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.284178    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9d26b68f-7174-4d4a-b60e-2643199a43d0" (UID: "9d26b68f-7174-4d4a-b60e-2643199a43d0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:28.284290 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.284240    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9d26b68f-7174-4d4a-b60e-2643199a43d0" (UID: "9d26b68f-7174-4d4a-b60e-2643199a43d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:28.284290 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.284251    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d26b68f-7174-4d4a-b60e-2643199a43d0-kube-api-access-hmkl9" (OuterVolumeSpecName: "kube-api-access-hmkl9") pod "9d26b68f-7174-4d4a-b60e-2643199a43d0" (UID: "9d26b68f-7174-4d4a-b60e-2643199a43d0"). InnerVolumeSpecName "kube-api-access-hmkl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:28.384274 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.384234    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-metrics-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.384274 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.384276    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmkl9\" (UniqueName: \"kubernetes.io/projected/9d26b68f-7174-4d4a-b60e-2643199a43d0-kube-api-access-hmkl9\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.384274 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.384291    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d26b68f-7174-4d4a-b60e-2643199a43d0-maas-api-tls\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.571252 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.571164    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:28.605937 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.605903    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc" podUID="6ec658f4-4bb5-4924-8655-57bda4f451f4" containerName="main" containerID="cri-o://00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2" gracePeriod=45
Sep 15 11:51:28.710704 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.710673    2570 generic.go:356] "Generic (PLEG): container finished" podID="9d26b68f-7174-4d4a-b60e-2643199a43d0" containerID="8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551" exitCode=0
Sep 15 11:51:28.710866 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.710717    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"
Sep 15 11:51:28.710866 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.710754    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn" event={"ID":"9d26b68f-7174-4d4a-b60e-2643199a43d0","Type":"ContainerDied","Data":"8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551"}
Sep 15 11:51:28.710866 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.710819    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn" event={"ID":"9d26b68f-7174-4d4a-b60e-2643199a43d0","Type":"ContainerDied","Data":"59af6bb7545f7b4065189353e23f61e596165938c736bbfc924bea97d1ab4acc"}
Sep 15 11:51:28.710866 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.710849    2570 scope.go:117] "RemoveContainer" containerID="8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551"
Sep 15 11:51:28.720776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.720757    2570 scope.go:117] "RemoveContainer" containerID="8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551"
Sep 15 11:51:28.721034 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:51:28.721014    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551\": container with ID starting with 8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551 not found: ID does not exist" containerID="8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551"
Sep 15 11:51:28.721107 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.721041    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551"} err="failed to get container status \"8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551\": rpc error: code = NotFound desc = could not find container \"8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551\": container with ID starting with 8cb0c55ccedff53166e6238eef78f6eb06295e4843afeba932f40f600e000551 not found: ID does not exist"
Sep 15 11:51:28.738754 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.738726    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"]
Sep 15 11:51:28.745360 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.745337    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f3e7da-57bf77557f-cjqjn"]
Sep 15 11:51:28.782180 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.782153    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d26b68f-7174-4d4a-b60e-2643199a43d0" path="/var/lib/kubelet/pods/9d26b68f-7174-4d4a-b60e-2643199a43d0/volumes"
Sep 15 11:51:28.850151 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.850123    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:51:28.889245 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889215    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-model-cache\") pod \"6ec658f4-4bb5-4924-8655-57bda4f451f4\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") "
Sep 15 11:51:28.889384 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889328    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ec658f4-4bb5-4924-8655-57bda4f451f4-tls-certs\") pod \"6ec658f4-4bb5-4924-8655-57bda4f451f4\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") "
Sep 15 11:51:28.889384 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889372    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-tmp-dir\") pod \"6ec658f4-4bb5-4924-8655-57bda4f451f4\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") "
Sep 15 11:51:28.889476 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889445    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-home\") pod \"6ec658f4-4bb5-4924-8655-57bda4f451f4\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") "
Sep 15 11:51:28.889529 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889493    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-dshm\") pod \"6ec658f4-4bb5-4924-8655-57bda4f451f4\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") "
Sep 15 11:51:28.889529 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889505    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ec658f4-4bb5-4924-8655-57bda4f451f4" (UID: "6ec658f4-4bb5-4924-8655-57bda4f451f4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:28.889662 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889539    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlcvg\" (UniqueName: \"kubernetes.io/projected/6ec658f4-4bb5-4924-8655-57bda4f451f4-kube-api-access-xlcvg\") pod \"6ec658f4-4bb5-4924-8655-57bda4f451f4\" (UID: \"6ec658f4-4bb5-4924-8655-57bda4f451f4\") "
Sep 15 11:51:28.889725 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889707    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ec658f4-4bb5-4924-8655-57bda4f451f4" (UID: "6ec658f4-4bb5-4924-8655-57bda4f451f4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:28.889779 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889742    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-home" (OuterVolumeSpecName: "home") pod "6ec658f4-4bb5-4924-8655-57bda4f451f4" (UID: "6ec658f4-4bb5-4924-8655-57bda4f451f4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:28.889966 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889949    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-tmp-dir\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.890057 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889967    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-home\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.890057 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.889980    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-model-cache\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.891743 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.891716    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-dshm" (OuterVolumeSpecName: "dshm") pod "6ec658f4-4bb5-4924-8655-57bda4f451f4" (UID: "6ec658f4-4bb5-4924-8655-57bda4f451f4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:28.891907 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.891885    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ec658f4-4bb5-4924-8655-57bda4f451f4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ec658f4-4bb5-4924-8655-57bda4f451f4" (UID: "6ec658f4-4bb5-4924-8655-57bda4f451f4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:28.891965 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.891907    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec658f4-4bb5-4924-8655-57bda4f451f4-kube-api-access-xlcvg" (OuterVolumeSpecName: "kube-api-access-xlcvg") pod "6ec658f4-4bb5-4924-8655-57bda4f451f4" (UID: "6ec658f4-4bb5-4924-8655-57bda4f451f4"). InnerVolumeSpecName "kube-api-access-xlcvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:28.991504 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.991478    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ec658f4-4bb5-4924-8655-57bda4f451f4-tls-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.991504 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.991501    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ec658f4-4bb5-4924-8655-57bda4f451f4-dshm\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.991698 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:28.991512    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlcvg\" (UniqueName: \"kubernetes.io/projected/6ec658f4-4bb5-4924-8655-57bda4f451f4-kube-api-access-xlcvg\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:29.184229 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:29.184144    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:29.726096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:29.726058    2570 generic.go:356] "Generic (PLEG): container finished" podID="6ec658f4-4bb5-4924-8655-57bda4f451f4" containerID="00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2" exitCode=0
Sep 15 11:51:29.726547 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:29.726113    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"
Sep 15 11:51:29.726547 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:29.726144    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc" event={"ID":"6ec658f4-4bb5-4924-8655-57bda4f451f4","Type":"ContainerDied","Data":"00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2"}
Sep 15 11:51:29.726547 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:29.726187    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc" event={"ID":"6ec658f4-4bb5-4924-8655-57bda4f451f4","Type":"ContainerDied","Data":"edfd1a58000e56c335c05a89622d52dde2c9dfcb5f61290f07536a1b83b61ffe"}
Sep 15 11:51:29.726547 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:29.726204    2570 scope.go:117] "RemoveContainer" containerID="00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2"
Sep 15 11:51:29.736273 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:29.736250    2570 scope.go:117] "RemoveContainer" containerID="00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2"
Sep 15 11:51:29.736570 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:51:29.736543    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2\": container with ID starting with 00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2 not found: ID does not exist" containerID="00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2"
Sep 15 11:51:29.736645 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:29.736591    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2"} err="failed to get container status \"00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2\": rpc error: code = NotFound desc = could not find container \"00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2\": container with ID starting with 00a8c591c0f0e74329a392536bf9a6d5f9f92cb6cf7c82237251f23efaaeaeb2 not found: ID does not exist"
Sep 15 11:51:29.753151 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:29.753124    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"]
Sep 15 11:51:29.756383 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:29.756352    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-2-w0-9bd868-kserve-5dd66fd9c-54gjc"]
Sep 15 11:51:29.868410 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:29.868378    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:30.713354 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:30.713321    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:30.781491 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:30.781457    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ec658f4-4bb5-4924-8655-57bda4f451f4" path="/var/lib/kubelet/pods/6ec658f4-4bb5-4924-8655-57bda4f451f4/volumes"
Sep 15 11:51:31.429797 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:31.429764    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:31.951868 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:31.951829    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:32.053299 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:32.053215    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:32.195812 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:32.195781    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"]
Sep 15 11:51:32.196022 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:32.195999    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy" containerID="cri-o://11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e" gracePeriod=30
Sep 15 11:51:32.202917 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:32.202852    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:32.380359 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:32.380323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:33.225582 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:33.225532    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:35.066267 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:35.066233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:35.222026 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:35.221989    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:35.354554 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:35.354471    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"]
Sep 15 11:51:35.354767 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:35.354742    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy" containerID="cri-o://c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb" gracePeriod=30
Sep 15 11:51:35.391252 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:35.391218    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:36.347536 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:36.347505    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:37.064478 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.064441    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:37.450838 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.450812    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:51:37.581659 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.581629    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-podinfo\") pod \"463b5e48-12c2-48b5-8631-8039daa8fabc\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") "
Sep 15 11:51:37.581844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.581673    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9hqr\" (UniqueName: \"kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-kube-api-access-q9hqr\") pod \"463b5e48-12c2-48b5-8631-8039daa8fabc\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") "
Sep 15 11:51:37.581844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.581768    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-socket\") pod \"463b5e48-12c2-48b5-8631-8039daa8fabc\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") "
Sep 15 11:51:37.581844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.581796    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-data\") pod \"463b5e48-12c2-48b5-8631-8039daa8fabc\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") "
Sep 15 11:51:37.581844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.581825    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-envoy\") pod \"463b5e48-12c2-48b5-8631-8039daa8fabc\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") "
Sep 15 11:51:37.582058 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.581865    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/463b5e48-12c2-48b5-8631-8039daa8fabc-istiod-ca-cert\") pod \"463b5e48-12c2-48b5-8631-8039daa8fabc\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") "
Sep 15 11:51:37.582058 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.581918    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-token\") pod \"463b5e48-12c2-48b5-8631-8039daa8fabc\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") "
Sep 15 11:51:37.582058 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.581957    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-certs\") pod \"463b5e48-12c2-48b5-8631-8039daa8fabc\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") "
Sep 15 11:51:37.582219 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.582122    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-data" (OuterVolumeSpecName: "istio-data") pod "463b5e48-12c2-48b5-8631-8039daa8fabc" (UID: "463b5e48-12c2-48b5-8631-8039daa8fabc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.582219 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.582200    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-credential-socket\") pod \"463b5e48-12c2-48b5-8631-8039daa8fabc\" (UID: \"463b5e48-12c2-48b5-8631-8039daa8fabc\") "
Sep 15 11:51:37.582219 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.582207    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "463b5e48-12c2-48b5-8631-8039daa8fabc" (UID: "463b5e48-12c2-48b5-8631-8039daa8fabc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.582368 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.582304    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/463b5e48-12c2-48b5-8631-8039daa8fabc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "463b5e48-12c2-48b5-8631-8039daa8fabc" (UID: "463b5e48-12c2-48b5-8631-8039daa8fabc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:37.582431 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.582407    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "463b5e48-12c2-48b5-8631-8039daa8fabc" (UID: "463b5e48-12c2-48b5-8631-8039daa8fabc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.582546 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.582522    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "463b5e48-12c2-48b5-8631-8039daa8fabc" (UID: "463b5e48-12c2-48b5-8631-8039daa8fabc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.582750 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.582731    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.582809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.582756    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.582809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.582770    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/463b5e48-12c2-48b5-8631-8039daa8fabc-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.582809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.582784    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.582809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.582797    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.584029 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.584003    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "463b5e48-12c2-48b5-8631-8039daa8fabc" (UID: "463b5e48-12c2-48b5-8631-8039daa8fabc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.584114 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.584015    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "463b5e48-12c2-48b5-8631-8039daa8fabc" (UID: "463b5e48-12c2-48b5-8631-8039daa8fabc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:51:37.584299 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.584280    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-kube-api-access-q9hqr" (OuterVolumeSpecName: "kube-api-access-q9hqr") pod "463b5e48-12c2-48b5-8631-8039daa8fabc" (UID: "463b5e48-12c2-48b5-8631-8039daa8fabc"). InnerVolumeSpecName "kube-api-access-q9hqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:37.584351 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.584331    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-token" (OuterVolumeSpecName: "istio-token") pod "463b5e48-12c2-48b5-8631-8039daa8fabc" (UID: "463b5e48-12c2-48b5-8631-8039daa8fabc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:37.684112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.684033    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.684112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.684066    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.684112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.684076    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/463b5e48-12c2-48b5-8631-8039daa8fabc-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.684112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.684085    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9hqr\" (UniqueName: \"kubernetes.io/projected/463b5e48-12c2-48b5-8631-8039daa8fabc-kube-api-access-q9hqr\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.789706 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.789672    2570 generic.go:356] "Generic (PLEG): container finished" podID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerID="11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e" exitCode=0
Sep 15 11:51:37.789872 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.789715    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" event={"ID":"463b5e48-12c2-48b5-8631-8039daa8fabc","Type":"ContainerDied","Data":"11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e"}
Sep 15 11:51:37.789872 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.789720    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"
Sep 15 11:51:37.789872 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.789763    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh" event={"ID":"463b5e48-12c2-48b5-8631-8039daa8fabc","Type":"ContainerDied","Data":"5393098a2eb144b1976cd986cca201bfc647e3a10396546cc2e0140c4dc61eea"}
Sep 15 11:51:37.789872 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.789793    2570 scope.go:117] "RemoveContainer" containerID="11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e"
Sep 15 11:51:37.800073 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.800055    2570 scope.go:117] "RemoveContainer" containerID="79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a"
Sep 15 11:51:37.808530 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.808508    2570 scope.go:117] "RemoveContainer" containerID="11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e"
Sep 15 11:51:37.808851 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:51:37.808817    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e\": container with ID starting with 11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e not found: ID does not exist" containerID="11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e"
Sep 15 11:51:37.808930 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.808852    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e"} err="failed to get container status \"11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e\": rpc error: code = NotFound desc = could not find container \"11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e\": container with ID starting with 11fa66ff563af2aecea7a258802b44f36c668b7852a8081e5e21e5881c877c5e not found: ID does not exist"
Sep 15 11:51:37.808930 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.808873    2570 scope.go:117] "RemoveContainer" containerID="79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a"
Sep 15 11:51:37.809153 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:51:37.809133    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a\": container with ID starting with 79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a not found: ID does not exist" containerID="79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a"
Sep 15 11:51:37.809196 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.809159    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a"} err="failed to get container status \"79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a\": rpc error: code = NotFound desc = could not find container \"79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a\": container with ID starting with 79edd6d145aeee9a0707e61d353e9823f9b3e786e409e7dc1bb66da8fdc0434a not found: ID does not exist"
Sep 15 11:51:37.811448 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.811428    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"]
Sep 15 11:51:37.819676 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.819654    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh"]
Sep 15 11:51:37.906686 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:37.906655    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:38.617760 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:38.617722    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:38.781623 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:38.781589    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" path="/var/lib/kubelet/pods/463b5e48-12c2-48b5-8631-8039daa8fabc/volumes"
Sep 15 11:51:39.273783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:39.273726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:40.105342 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.105287    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:40.605029 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.605008    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:51:40.717772 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.717701    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-data\") pod \"b7316c42-8124-42e2-b76c-c55a9d323cfe\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") "
Sep 15 11:51:40.717772 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.717748    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-certs\") pod \"b7316c42-8124-42e2-b76c-c55a9d323cfe\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") "
Sep 15 11:51:40.717921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.717797    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-socket\") pod \"b7316c42-8124-42e2-b76c-c55a9d323cfe\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") "
Sep 15 11:51:40.717921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.717821    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-token\") pod \"b7316c42-8124-42e2-b76c-c55a9d323cfe\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") "
Sep 15 11:51:40.717921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.717857    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-credential-socket\") pod \"b7316c42-8124-42e2-b76c-c55a9d323cfe\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") "
Sep 15 11:51:40.717921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.717893    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntx8j\" (UniqueName: \"kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-kube-api-access-ntx8j\") pod \"b7316c42-8124-42e2-b76c-c55a9d323cfe\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") "
Sep 15 11:51:40.718078 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.717923    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-podinfo\") pod \"b7316c42-8124-42e2-b76c-c55a9d323cfe\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") "
Sep 15 11:51:40.718078 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.717958    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7316c42-8124-42e2-b76c-c55a9d323cfe-istiod-ca-cert\") pod \"b7316c42-8124-42e2-b76c-c55a9d323cfe\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") "
Sep 15 11:51:40.718078 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.718004    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-envoy\") pod \"b7316c42-8124-42e2-b76c-c55a9d323cfe\" (UID: \"b7316c42-8124-42e2-b76c-c55a9d323cfe\") "
Sep 15 11:51:40.718078 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.718005    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-data" (OuterVolumeSpecName: "istio-data") pod "b7316c42-8124-42e2-b76c-c55a9d323cfe" (UID: "b7316c42-8124-42e2-b76c-c55a9d323cfe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:40.718078 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.718051    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b7316c42-8124-42e2-b76c-c55a9d323cfe" (UID: "b7316c42-8124-42e2-b76c-c55a9d323cfe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:40.718305 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.718108    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b7316c42-8124-42e2-b76c-c55a9d323cfe" (UID: "b7316c42-8124-42e2-b76c-c55a9d323cfe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:40.718368 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.718324    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b7316c42-8124-42e2-b76c-c55a9d323cfe" (UID: "b7316c42-8124-42e2-b76c-c55a9d323cfe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:40.718368 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.718349    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7316c42-8124-42e2-b76c-c55a9d323cfe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b7316c42-8124-42e2-b76c-c55a9d323cfe" (UID: "b7316c42-8124-42e2-b76c-c55a9d323cfe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:40.718486 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.718396    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:40.718486 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.718412    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:40.718486 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.718425    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:40.720093 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.720064    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b7316c42-8124-42e2-b76c-c55a9d323cfe" (UID: "b7316c42-8124-42e2-b76c-c55a9d323cfe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:51:40.720200 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.720128    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b7316c42-8124-42e2-b76c-c55a9d323cfe" (UID: "b7316c42-8124-42e2-b76c-c55a9d323cfe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:40.720200 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.720162    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-token" (OuterVolumeSpecName: "istio-token") pod "b7316c42-8124-42e2-b76c-c55a9d323cfe" (UID: "b7316c42-8124-42e2-b76c-c55a9d323cfe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:40.720200 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.720187    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-kube-api-access-ntx8j" (OuterVolumeSpecName: "kube-api-access-ntx8j") pod "b7316c42-8124-42e2-b76c-c55a9d323cfe" (UID: "b7316c42-8124-42e2-b76c-c55a9d323cfe"). InnerVolumeSpecName "kube-api-access-ntx8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:40.817820 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.817794    2570 generic.go:356] "Generic (PLEG): container finished" podID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerID="c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb" exitCode=0
Sep 15 11:51:40.817937 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.817829    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" event={"ID":"b7316c42-8124-42e2-b76c-c55a9d323cfe","Type":"ContainerDied","Data":"c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb"}
Sep 15 11:51:40.817937 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.817846    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"
Sep 15 11:51:40.817937 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.817875    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn" event={"ID":"b7316c42-8124-42e2-b76c-c55a9d323cfe","Type":"ContainerDied","Data":"45051faa8349f221d018115f60be8ead21c1db5f6894a2305936586efd047270"}
Sep 15 11:51:40.817937 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.817897    2570 scope.go:117] "RemoveContainer" containerID="c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb"
Sep 15 11:51:40.819034 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.819014    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:40.819106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.819040    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:40.819106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.819051    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntx8j\" (UniqueName: \"kubernetes.io/projected/b7316c42-8124-42e2-b76c-c55a9d323cfe-kube-api-access-ntx8j\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:40.819106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.819060    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:40.819106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.819068    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7316c42-8124-42e2-b76c-c55a9d323cfe-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:40.819106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.819076    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7316c42-8124-42e2-b76c-c55a9d323cfe-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:40.827180 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.827162    2570 scope.go:117] "RemoveContainer" containerID="95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5"
Sep 15 11:51:40.835367 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.835344    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"]
Sep 15 11:51:40.835913 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.835894    2570 scope.go:117] "RemoveContainer" containerID="c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb"
Sep 15 11:51:40.836188 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:51:40.836168    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb\": container with ID starting with c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb not found: ID does not exist" containerID="c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb"
Sep 15 11:51:40.836241 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.836195    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb"} err="failed to get container status \"c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb\": rpc error: code = NotFound desc = could not find container \"c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb\": container with ID starting with c6f9f07f77ab9d01d11e86f53b5789bf025e89392a2c0ad6572209de6bddbabb not found: ID does not exist"
Sep 15 11:51:40.836241 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.836212    2570 scope.go:117] "RemoveContainer" containerID="95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5"
Sep 15 11:51:40.836487 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:51:40.836470    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5\": container with ID starting with 95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5 not found: ID does not exist" containerID="95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5"
Sep 15 11:51:40.836541 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.836495    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5"} err="failed to get container status \"95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5\": rpc error: code = NotFound desc = could not find container \"95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5\": container with ID starting with 95128c20273efbad3fd6cf0f05fa4ef8c948d692b5c956e63b39c394455450a5 not found: ID does not exist"
Sep 15 11:51:40.841917 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.841895    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn"]
Sep 15 11:51:40.961553 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:40.961532    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:42.781102 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:42.781068    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" path="/var/lib/kubelet/pods/b7316c42-8124-42e2-b76c-c55a9d323cfe/volumes"
Sep 15 11:51:45.836029 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:45.835996    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:46.387180 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:46.387142    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:46.484176 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:46.484146    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:46.585306 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:46.585275    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:46.654048 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:46.653970    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:47.010280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:47.010246    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:47.110205 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:47.110170    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:47.883841 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:47.883809    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:48.822480 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:48.822444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:49.398701 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:49.398667    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:50.102119 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:50.102082    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:50.201643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:50.201606    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:51:50.940839 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:50.940806    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:51.011192 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:51.011115    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:52.091461 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:52.091414    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:53.016634 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:53.016604    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:53.080904 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:53.080861    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:53.243694 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:53.243539    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"]
Sep 15 11:51:53.244130 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:53.243821    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy" containerID="cri-o://d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a" gracePeriod=30
Sep 15 11:51:53.269973 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:53.269898    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:53.870268 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:53.870236    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:54.590211 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:54.590172    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:55.447343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:55.447310    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:56.177231 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:56.177203    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:56.976799 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:56.976766    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:57.177593 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:57.177546    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:57.803345 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:57.803306    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:58.495308 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.495285    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:51:58.502829 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.502804    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:58.690110 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690078    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-data\") pod \"8f41e208-08da-4777-8196-15c3e87f151b\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") "
Sep 15 11:51:58.690301 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690175    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f41e208-08da-4777-8196-15c3e87f151b-istiod-ca-cert\") pod \"8f41e208-08da-4777-8196-15c3e87f151b\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") "
Sep 15 11:51:58.690301 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690207    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-envoy\") pod \"8f41e208-08da-4777-8196-15c3e87f151b\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") "
Sep 15 11:51:58.690443 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690370    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-credential-socket\") pod \"8f41e208-08da-4777-8196-15c3e87f151b\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") "
Sep 15 11:51:58.690443 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690387    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f41e208-08da-4777-8196-15c3e87f151b" (UID: "8f41e208-08da-4777-8196-15c3e87f151b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:58.690443 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690411    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lns8r\" (UniqueName: \"kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-kube-api-access-lns8r\") pod \"8f41e208-08da-4777-8196-15c3e87f151b\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") "
Sep 15 11:51:58.690625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690488    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-istio-token\") pod \"8f41e208-08da-4777-8196-15c3e87f151b\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") "
Sep 15 11:51:58.690625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690508    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f41e208-08da-4777-8196-15c3e87f151b-istio-podinfo\") pod \"8f41e208-08da-4777-8196-15c3e87f151b\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") "
Sep 15 11:51:58.690625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690525    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-socket\") pod \"8f41e208-08da-4777-8196-15c3e87f151b\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") "
Sep 15 11:51:58.690625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690530    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f41e208-08da-4777-8196-15c3e87f151b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f41e208-08da-4777-8196-15c3e87f151b" (UID: "8f41e208-08da-4777-8196-15c3e87f151b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:58.690625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690546    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-certs\") pod \"8f41e208-08da-4777-8196-15c3e87f151b\" (UID: \"8f41e208-08da-4777-8196-15c3e87f151b\") "
Sep 15 11:51:58.690625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690586    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f41e208-08da-4777-8196-15c3e87f151b" (UID: "8f41e208-08da-4777-8196-15c3e87f151b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:58.690926 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690722    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f41e208-08da-4777-8196-15c3e87f151b" (UID: "8f41e208-08da-4777-8196-15c3e87f151b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:58.690926 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690801    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f41e208-08da-4777-8196-15c3e87f151b" (UID: "8f41e208-08da-4777-8196-15c3e87f151b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:58.691009 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690942    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f41e208-08da-4777-8196-15c3e87f151b-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:58.691009 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690961    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:58.691009 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690974    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:58.691009 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690987    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:58.691009 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.690999    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:58.692612 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.692589    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f41e208-08da-4777-8196-15c3e87f151b" (UID: "8f41e208-08da-4777-8196-15c3e87f151b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:58.692679 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.692632    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f41e208-08da-4777-8196-15c3e87f151b" (UID: "8f41e208-08da-4777-8196-15c3e87f151b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:58.692878 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.692857    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f41e208-08da-4777-8196-15c3e87f151b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f41e208-08da-4777-8196-15c3e87f151b" (UID: "8f41e208-08da-4777-8196-15c3e87f151b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:51:58.692937 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.692880    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-kube-api-access-lns8r" (OuterVolumeSpecName: "kube-api-access-lns8r") pod "8f41e208-08da-4777-8196-15c3e87f151b" (UID: "8f41e208-08da-4777-8196-15c3e87f151b"). InnerVolumeSpecName "kube-api-access-lns8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:58.791909 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.791884    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:58.791909 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.791904    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f41e208-08da-4777-8196-15c3e87f151b-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:58.792044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.791915    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f41e208-08da-4777-8196-15c3e87f151b-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:58.792044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.791926    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lns8r\" (UniqueName: \"kubernetes.io/projected/8f41e208-08da-4777-8196-15c3e87f151b-kube-api-access-lns8r\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:51:58.939090 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.939059    2570 generic.go:356] "Generic (PLEG): container finished" podID="8f41e208-08da-4777-8196-15c3e87f151b" containerID="d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a" exitCode=0
Sep 15 11:51:58.939230 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.939111    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"
Sep 15 11:51:58.939230 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.939148    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" event={"ID":"8f41e208-08da-4777-8196-15c3e87f151b","Type":"ContainerDied","Data":"d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a"}
Sep 15 11:51:58.939230 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.939205    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq" event={"ID":"8f41e208-08da-4777-8196-15c3e87f151b","Type":"ContainerDied","Data":"50fbfa5912428d53f1095e0fdd631185ef8fc0356b35830ccec75be0ff54f5d8"}
Sep 15 11:51:58.939230 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.939227    2570 scope.go:117] "RemoveContainer" containerID="d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a"
Sep 15 11:51:58.948415 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.948397    2570 scope.go:117] "RemoveContainer" containerID="9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4"
Sep 15 11:51:58.958084 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.958068    2570 scope.go:117] "RemoveContainer" containerID="d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a"
Sep 15 11:51:58.958346 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:51:58.958328    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a\": container with ID starting with d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a not found: ID does not exist" containerID="d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a"
Sep 15 11:51:58.958410 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.958351    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a"} err="failed to get container status \"d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a\": rpc error: code = NotFound desc = could not find container \"d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a\": container with ID starting with d09e2f4c3f1fc898a12fe91197a3728fb021275d91532ecfaae6cb2bda66487a not found: ID does not exist"
Sep 15 11:51:58.958410 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.958367    2570 scope.go:117] "RemoveContainer" containerID="9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4"
Sep 15 11:51:58.958593 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:51:58.958577    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4\": container with ID starting with 9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4 not found: ID does not exist" containerID="9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4"
Sep 15 11:51:58.958637 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.958598    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4"} err="failed to get container status \"9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4\": rpc error: code = NotFound desc = could not find container \"9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4\": container with ID starting with 9c6ad70f3959fad47a20ddf782bbe9ffeb5d46f218d3b107576c5d76844a1ef4 not found: ID does not exist"
Sep 15 11:51:58.959168 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.959150    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"]
Sep 15 11:51:58.964733 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:58.964713    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq"]
Sep 15 11:51:59.155320 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:59.155286    2570 scope.go:117] "RemoveContainer" containerID="ae72768c166968307a7333e1f5b48ad0f082e72a43b37c38f24a2bcb8ba7d634"
Sep 15 11:51:59.164416 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:59.164396    2570 scope.go:117] "RemoveContainer" containerID="03dbebf6025c29058945cdf033b2563ebfdff348a7b93ee8b8b450b9cd22f08b"
Sep 15 11:51:59.233512 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:51:59.233486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:00.004005 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:00.003970    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:00.781674 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:00.781644    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f41e208-08da-4777-8196-15c3e87f151b" path="/var/lib/kubelet/pods/8f41e208-08da-4777-8196-15c3e87f151b/volumes"
Sep 15 11:52:00.798526 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:00.798496    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:02.112498 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:02.112457    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"]
Sep 15 11:52:02.202923 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:02.202887    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:03.785603 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:03.785548    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:04.352679 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:04.352628    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:04.359293 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:04.359269    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k"]
Sep 15 11:52:04.363460 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:04.363434    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4dbbbf-29824545-zkq9k"]
Sep 15 11:52:04.452596 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:04.452551    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:04.556852 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:04.556803    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:04.624275 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:04.624201    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:04.784310 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:04.784265    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02cbaba6-af62-4681-a9e5-3b77aa539dd1" path="/var/lib/kubelet/pods/02cbaba6-af62-4681-a9e5-3b77aa539dd1/volumes"
Sep 15 11:52:04.954687 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:04.954596    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:05.054777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:05.054745    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:05.826445 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:05.826413    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:06.498315 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:06.498275    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:07.269295 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:07.269263    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:07.373682 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:07.373640    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:10.613635 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:10.613549    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:10.689867 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:10.689833    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:10.836248 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:10.836219    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"]
Sep 15 11:52:10.836479 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:10.836449    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy" containerID="cri-o://82c4c2ce509189cc85708b9fc6c3229deb37ebb07754aeb126e7e0ce992f4f45" gracePeriod=30
Sep 15 11:52:10.868177 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:10.868112    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:12.782253 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:12.782225    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:52:12.938899 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:12.938869    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng"]
Sep 15 11:52:12.940398 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:12.940357    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:12.941476 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:12.941455    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2fab1f-29824545-vrfng"]
Sep 15 11:52:13.003118 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:13.003081    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:13.067800 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:13.067720    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:13.140289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:13.140238    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:13.487118 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:13.487034    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:13.607752 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:13.607717    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:14.334802 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:14.334760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:14.780912 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:14.780873    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="201f9d53-22cc-4bae-9e14-cbc407d88992" path="/var/lib/kubelet/pods/201f9d53-22cc-4bae-9e14-cbc407d88992/volumes"
Sep 15 11:52:15.583060 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:15.583011    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:16.048415 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.048378    2570 generic.go:356] "Generic (PLEG): container finished" podID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerID="82c4c2ce509189cc85708b9fc6c3229deb37ebb07754aeb126e7e0ce992f4f45" exitCode=0
Sep 15 11:52:16.048592 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.048446    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" event={"ID":"bd05048f-54ff-48a2-9709-23bdc199d38b","Type":"ContainerDied","Data":"82c4c2ce509189cc85708b9fc6c3229deb37ebb07754aeb126e7e0ce992f4f45"}
Sep 15 11:52:16.048592 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.048507    2570 scope.go:117] "RemoveContainer" containerID="88349d5b1d64560880f3174d019681994a3b2af3a8924afe357635f9b1cb72cc"
Sep 15 11:52:16.091636 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.091616    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:52:16.130709 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.130649    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-podinfo\") pod \"bd05048f-54ff-48a2-9709-23bdc199d38b\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") "
Sep 15 11:52:16.130709 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.130695    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njw8z\" (UniqueName: \"kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-kube-api-access-njw8z\") pod \"bd05048f-54ff-48a2-9709-23bdc199d38b\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") "
Sep 15 11:52:16.130864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.130725    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-socket\") pod \"bd05048f-54ff-48a2-9709-23bdc199d38b\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") "
Sep 15 11:52:16.130864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.130755    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-envoy\") pod \"bd05048f-54ff-48a2-9709-23bdc199d38b\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") "
Sep 15 11:52:16.130864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.130789    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-token\") pod \"bd05048f-54ff-48a2-9709-23bdc199d38b\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") "
Sep 15 11:52:16.130864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.130826    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-credential-socket\") pod \"bd05048f-54ff-48a2-9709-23bdc199d38b\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") "
Sep 15 11:52:16.130864 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.130864    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd05048f-54ff-48a2-9709-23bdc199d38b-istiod-ca-cert\") pod \"bd05048f-54ff-48a2-9709-23bdc199d38b\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") "
Sep 15 11:52:16.131123 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.130939    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-data\") pod \"bd05048f-54ff-48a2-9709-23bdc199d38b\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") "
Sep 15 11:52:16.131123 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.130993    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-certs\") pod \"bd05048f-54ff-48a2-9709-23bdc199d38b\" (UID: \"bd05048f-54ff-48a2-9709-23bdc199d38b\") "
Sep 15 11:52:16.131123 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.131005    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd05048f-54ff-48a2-9709-23bdc199d38b" (UID: "bd05048f-54ff-48a2-9709-23bdc199d38b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:16.131289 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.131264    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd05048f-54ff-48a2-9709-23bdc199d38b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd05048f-54ff-48a2-9709-23bdc199d38b" (UID: "bd05048f-54ff-48a2-9709-23bdc199d38b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:16.131379 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.131359    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:16.131443 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.131383    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd05048f-54ff-48a2-9709-23bdc199d38b-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:16.131506 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.131475    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd05048f-54ff-48a2-9709-23bdc199d38b" (UID: "bd05048f-54ff-48a2-9709-23bdc199d38b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:16.131665 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.131633    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd05048f-54ff-48a2-9709-23bdc199d38b" (UID: "bd05048f-54ff-48a2-9709-23bdc199d38b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:16.131753 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.131709    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd05048f-54ff-48a2-9709-23bdc199d38b" (UID: "bd05048f-54ff-48a2-9709-23bdc199d38b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:16.133100 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.133079    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-kube-api-access-njw8z" (OuterVolumeSpecName: "kube-api-access-njw8z") pod "bd05048f-54ff-48a2-9709-23bdc199d38b" (UID: "bd05048f-54ff-48a2-9709-23bdc199d38b"). InnerVolumeSpecName "kube-api-access-njw8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:16.133100 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.133078    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd05048f-54ff-48a2-9709-23bdc199d38b" (UID: "bd05048f-54ff-48a2-9709-23bdc199d38b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:16.133640 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.133609    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd05048f-54ff-48a2-9709-23bdc199d38b" (UID: "bd05048f-54ff-48a2-9709-23bdc199d38b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:52:16.133729 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.133680    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd05048f-54ff-48a2-9709-23bdc199d38b" (UID: "bd05048f-54ff-48a2-9709-23bdc199d38b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:16.232057 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.232031    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:16.232057 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.232054    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:16.232190 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.232063    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njw8z\" (UniqueName: \"kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-kube-api-access-njw8z\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:16.232190 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.232072    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:16.232190 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.232080    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:16.232190 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.232089    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:16.232190 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:16.232096    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd05048f-54ff-48a2-9709-23bdc199d38b-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:17.055951 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.055880    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"
Sep 15 11:52:17.055951 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.055891    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq" event={"ID":"bd05048f-54ff-48a2-9709-23bdc199d38b","Type":"ContainerDied","Data":"fca74c79d2e65ab979dc3ac924953486f23e59d4c0c60f81753dfedf0d20fbd4"}
Sep 15 11:52:17.055951 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.055950    2570 scope.go:117] "RemoveContainer" containerID="82c4c2ce509189cc85708b9fc6c3229deb37ebb07754aeb126e7e0ce992f4f45"
Sep 15 11:52:17.083792 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.083764    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"]
Sep 15 11:52:17.088881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.088858    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq"]
Sep 15 11:52:17.137876 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.137846    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b" podUID="7e7987dd-220c-4829-9ba8-aa1a7b2ff040" containerName="main" containerID="cri-o://d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e" gracePeriod=45
Sep 15 11:52:17.389751 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.389725    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:52:17.442207 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.442174    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-home\") pod \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") "
Sep 15 11:52:17.442345 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.442246    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tls-certs\") pod \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") "
Sep 15 11:52:17.442345 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.442297    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tmp-dir\") pod \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") "
Sep 15 11:52:17.442345 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.442325    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4g9m\" (UniqueName: \"kubernetes.io/projected/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-kube-api-access-h4g9m\") pod \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") "
Sep 15 11:52:17.442542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.442383    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-model-cache\") pod \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") "
Sep 15 11:52:17.442542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.442404    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-home" (OuterVolumeSpecName: "home") pod "7e7987dd-220c-4829-9ba8-aa1a7b2ff040" (UID: "7e7987dd-220c-4829-9ba8-aa1a7b2ff040"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:17.442542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.442420    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-dshm\") pod \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\" (UID: \"7e7987dd-220c-4829-9ba8-aa1a7b2ff040\") "
Sep 15 11:52:17.443096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.442879    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e7987dd-220c-4829-9ba8-aa1a7b2ff040" (UID: "7e7987dd-220c-4829-9ba8-aa1a7b2ff040"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:17.443096 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.442908    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-home\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:17.443263 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.443099    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e7987dd-220c-4829-9ba8-aa1a7b2ff040" (UID: "7e7987dd-220c-4829-9ba8-aa1a7b2ff040"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:17.445128 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.445103    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-dshm" (OuterVolumeSpecName: "dshm") pod "7e7987dd-220c-4829-9ba8-aa1a7b2ff040" (UID: "7e7987dd-220c-4829-9ba8-aa1a7b2ff040"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:17.445128 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.445116    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-kube-api-access-h4g9m" (OuterVolumeSpecName: "kube-api-access-h4g9m") pod "7e7987dd-220c-4829-9ba8-aa1a7b2ff040" (UID: "7e7987dd-220c-4829-9ba8-aa1a7b2ff040"). InnerVolumeSpecName "kube-api-access-h4g9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:17.445482 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.445456    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e7987dd-220c-4829-9ba8-aa1a7b2ff040" (UID: "7e7987dd-220c-4829-9ba8-aa1a7b2ff040"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:17.543609 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.543579    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-model-cache\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:17.543609 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.543610    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-dshm\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:17.543823 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.543622    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tls-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:17.543823 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.543633    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-tmp-dir\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:17.543823 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:17.543646    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4g9m\" (UniqueName: \"kubernetes.io/projected/7e7987dd-220c-4829-9ba8-aa1a7b2ff040-kube-api-access-h4g9m\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:18.064023 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:18.063985    2570 generic.go:356] "Generic (PLEG): container finished" podID="7e7987dd-220c-4829-9ba8-aa1a7b2ff040" containerID="d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e" exitCode=0
Sep 15 11:52:18.064428 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:18.064025    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"
Sep 15 11:52:18.064428 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:18.064049    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b" event={"ID":"7e7987dd-220c-4829-9ba8-aa1a7b2ff040","Type":"ContainerDied","Data":"d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e"}
Sep 15 11:52:18.064428 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:18.064084    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b" event={"ID":"7e7987dd-220c-4829-9ba8-aa1a7b2ff040","Type":"ContainerDied","Data":"4198f626fb2b08b95d1fe47eb1532773929c51eaec2353769d69c6073b51c1e6"}
Sep 15 11:52:18.064428 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:18.064103    2570 scope.go:117] "RemoveContainer" containerID="d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e"
Sep 15 11:52:18.073744 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:18.073726    2570 scope.go:117] "RemoveContainer" containerID="d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e"
Sep 15 11:52:18.073996 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:52:18.073977    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e\": container with ID starting with d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e not found: ID does not exist" containerID="d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e"
Sep 15 11:52:18.074057 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:18.074004    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e"} err="failed to get container status \"d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e\": rpc error: code = NotFound desc = could not find container \"d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e\": container with ID starting with d83811fb27c6a06f4499d772f1c6627e7886ddd3202e06c0f1de653113ec046e not found: ID does not exist"
Sep 15 11:52:18.115075 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:18.115054    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"]
Sep 15 11:52:18.126542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:18.126519    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2fab1f/distinct-w4-2fab1f-kserve-6f97f955c9-h2x5b"]
Sep 15 11:52:18.780871 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:18.780840    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e7987dd-220c-4829-9ba8-aa1a7b2ff040" path="/var/lib/kubelet/pods/7e7987dd-220c-4829-9ba8-aa1a7b2ff040/volumes"
Sep 15 11:52:18.781277 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:18.781263    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" path="/var/lib/kubelet/pods/bd05048f-54ff-48a2-9709-23bdc199d38b/volumes"
Sep 15 11:52:19.870077 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:19.870045    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:19.968331 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:19.968302    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:20.114360 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:20.114329    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"]
Sep 15 11:52:20.114580 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:20.114544    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy" containerID="cri-o://55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549" gracePeriod=30
Sep 15 11:52:20.127634 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:20.127540    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:24.524235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:24.524200    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 11:52:24.524686 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:24.524259    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 11:52:25.366491 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.366462    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:52:25.409693 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.409586    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/904a76a3-6f86-4da9-87e1-13761088ba29-istiod-ca-cert\") pod \"904a76a3-6f86-4da9-87e1-13761088ba29\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") "
Sep 15 11:52:25.409693 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.409666    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-credential-socket\") pod \"904a76a3-6f86-4da9-87e1-13761088ba29\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") "
Sep 15 11:52:25.409908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.409693    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-istio-token\") pod \"904a76a3-6f86-4da9-87e1-13761088ba29\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") "
Sep 15 11:52:25.409908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.409721    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-data\") pod \"904a76a3-6f86-4da9-87e1-13761088ba29\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") "
Sep 15 11:52:25.409908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.409749    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4z6x\" (UniqueName: \"kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-kube-api-access-p4z6x\") pod \"904a76a3-6f86-4da9-87e1-13761088ba29\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") "
Sep 15 11:52:25.409908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.409803    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/904a76a3-6f86-4da9-87e1-13761088ba29-istio-podinfo\") pod \"904a76a3-6f86-4da9-87e1-13761088ba29\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") "
Sep 15 11:52:25.409908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.409847    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-socket\") pod \"904a76a3-6f86-4da9-87e1-13761088ba29\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") "
Sep 15 11:52:25.409908 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.409874    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-certs\") pod \"904a76a3-6f86-4da9-87e1-13761088ba29\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") "
Sep 15 11:52:25.410222 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.409933    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-envoy\") pod \"904a76a3-6f86-4da9-87e1-13761088ba29\" (UID: \"904a76a3-6f86-4da9-87e1-13761088ba29\") "
Sep 15 11:52:25.410222 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.409981    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "904a76a3-6f86-4da9-87e1-13761088ba29" (UID: "904a76a3-6f86-4da9-87e1-13761088ba29"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:25.410222 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.409991    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/904a76a3-6f86-4da9-87e1-13761088ba29-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "904a76a3-6f86-4da9-87e1-13761088ba29" (UID: "904a76a3-6f86-4da9-87e1-13761088ba29"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:25.410222 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.410140    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-data" (OuterVolumeSpecName: "istio-data") pod "904a76a3-6f86-4da9-87e1-13761088ba29" (UID: "904a76a3-6f86-4da9-87e1-13761088ba29"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:25.410424 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.410357    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "904a76a3-6f86-4da9-87e1-13761088ba29" (UID: "904a76a3-6f86-4da9-87e1-13761088ba29"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:25.410424 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.410373    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/904a76a3-6f86-4da9-87e1-13761088ba29-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:25.410424 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.410393    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:25.410424 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.410407    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:25.410720 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.410546    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "904a76a3-6f86-4da9-87e1-13761088ba29" (UID: "904a76a3-6f86-4da9-87e1-13761088ba29"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:25.412250 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.412211    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-kube-api-access-p4z6x" (OuterVolumeSpecName: "kube-api-access-p4z6x") pod "904a76a3-6f86-4da9-87e1-13761088ba29" (UID: "904a76a3-6f86-4da9-87e1-13761088ba29"). InnerVolumeSpecName "kube-api-access-p4z6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:25.412378 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.412310    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-istio-token" (OuterVolumeSpecName: "istio-token") pod "904a76a3-6f86-4da9-87e1-13761088ba29" (UID: "904a76a3-6f86-4da9-87e1-13761088ba29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:25.412576 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.412531    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/904a76a3-6f86-4da9-87e1-13761088ba29-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "904a76a3-6f86-4da9-87e1-13761088ba29" (UID: "904a76a3-6f86-4da9-87e1-13761088ba29"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:52:25.412704 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.412595    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "904a76a3-6f86-4da9-87e1-13761088ba29" (UID: "904a76a3-6f86-4da9-87e1-13761088ba29"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:25.511286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.511229    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:25.511286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.511274    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4z6x\" (UniqueName: \"kubernetes.io/projected/904a76a3-6f86-4da9-87e1-13761088ba29-kube-api-access-p4z6x\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:25.511286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.511285    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/904a76a3-6f86-4da9-87e1-13761088ba29-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:25.511286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.511293    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:25.511286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.511302    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:25.511286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.511310    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/904a76a3-6f86-4da9-87e1-13761088ba29-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:52:25.859462 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:25.859425    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:26.121532 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.121455    2570 generic.go:356] "Generic (PLEG): container finished" podID="904a76a3-6f86-4da9-87e1-13761088ba29" containerID="55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549" exitCode=0
Sep 15 11:52:26.121532 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.121508    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"
Sep 15 11:52:26.121769 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.121548    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" event={"ID":"904a76a3-6f86-4da9-87e1-13761088ba29","Type":"ContainerDied","Data":"55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549"}
Sep 15 11:52:26.121769 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.121632    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x" event={"ID":"904a76a3-6f86-4da9-87e1-13761088ba29","Type":"ContainerDied","Data":"ef8a462a238232927435eb78f70c753177f59134d635fbbee5028f4913d8b5c5"}
Sep 15 11:52:26.121769 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.121665    2570 scope.go:117] "RemoveContainer" containerID="55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549"
Sep 15 11:52:26.132265 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.132249    2570 scope.go:117] "RemoveContainer" containerID="4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23"
Sep 15 11:52:26.140732 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.140714    2570 scope.go:117] "RemoveContainer" containerID="55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549"
Sep 15 11:52:26.141004 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:52:26.140984    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549\": container with ID starting with 55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549 not found: ID does not exist" containerID="55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549"
Sep 15 11:52:26.141061 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.141011    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549"} err="failed to get container status \"55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549\": rpc error: code = NotFound desc = could not find container \"55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549\": container with ID starting with 55646f150080e70ed6dae1270ad1675c1c132e565808f7eaa0415400ceb7f549 not found: ID does not exist"
Sep 15 11:52:26.141061 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.141029    2570 scope.go:117] "RemoveContainer" containerID="4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23"
Sep 15 11:52:26.141287 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:52:26.141270    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23\": container with ID starting with 4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23 not found: ID does not exist" containerID="4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23"
Sep 15 11:52:26.141341 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.141294    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23"} err="failed to get container status \"4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23\": rpc error: code = NotFound desc = could not find container \"4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23\": container with ID starting with 4a3fa01208b26a6cda5c7d400ffb0b3d3fd3c32cf9b9bce0e8fef7250022fd23 not found: ID does not exist"
Sep 15 11:52:26.144884 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.144861    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"]
Sep 15 11:52:26.150473 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.150452    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x"]
Sep 15 11:52:26.780280 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:26.780251    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" path="/var/lib/kubelet/pods/904a76a3-6f86-4da9-87e1-13761088ba29/volumes"
Sep 15 11:52:32.392091 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:32.392059    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:52:38.970433 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:38.970395    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:39.069707 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:39.069671    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:39.705464 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:39.705426    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:45.585986 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:45.585951    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:52:52.195603 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:52.195552    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:57.679298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:57.679263    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:52:59.219333 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.219299    2570 scope.go:117] "RemoveContainer" containerID="1d4daa7f39d07c8dae69e16df1d176755b1780e687a6e94d1f06979dd48ad7c2"
Sep 15 11:52:59.227874 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.227855    2570 scope.go:117] "RemoveContainer" containerID="2bd38b3461f02ce9f9615009bbe58ff19020b26f51bcd5a015656c760b7fb40c"
Sep 15 11:52:59.286272 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286250    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7479-32ab51"]
Sep 15 11:52:59.286712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286693    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy"
Sep 15 11:52:59.286712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286711    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286723    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec658f4-4bb5-4924-8655-57bda4f451f4" containerName="main"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286732    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec658f4-4bb5-4924-8655-57bda4f451f4" containerName="main"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286744    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286755    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286764    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286770    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286775    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286780    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286787    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72186e8-5a83-4a21-bf4f-27f0cd397dde" containerName="maas-api"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286793    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72186e8-5a83-4a21-bf4f-27f0cd397dde" containerName="maas-api"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286800    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286805    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286822    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286830    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286843    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286851    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy"
Sep 15 11:52:59.286853 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286862    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286870    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286885    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286893    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286903    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286909    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286915    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e7987dd-220c-4829-9ba8-aa1a7b2ff040" containerName="main"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286920    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e7987dd-220c-4829-9ba8-aa1a7b2ff040" containerName="main"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286927    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d26b68f-7174-4d4a-b60e-2643199a43d0" containerName="maas-api"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.286932    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d26b68f-7174-4d4a-b60e-2643199a43d0" containerName="maas-api"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287007    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287017    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287023    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287028    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d26b68f-7174-4d4a-b60e-2643199a43d0" containerName="maas-api"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287034    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287040    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287047    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e7987dd-220c-4829-9ba8-aa1a7b2ff040" containerName="main"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287055    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287063    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec658f4-4bb5-4924-8655-57bda4f451f4" containerName="main"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287071    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287079    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="463b5e48-12c2-48b5-8631-8039daa8fabc" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287087    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="904a76a3-6f86-4da9-87e1-13761088ba29" containerName="istio-proxy"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287097    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c72186e8-5a83-4a21-bf4f-27f0cd397dde" containerName="maas-api"
Sep 15 11:52:59.287515 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.287103    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy"
Sep 15 11:52:59.291209 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.291190    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-32ab51"
Sep 15 11:52:59.293969 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.293770    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lrtt7\""
Sep 15 11:52:59.296464 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.296444    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-32ab51"]
Sep 15 11:52:59.388141 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.388119    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg5rt\" (UniqueName: \"kubernetes.io/projected/eae7e996-4d51-4726-831c-845c505e7757-kube-api-access-lg5rt\") pod \"test-curl-7479-32ab51\" (UID: \"eae7e996-4d51-4726-831c-845c505e7757\") " pod="opendatahub/test-curl-7479-32ab51"
Sep 15 11:52:59.489412 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.489354    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg5rt\" (UniqueName: \"kubernetes.io/projected/eae7e996-4d51-4726-831c-845c505e7757-kube-api-access-lg5rt\") pod \"test-curl-7479-32ab51\" (UID: \"eae7e996-4d51-4726-831c-845c505e7757\") " pod="opendatahub/test-curl-7479-32ab51"
Sep 15 11:52:59.497403 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.497382    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg5rt\" (UniqueName: \"kubernetes.io/projected/eae7e996-4d51-4726-831c-845c505e7757-kube-api-access-lg5rt\") pod \"test-curl-7479-32ab51\" (UID: \"eae7e996-4d51-4726-831c-845c505e7757\") " pod="opendatahub/test-curl-7479-32ab51"
Sep 15 11:52:59.602286 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.602268    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-32ab51"
Sep 15 11:52:59.872004 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:52:59.871978    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-32ab51"]
Sep 15 11:52:59.873294 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:52:59.873268    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeae7e996_4d51_4726_831c_845c505e7757.slice/crio-448af096d75c33fd676cc899489b8e4c647986ba48a36d9f6c224493ff1c16bd WatchSource:0}: Error finding container 448af096d75c33fd676cc899489b8e4c647986ba48a36d9f6c224493ff1c16bd: Status 404 returned error can't find the container with id 448af096d75c33fd676cc899489b8e4c647986ba48a36d9f6c224493ff1c16bd
Sep 15 11:53:00.323282 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:00.323246    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-32ab51" event={"ID":"eae7e996-4d51-4726-831c-845c505e7757","Type":"ContainerStarted","Data":"801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1"}
Sep 15 11:53:00.323668 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:00.323291    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-32ab51" event={"ID":"eae7e996-4d51-4726-831c-845c505e7757","Type":"ContainerStarted","Data":"448af096d75c33fd676cc899489b8e4c647986ba48a36d9f6c224493ff1c16bd"}
Sep 15 11:53:00.339011 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:00.338964    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7479-32ab51" podStartSLOduration=1.338950488 podStartE2EDuration="1.338950488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:53:00.33658654 +0000 UTC m=+1682.092832919" watchObservedRunningTime="2026-09-15 11:53:00.338950488 +0000 UTC m=+1682.095196905"
Sep 15 11:53:00.915422 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:00.915389    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7479-32ab51"]
Sep 15 11:53:00.918297 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:00.918268    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7479-32ab51"]
Sep 15 11:53:01.332667 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:53:01.332642    2570 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7479-32ab51" container="test-curl-7479-32ab51"
Sep 15 11:53:02.338376 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:02.338336    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7479-32ab51" podUID="eae7e996-4d51-4726-831c-845c505e7757" containerName="test-curl-7479-32ab51" containerID="cri-o://801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1" gracePeriod=2
Sep 15 11:53:02.341254 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:53:02.341224    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7479-32ab51\" is forbidden: User \"system:node:ip-10-0-139-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-116.ec2.internal' and this object" podUID="eae7e996-4d51-4726-831c-845c505e7757" pod="opendatahub/test-curl-7479-32ab51"
Sep 15 11:53:02.374296 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:02.374266    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:03.143047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:03.143001    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:03.201783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:03.201750    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:04.519734 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:04.519704    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-32ab51"
Sep 15 11:53:04.635021 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:04.634920    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg5rt\" (UniqueName: \"kubernetes.io/projected/eae7e996-4d51-4726-831c-845c505e7757-kube-api-access-lg5rt\") pod \"eae7e996-4d51-4726-831c-845c505e7757\" (UID: \"eae7e996-4d51-4726-831c-845c505e7757\") "
Sep 15 11:53:04.637111 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:04.637075    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eae7e996-4d51-4726-831c-845c505e7757-kube-api-access-lg5rt" (OuterVolumeSpecName: "kube-api-access-lg5rt") pod "eae7e996-4d51-4726-831c-845c505e7757" (UID: "eae7e996-4d51-4726-831c-845c505e7757"). InnerVolumeSpecName "kube-api-access-lg5rt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:04.735761 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:04.735722    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg5rt\" (UniqueName: \"kubernetes.io/projected/eae7e996-4d51-4726-831c-845c505e7757-kube-api-access-lg5rt\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:53:04.781341 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:04.781304    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eae7e996-4d51-4726-831c-845c505e7757" path="/var/lib/kubelet/pods/eae7e996-4d51-4726-831c-845c505e7757/volumes"
Sep 15 11:53:05.355485 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:05.355445    2570 generic.go:356] "Generic (PLEG): container finished" podID="eae7e996-4d51-4726-831c-845c505e7757" containerID="801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1" exitCode=137
Sep 15 11:53:05.355485 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:05.355485    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-32ab51"
Sep 15 11:53:05.355781 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:05.355536    2570 scope.go:117] "RemoveContainer" containerID="801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1"
Sep 15 11:53:05.364308 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:05.364292    2570 scope.go:117] "RemoveContainer" containerID="801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1"
Sep 15 11:53:05.364600 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:53:05.364582    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1\": container with ID starting with 801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1 not found: ID does not exist" containerID="801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1"
Sep 15 11:53:05.364665 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:05.364609    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1"} err="failed to get container status \"801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1\": rpc error: code = NotFound desc = could not find container \"801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1\": container with ID starting with 801e86a4cf476669008233d7ee00f4f34633dcefbc401ddd3a0aa1e21a5c23a1 not found: ID does not exist"
Sep 15 11:53:06.184099 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:06.184060    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:53:15.260187 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:15.260155    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:18.495597 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:18.495547    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:53:47.222185 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:47.222145    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:47.300921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:47.300883    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:56.106275 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:56.106235    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:59.294630 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:53:59.294598    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:54:16.584311 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:16.584273    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:54:28.889069 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:28.889026    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:54:31.316575 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.316531    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7479-f5a11b"]
Sep 15 11:54:31.316952 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.316929    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy"
Sep 15 11:54:31.316952 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.316942    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f41e208-08da-4777-8196-15c3e87f151b" containerName="istio-proxy"
Sep 15 11:54:31.317044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.316957    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy"
Sep 15 11:54:31.317044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.316962    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7316c42-8124-42e2-b76c-c55a9d323cfe" containerName="istio-proxy"
Sep 15 11:54:31.317044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.316969    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae7e996-4d51-4726-831c-845c505e7757" containerName="test-curl-7479-32ab51"
Sep 15 11:54:31.317044 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.316975    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae7e996-4d51-4726-831c-845c505e7757" containerName="test-curl-7479-32ab51"
Sep 15 11:54:31.317179 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.317050    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd05048f-54ff-48a2-9709-23bdc199d38b" containerName="istio-proxy"
Sep 15 11:54:31.317179 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.317058    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df21e3a-55c6-4943-a159-14fd5c565c71" containerName="istio-proxy"
Sep 15 11:54:31.317179 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.317064    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="eae7e996-4d51-4726-831c-845c505e7757" containerName="test-curl-7479-32ab51"
Sep 15 11:54:31.320089 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.320071    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-f5a11b"
Sep 15 11:54:31.322511 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.322486    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lrtt7\""
Sep 15 11:54:31.326529 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.326478    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-f5a11b"]
Sep 15 11:54:31.425664 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.425636    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g6tg\" (UniqueName: \"kubernetes.io/projected/b315b08d-ba82-4158-a668-27c79097e8f7-kube-api-access-8g6tg\") pod \"test-curl-7479-f5a11b\" (UID: \"b315b08d-ba82-4158-a668-27c79097e8f7\") " pod="opendatahub/test-curl-7479-f5a11b"
Sep 15 11:54:31.526433 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.526403    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g6tg\" (UniqueName: \"kubernetes.io/projected/b315b08d-ba82-4158-a668-27c79097e8f7-kube-api-access-8g6tg\") pod \"test-curl-7479-f5a11b\" (UID: \"b315b08d-ba82-4158-a668-27c79097e8f7\") " pod="opendatahub/test-curl-7479-f5a11b"
Sep 15 11:54:31.534824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.534799    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g6tg\" (UniqueName: \"kubernetes.io/projected/b315b08d-ba82-4158-a668-27c79097e8f7-kube-api-access-8g6tg\") pod \"test-curl-7479-f5a11b\" (UID: \"b315b08d-ba82-4158-a668-27c79097e8f7\") " pod="opendatahub/test-curl-7479-f5a11b"
Sep 15 11:54:31.631393 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.631340    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-f5a11b"
Sep 15 11:54:31.900017 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:31.899989    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-f5a11b"]
Sep 15 11:54:31.901001 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:54:31.900973    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb315b08d_ba82_4158_a668_27c79097e8f7.slice/crio-8c2058c16f16d6251665b3212a3064d09796b03554220ba831e198d0052c69e1 WatchSource:0}: Error finding container 8c2058c16f16d6251665b3212a3064d09796b03554220ba831e198d0052c69e1: Status 404 returned error can't find the container with id 8c2058c16f16d6251665b3212a3064d09796b03554220ba831e198d0052c69e1
Sep 15 11:54:32.857844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:32.857803    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-f5a11b" event={"ID":"b315b08d-ba82-4158-a668-27c79097e8f7","Type":"ContainerStarted","Data":"b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65"}
Sep 15 11:54:32.857844 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:32.857845    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-f5a11b" event={"ID":"b315b08d-ba82-4158-a668-27c79097e8f7","Type":"ContainerStarted","Data":"8c2058c16f16d6251665b3212a3064d09796b03554220ba831e198d0052c69e1"}
Sep 15 11:54:32.875375 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:32.875329    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7479-f5a11b" podStartSLOduration=1.875315114 podStartE2EDuration="1.875315114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:54:32.872906083 +0000 UTC m=+1774.629152460" watchObservedRunningTime="2026-09-15 11:54:32.875315114 +0000 UTC m=+1774.631561491"
Sep 15 11:54:33.472397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.472368    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7479-f5a11b"]
Sep 15 11:54:33.476330 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.476304    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7479-f5a11b"]
Sep 15 11:54:33.600097 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.600068    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7479-73c557"]
Sep 15 11:54:33.600453 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.600441    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b315b08d-ba82-4158-a668-27c79097e8f7" containerName="test-curl-7479-f5a11b"
Sep 15 11:54:33.600499 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.600454    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b315b08d-ba82-4158-a668-27c79097e8f7" containerName="test-curl-7479-f5a11b"
Sep 15 11:54:33.600542 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.600533    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b315b08d-ba82-4158-a668-27c79097e8f7" containerName="test-curl-7479-f5a11b"
Sep 15 11:54:33.603648 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.603632    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-73c557"
Sep 15 11:54:33.610033 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.610008    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-73c557"]
Sep 15 11:54:33.745782 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.745754    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m759f\" (UniqueName: \"kubernetes.io/projected/1923c177-8387-4d23-a1d3-9ea470f6c26b-kube-api-access-m759f\") pod \"test-curl-7479-73c557\" (UID: \"1923c177-8387-4d23-a1d3-9ea470f6c26b\") " pod="opendatahub/test-curl-7479-73c557"
Sep 15 11:54:33.846452 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.846429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m759f\" (UniqueName: \"kubernetes.io/projected/1923c177-8387-4d23-a1d3-9ea470f6c26b-kube-api-access-m759f\") pod \"test-curl-7479-73c557\" (UID: \"1923c177-8387-4d23-a1d3-9ea470f6c26b\") " pod="opendatahub/test-curl-7479-73c557"
Sep 15 11:54:33.854527 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.854484    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m759f\" (UniqueName: \"kubernetes.io/projected/1923c177-8387-4d23-a1d3-9ea470f6c26b-kube-api-access-m759f\") pod \"test-curl-7479-73c557\" (UID: \"1923c177-8387-4d23-a1d3-9ea470f6c26b\") " pod="opendatahub/test-curl-7479-73c557"
Sep 15 11:54:33.871719 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:54:33.871693    2570 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7479-f5a11b" container="test-curl-7479-f5a11b"
Sep 15 11:54:33.913979 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:33.913955    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-73c557"
Sep 15 11:54:34.189273 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:34.189250    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-73c557"]
Sep 15 11:54:34.191452 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:54:34.191425    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1923c177_8387_4d23_a1d3_9ea470f6c26b.slice/crio-a8fa3ba31fcb3503c5e60a9ad37d3139efd666a3cb73533d0d2549a123d4c0ad WatchSource:0}: Error finding container a8fa3ba31fcb3503c5e60a9ad37d3139efd666a3cb73533d0d2549a123d4c0ad: Status 404 returned error can't find the container with id a8fa3ba31fcb3503c5e60a9ad37d3139efd666a3cb73533d0d2549a123d4c0ad
Sep 15 11:54:34.878287 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:34.878247    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-73c557" event={"ID":"1923c177-8387-4d23-a1d3-9ea470f6c26b","Type":"ContainerStarted","Data":"41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b"}
Sep 15 11:54:34.878761 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:34.878298    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-73c557" event={"ID":"1923c177-8387-4d23-a1d3-9ea470f6c26b","Type":"ContainerStarted","Data":"a8fa3ba31fcb3503c5e60a9ad37d3139efd666a3cb73533d0d2549a123d4c0ad"}
Sep 15 11:54:34.878761 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:34.878333    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7479-f5a11b" podUID="b315b08d-ba82-4158-a668-27c79097e8f7" containerName="test-curl-7479-f5a11b" containerID="cri-o://b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65" gracePeriod=2
Sep 15 11:54:34.895496 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:34.895451    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7479-73c557" podStartSLOduration=1.895437056 podStartE2EDuration="1.895437056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:54:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:54:34.893473638 +0000 UTC m=+1776.649720015" watchObservedRunningTime="2026-09-15 11:54:34.895437056 +0000 UTC m=+1776.651683478"
Sep 15 11:54:35.523954 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:35.523923    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7479-73c557"]
Sep 15 11:54:35.530732 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:35.530706    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7479-73c557"]
Sep 15 11:54:35.883137 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:54:35.883109    2570 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7479-73c557" container="test-curl-7479-73c557"
Sep 15 11:54:36.888183 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:36.888151    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7479-73c557" podUID="1923c177-8387-4d23-a1d3-9ea470f6c26b" containerName="test-curl-7479-73c557" containerID="cri-o://41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b" gracePeriod=2
Sep 15 11:54:37.056438 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:37.056414    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-f5a11b"
Sep 15 11:54:37.174208 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:37.174148    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g6tg\" (UniqueName: \"kubernetes.io/projected/b315b08d-ba82-4158-a668-27c79097e8f7-kube-api-access-8g6tg\") pod \"b315b08d-ba82-4158-a668-27c79097e8f7\" (UID: \"b315b08d-ba82-4158-a668-27c79097e8f7\") "
Sep 15 11:54:37.176099 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:37.176069    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b315b08d-ba82-4158-a668-27c79097e8f7-kube-api-access-8g6tg" (OuterVolumeSpecName: "kube-api-access-8g6tg") pod "b315b08d-ba82-4158-a668-27c79097e8f7" (UID: "b315b08d-ba82-4158-a668-27c79097e8f7"). InnerVolumeSpecName "kube-api-access-8g6tg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:54:37.275841 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:37.275811    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g6tg\" (UniqueName: \"kubernetes.io/projected/b315b08d-ba82-4158-a668-27c79097e8f7-kube-api-access-8g6tg\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:54:37.590544 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:37.590505    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:37.894892 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:37.894803    2570 generic.go:356] "Generic (PLEG): container finished" podID="b315b08d-ba82-4158-a668-27c79097e8f7" containerID="b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65" exitCode=137
Sep 15 11:54:37.894892 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:37.894847    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-f5a11b"
Sep 15 11:54:37.894892 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:37.894885    2570 scope.go:117] "RemoveContainer" containerID="b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65"
Sep 15 11:54:37.904433 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:37.904417    2570 scope.go:117] "RemoveContainer" containerID="b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65"
Sep 15 11:54:37.904711 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:54:37.904694    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65\": container with ID starting with b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65 not found: ID does not exist" containerID="b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65"
Sep 15 11:54:37.904778 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:37.904721    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65"} err="failed to get container status \"b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65\": rpc error: code = NotFound desc = could not find container \"b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65\": container with ID starting with b3c4cb55aca8334f8509919e931e837216b27e763dd5befefb23abb36c229d65 not found: ID does not exist"
Sep 15 11:54:37.905798 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:54:37.905772    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7479-f5a11b\" is forbidden: User \"system:node:ip-10-0-139-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-116.ec2.internal' and this object" podUID="b315b08d-ba82-4158-a668-27c79097e8f7" pod="opendatahub/test-curl-7479-f5a11b"
Sep 15 11:54:38.574729 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:38.574693    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:38.779913 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:54:38.779878    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7479-f5a11b\" is forbidden: User \"system:node:ip-10-0-139-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-116.ec2.internal' and this object" podUID="b315b08d-ba82-4158-a668-27c79097e8f7" pod="opendatahub/test-curl-7479-f5a11b"
Sep 15 11:54:38.780950 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:38.780932    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b315b08d-ba82-4158-a668-27c79097e8f7" path="/var/lib/kubelet/pods/b315b08d-ba82-4158-a668-27c79097e8f7/volumes"
Sep 15 11:54:39.064927 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:39.064905    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-73c557"
Sep 15 11:54:39.089277 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:39.089256    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m759f\" (UniqueName: \"kubernetes.io/projected/1923c177-8387-4d23-a1d3-9ea470f6c26b-kube-api-access-m759f\") pod \"1923c177-8387-4d23-a1d3-9ea470f6c26b\" (UID: \"1923c177-8387-4d23-a1d3-9ea470f6c26b\") "
Sep 15 11:54:39.091134 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:39.091112    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1923c177-8387-4d23-a1d3-9ea470f6c26b-kube-api-access-m759f" (OuterVolumeSpecName: "kube-api-access-m759f") pod "1923c177-8387-4d23-a1d3-9ea470f6c26b" (UID: "1923c177-8387-4d23-a1d3-9ea470f6c26b"). InnerVolumeSpecName "kube-api-access-m759f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:54:39.190144 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:39.190084    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m759f\" (UniqueName: \"kubernetes.io/projected/1923c177-8387-4d23-a1d3-9ea470f6c26b-kube-api-access-m759f\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:54:39.486776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:39.486704    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:54:39.909759 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:39.909724    2570 generic.go:356] "Generic (PLEG): container finished" podID="1923c177-8387-4d23-a1d3-9ea470f6c26b" containerID="41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b" exitCode=137
Sep 15 11:54:39.909921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:39.909779    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-73c557"
Sep 15 11:54:39.909921 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:39.909830    2570 scope.go:117] "RemoveContainer" containerID="41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b"
Sep 15 11:54:39.918828 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:39.918781    2570 scope.go:117] "RemoveContainer" containerID="41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b"
Sep 15 11:54:39.919078 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:54:39.919044    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b\": container with ID starting with 41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b not found: ID does not exist" containerID="41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b"
Sep 15 11:54:39.919175 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:39.919086    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b"} err="failed to get container status \"41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b\": rpc error: code = NotFound desc = could not find container \"41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b\": container with ID starting with 41e7078004f2eb8172a93f311fe7b9590ed016f54bc0b9e3950ca6621a3a0f4b not found: ID does not exist"
Sep 15 11:54:39.922930 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:54:39.922900    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7479-73c557\" is forbidden: User \"system:node:ip-10-0-139-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-116.ec2.internal' and this object" podUID="1923c177-8387-4d23-a1d3-9ea470f6c26b" pod="opendatahub/test-curl-7479-73c557"
Sep 15 11:54:40.780684 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:40.780653    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1923c177-8387-4d23-a1d3-9ea470f6c26b" path="/var/lib/kubelet/pods/1923c177-8387-4d23-a1d3-9ea470f6c26b/volumes"
Sep 15 11:54:48.385271 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:48.385231    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:54:53.165307 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:53.165213    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:56.084272 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:54:56.084236    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:55:21.410293 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:21.410233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:24.585510 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:24.585471    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:55:41.594914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:41.594875    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:55:43.489406 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:43.489364    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:50.589112 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:50.589074    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:55:55.642111 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:55.642077    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:56.891753 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:56.891694    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:57.205995 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.205881    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:57.494963 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.494887    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"]
Sep 15 11:55:57.495359 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.495344    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1923c177-8387-4d23-a1d3-9ea470f6c26b" containerName="test-curl-7479-73c557"
Sep 15 11:55:57.495400 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.495363    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1923c177-8387-4d23-a1d3-9ea470f6c26b" containerName="test-curl-7479-73c557"
Sep 15 11:55:57.495442 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.495430    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1923c177-8387-4d23-a1d3-9ea470f6c26b" containerName="test-curl-7479-73c557"
Sep 15 11:55:57.498450 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.498433    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.500812 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.500796    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-0ecfa6-openshift-default-dockercfg-srkhq\""
Sep 15 11:55:57.513240 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.513215    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"]
Sep 15 11:55:57.524124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.524095    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:57.607657 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.607633    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-envoy\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.607771 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.607665    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpcgb\" (UniqueName: \"kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-kube-api-access-gpcgb\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.607771 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.607683    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-socket\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.607850 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.607765    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-token\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.607850 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.607806    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-credential-socket\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.607850 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.607831    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-podinfo\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.607997 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.607915    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-certs\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.607997 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.607959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-data\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.608092 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.607997    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/500bdfc4-4364-43f4-aead-8d08ec609bd6-istiod-ca-cert\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.619383 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.619337    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:57.709159 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709125    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-certs\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709159 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-data\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709195    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/500bdfc4-4364-43f4-aead-8d08ec609bd6-istiod-ca-cert\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-envoy\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709266    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpcgb\" (UniqueName: \"kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-kube-api-access-gpcgb\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709288    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-socket\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709411 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709365    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-token\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709691 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-credential-socket\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709691 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-podinfo\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709691 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709553    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-data\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709818 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709773    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-socket\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709858 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709817    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-certs\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.709903 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.709881    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-credential-socket\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.710025 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.710005    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/500bdfc4-4364-43f4-aead-8d08ec609bd6-istiod-ca-cert\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.711517 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.711486    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-envoy\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.711885 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.711868    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-podinfo\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.717106 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.717083    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-token\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.717508 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.717488    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpcgb\" (UniqueName: \"kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-kube-api-access-gpcgb\") pod \"e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") " pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:57.808685 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:57.808661    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:58.091073 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:58.091045    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"]
Sep 15 11:55:58.092577 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:55:58.092537    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500bdfc4_4364_43f4_aead_8d08ec609bd6.slice/crio-70c5959fe314b2225c41391c3366c68a5ee569369d7596e37e800b649a5a768b WatchSource:0}: Error finding container 70c5959fe314b2225c41391c3366c68a5ee569369d7596e37e800b649a5a768b: Status 404 returned error can't find the container with id 70c5959fe314b2225c41391c3366c68a5ee569369d7596e37e800b649a5a768b
Sep 15 11:55:58.095000 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:58.094962    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:55:58.095145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:58.095047    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:55:58.095145 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:58.095091    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:55:58.368986 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:58.368901    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" event={"ID":"500bdfc4-4364-43f4-aead-8d08ec609bd6","Type":"ContainerStarted","Data":"e3d0a59ef65c2bfa093acf0813de9cb16073689de062e4ec9b989ba5bbea7ea1"}
Sep 15 11:55:58.368986 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:58.368964    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" event={"ID":"500bdfc4-4364-43f4-aead-8d08ec609bd6","Type":"ContainerStarted","Data":"70c5959fe314b2225c41391c3366c68a5ee569369d7596e37e800b649a5a768b"}
Sep 15 11:55:58.392794 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:58.392737    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" podStartSLOduration=1.392716175 podStartE2EDuration="1.392716175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:55:58.389470412 +0000 UTC m=+1860.145716823" watchObservedRunningTime="2026-09-15 11:55:58.392716175 +0000 UTC m=+1860.148962551"
Sep 15 11:55:58.809015 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:58.808967    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:55:59.705507 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:59.705468    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:59.814609 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:55:59.814581    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:56:00.379981 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:00.379946    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:56:00.380840 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:00.380819    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:56:00.421633 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:00.421603    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:00.516466 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:00.516432    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:00.832223 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:00.832189    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:01.289675 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:01.289643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:56:01.801348 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:01.801318    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:02.700129 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.700100    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"]
Sep 15 11:56:02.703501 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.703482    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:02.707089 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.707072    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-0ecfa6-serving-cert\""
Sep 15 11:56:02.747523 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.747500    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:02.766850 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.766828    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"]
Sep 15 11:56:02.855397 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.855367    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:02.862599 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.862569    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:02.862721 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.862621    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:02.862721 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.862642    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdjmm\" (UniqueName: \"kubernetes.io/projected/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-kube-api-access-xdjmm\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:02.862721 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.862716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-metrics-certs\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:02.963483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.963411    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:02.963483 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.963448    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:02.963678 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:56:02.963538    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-serving-cert: secret "maas-api-e2e-ipp-a-0ecfa6-serving-cert" not found
Sep 15 11:56:02.963678 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.963592    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdjmm\" (UniqueName: \"kubernetes.io/projected/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-kube-api-access-xdjmm\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:02.963678 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:56:02.963650    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-maas-api-tls podName:bdfb1e31-ab26-418d-a863-3c3ba68fa8b4 nodeName:}" failed. No retries permitted until 2026-09-15 11:56:03.463629845 +0000 UTC m=+1865.219876203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-maas-api-tls") pod "maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl" (UID: "bdfb1e31-ab26-418d-a863-3c3ba68fa8b4") : secret "maas-api-e2e-ipp-a-0ecfa6-serving-cert" not found
Sep 15 11:56:02.963858 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.963729    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-metrics-certs\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:02.964104 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.964084    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:02.966257 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.966232    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-metrics-certs\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:02.988683 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:02.988657    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdjmm\" (UniqueName: \"kubernetes.io/projected/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-kube-api-access-xdjmm\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:03.087607 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:03.087547    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:03.467698 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:03.467662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:03.470070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:03.470053    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:03.614318 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:03.614283    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:03.696607 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:03.696530    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:03.821701 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:03.821666    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:03.897693 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:03.897665    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"]
Sep 15 11:56:03.899221 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:56:03.899186    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdfb1e31_ab26_418d_a863_3c3ba68fa8b4.slice/crio-c8c81870e573a3c5b015d3f97dd1f1077810281c000bb6502746286dad93a7a6 WatchSource:0}: Error finding container c8c81870e573a3c5b015d3f97dd1f1077810281c000bb6502746286dad93a7a6: Status 404 returned error can't find the container with id c8c81870e573a3c5b015d3f97dd1f1077810281c000bb6502746286dad93a7a6
Sep 15 11:56:03.900721 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:03.900702    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:56:04.405717 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:04.405682    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl" event={"ID":"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4","Type":"ContainerStarted","Data":"c8c81870e573a3c5b015d3f97dd1f1077810281c000bb6502746286dad93a7a6"}
Sep 15 11:56:05.414097 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:05.414061    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl" event={"ID":"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4","Type":"ContainerStarted","Data":"ace8074cacd3c3c07951e82800a7f66d290868fdade6136d3d42c7991d08674b"}
Sep 15 11:56:05.414594 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:05.414184    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:05.440747 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:05.440688    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl" podStartSLOduration=2.9017343110000002 podStartE2EDuration="3.440666036s" totalImagesPullingTime="538.931725ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:56:05.436726457 +0000 UTC m=+1867.192972835" watchObservedRunningTime="2026-09-15 11:56:05.440666036 +0000 UTC m=+1867.196912415"
Sep 15 11:56:11.430884 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:11.430850    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:56:15.199670 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:15.199633    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:56:16.422723 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:16.422684    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 11:56:16.423128 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:16.422766    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 11:56:17.495343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:17.495286    2570 generic.go:356] "Generic (PLEG): container finished" podID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerID="e3d0a59ef65c2bfa093acf0813de9cb16073689de062e4ec9b989ba5bbea7ea1" exitCode=0
Sep 15 11:56:17.495343 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:17.495321    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" event={"ID":"500bdfc4-4364-43f4-aead-8d08ec609bd6","Type":"ContainerDied","Data":"e3d0a59ef65c2bfa093acf0813de9cb16073689de062e4ec9b989ba5bbea7ea1"}
Sep 15 11:56:17.495752 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:17.495721    2570 scope.go:117] "RemoveContainer" containerID="e3d0a59ef65c2bfa093acf0813de9cb16073689de062e4ec9b989ba5bbea7ea1"
Sep 15 11:56:17.496813 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:17.496774    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:17.496917 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:17.496866    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:17.496917 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:17.496911    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:18.506070 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:18.506038    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" event={"ID":"500bdfc4-4364-43f4-aead-8d08ec609bd6","Type":"ContainerStarted","Data":"6dca843f844eff0d523934662b3193028c26cbdc974f84722142c680d032de14"}
Sep 15 11:56:18.809736 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:18.809708    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:56:18.809911 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:18.809866    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Sep 15 11:56:18.809959 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:18.809919    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Sep 15 11:56:19.809762 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:19.809723    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Sep 15 11:56:19.810190 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:19.809793    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Sep 15 11:56:20.809065 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:20.809023    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Sep 15 11:56:20.809235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:20.809092    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Sep 15 11:56:21.809410 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:21.809376    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Sep 15 11:56:21.809831 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:21.809439    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Sep 15 11:56:22.809083 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:22.809050    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Sep 15 11:56:22.809285 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:22.809110    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Sep 15 11:56:23.813228 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:23.813198    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:56:23.813683 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:23.813665    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:56:23.814190 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:23.814170    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:56:25.323883 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:25.323848    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:25.490527 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:25.490493    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:25.999279 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:25.999245    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:26.202927 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:26.202899    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:26.337474 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:26.337439    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:26.710426 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:26.710337    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:26.891497 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:26.891468    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:27.678705 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:27.678658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:31.516881 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:31.516846    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:31.756634 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:31.756587    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:31.854580 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:31.854488    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:32.297526 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:32.297488    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:33.087934 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.087903    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:33.698822 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.698781    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"]
Sep 15 11:56:33.702986 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.702965    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.705262 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.705235    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-2023d5-serving-cert\""
Sep 15 11:56:33.713387 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.713360    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"]
Sep 15 11:56:33.751078 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.751033    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:33.768235 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.768206    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.768379 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.768246    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.768437 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.768390    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dfrf\" (UniqueName: \"kubernetes.io/projected/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-kube-api-access-9dfrf\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.768481 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.768452    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-metrics-certs\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.834201 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.834170    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:33.869454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.869414    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dfrf\" (UniqueName: \"kubernetes.io/projected/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-kube-api-access-9dfrf\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.869454 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.869463    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-metrics-certs\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.869700 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.869504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.869700 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.869521    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.870275 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.870256    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.872027 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.871998    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.872109 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.872049    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-metrics-certs\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:33.877281 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:33.877261    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dfrf\" (UniqueName: \"kubernetes.io/projected/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-kube-api-access-9dfrf\") pod \"maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:34.018552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:34.018520    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:34.232538 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:34.232450    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:34.296114 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:34.296086    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"]
Sep 15 11:56:34.297629 ip-10-0-139-116 kubenswrapper[2570]: W0915 11:56:34.297598    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea7d4a9_d35e_47e4_a2e8_f510f63605ee.slice/crio-9b978461c6a8b9bac8e9cf1e117e22358f39d61151c7f4437d29637ed3908b37 WatchSource:0}: Error finding container 9b978461c6a8b9bac8e9cf1e117e22358f39d61151c7f4437d29637ed3908b37: Status 404 returned error can't find the container with id 9b978461c6a8b9bac8e9cf1e117e22358f39d61151c7f4437d29637ed3908b37
Sep 15 11:56:34.297994 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:34.297962    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:34.600971 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:34.600893    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc" event={"ID":"cea7d4a9-d35e-47e4-a2e8-f510f63605ee","Type":"ContainerStarted","Data":"9b978461c6a8b9bac8e9cf1e117e22358f39d61151c7f4437d29637ed3908b37"}
Sep 15 11:56:35.608040 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:35.608003    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc" event={"ID":"cea7d4a9-d35e-47e4-a2e8-f510f63605ee","Type":"ContainerStarted","Data":"8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5"}
Sep 15 11:56:35.608425 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:35.608189    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:35.666956 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:35.666910    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc" podStartSLOduration=2.343625564 podStartE2EDuration="2.666895719s" totalImagesPullingTime="323.270155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:56:35.664217281 +0000 UTC m=+1897.420463651" watchObservedRunningTime="2026-09-15 11:56:35.666895719 +0000 UTC m=+1897.423142096"
Sep 15 11:56:37.487932 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:37.487896    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:56:41.619305 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:41.619276    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:56:41.785202 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:41.785168    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:47.889393 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:47.889355    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:54.681499 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:54.681461    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:55.906794 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:55.906760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:56.543897 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:56.543861    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:56.745271 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:56.745236    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:57.335810 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:57.335770    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:58.172622 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:58.172580    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:59.202576 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:56:59.202525    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:06.403212 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:06.403174    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:10.084081 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:10.084047    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:57:16.734244 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:16.734207    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:26.389392 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:26.389352    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:57:33.080184 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:33.080134    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:33.967086 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:33.967051    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:34.027055 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:34.027023    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:35.408949 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:35.408918    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:36.134283 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:36.134242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:36.221352 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:36.221316    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:36.333393 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:36.333359    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:37.375168 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:37.375128    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:38.205518 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:38.205486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:38.888533 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:38.888496    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:39.774902 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:39.774873    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:39.873039 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:39.873004    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:39.973215 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:39.973175    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:40.278774 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:40.278726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:40.376939 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:40.376898    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:44.892999 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:57:44.892962    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:58:01.730092 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:01.730003    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:02.505445 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:02.505410    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:03.106703 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:03.106665    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:03.889773 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:03.889742    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:04.527094 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:04.527054    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:05.197774 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:05.197742    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:06.221410 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:06.221356    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:07.624271 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:07.624232    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:08.698047 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:08.698010    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:09.416854 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:09.416823    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:10.210549 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:10.210499    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:10.898827 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:10.898786    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:11.708744 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:11.708711    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:18.031569 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:18.031520    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:18.205672 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:18.205623    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:18.295486 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:18.295376    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:18.369148 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:18.369106    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:18.436132 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:18.436085    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:18.688622 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:18.688513    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:18.788655 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:18.788621    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:18.889785 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:18.889748    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:19.493805 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:19.493771    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:20.255176 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:20.255140    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:20.925457 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:20.925418    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:21.707040 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:21.707003    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:22.587440 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:22.587402    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:58:24.876342 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:24.876284    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:24.939391 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:24.939357    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:25.134905 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:25.134795    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:29.479510 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:29.479475    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:30.100734 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:30.100701    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:30.730698 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:30.730657    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:31.491127 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:31.491092    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:32.131164 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:32.131123    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:41.578405 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:41.578365    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:58:44.185763 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.185723    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"]
Sep 15 11:58:44.186209 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.185946    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl" podUID="bdfb1e31-ab26-418d-a863-3c3ba68fa8b4" containerName="maas-api" containerID="cri-o://ace8074cacd3c3c07951e82800a7f66d290868fdade6136d3d42c7991d08674b" gracePeriod=30
Sep 15 11:58:44.214809 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.214777    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:44.315855 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.315815    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:44.370212 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.370183    2570 generic.go:356] "Generic (PLEG): container finished" podID="bdfb1e31-ab26-418d-a863-3c3ba68fa8b4" containerID="ace8074cacd3c3c07951e82800a7f66d290868fdade6136d3d42c7991d08674b" exitCode=0
Sep 15 11:58:44.370352 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.370256    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl" event={"ID":"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4","Type":"ContainerDied","Data":"ace8074cacd3c3c07951e82800a7f66d290868fdade6136d3d42c7991d08674b"}
Sep 15 11:58:44.440439 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.440362    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:44.449646 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.449620    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:58:44.463329 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.463304    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-openshift-service-ca\") pod \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") "
Sep 15 11:58:44.463458 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.463383    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-metrics-certs\") pod \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") "
Sep 15 11:58:44.463458 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.463419    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdjmm\" (UniqueName: \"kubernetes.io/projected/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-kube-api-access-xdjmm\") pod \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") "
Sep 15 11:58:44.463458 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.463443    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-maas-api-tls\") pod \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\" (UID: \"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4\") "
Sep 15 11:58:44.463674 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.463654    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bdfb1e31-ab26-418d-a863-3c3ba68fa8b4" (UID: "bdfb1e31-ab26-418d-a863-3c3ba68fa8b4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:44.463762 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.463748    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-openshift-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:58:44.465620 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.465553    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bdfb1e31-ab26-418d-a863-3c3ba68fa8b4" (UID: "bdfb1e31-ab26-418d-a863-3c3ba68fa8b4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:44.465745 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.465638    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bdfb1e31-ab26-418d-a863-3c3ba68fa8b4" (UID: "bdfb1e31-ab26-418d-a863-3c3ba68fa8b4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:44.465745 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.465635    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-kube-api-access-xdjmm" (OuterVolumeSpecName: "kube-api-access-xdjmm") pod "bdfb1e31-ab26-418d-a863-3c3ba68fa8b4" (UID: "bdfb1e31-ab26-418d-a863-3c3ba68fa8b4"). InnerVolumeSpecName "kube-api-access-xdjmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:44.560825 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.560786    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:44.564993 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.564971    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-metrics-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:58:44.564993 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.564994    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdjmm\" (UniqueName: \"kubernetes.io/projected/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-kube-api-access-xdjmm\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:58:44.565147 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.565004    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4-maas-api-tls\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:58:44.782346 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.782300    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:44.884914 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:44.884865    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:45.377820 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:45.377782    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"
Sep 15 11:58:45.377820 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:45.377810    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl" event={"ID":"bdfb1e31-ab26-418d-a863-3c3ba68fa8b4","Type":"ContainerDied","Data":"c8c81870e573a3c5b015d3f97dd1f1077810281c000bb6502746286dad93a7a6"}
Sep 15 11:58:45.378372 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:45.377870    2570 scope.go:117] "RemoveContainer" containerID="ace8074cacd3c3c07951e82800a7f66d290868fdade6136d3d42c7991d08674b"
Sep 15 11:58:45.397135 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:45.397107    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"]
Sep 15 11:58:45.401340 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:45.401318    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-0ecfa6-fc57c5546-w7gsl"]
Sep 15 11:58:45.590159 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:45.590126    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:46.247042 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:46.247006    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:46.780776 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:46.780748    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdfb1e31-ab26-418d-a863-3c3ba68fa8b4" path="/var/lib/kubelet/pods/bdfb1e31-ab26-418d-a863-3c3ba68fa8b4/volumes"
Sep 15 11:58:46.999625 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:46.999594    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:49.800087 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:49.800053    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:54.484657 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:54.484620    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:58:56.618751 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:58:56.618717    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:13.737961 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:13.737928    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:23.480824 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:23.480744    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:26.964926 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:26.964892    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:27.205802 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:27.205765    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:33.152452 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:33.152414    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:33.516783 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:33.516750    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"]
Sep 15 11:59:33.516979 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:33.516956    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy" containerID="cri-o://6dca843f844eff0d523934662b3193028c26cbdc974f84722142c680d032de14" gracePeriod=30
Sep 15 11:59:34.679978 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:34.679941    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:34.779889 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:34.779856    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:34.985654 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:34.985552    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:35.912413 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:35.912374    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:36.587242 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:36.587203    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:37.233656 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:37.233627    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:38.691158 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.691123    2570 generic.go:356] "Generic (PLEG): container finished" podID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerID="6dca843f844eff0d523934662b3193028c26cbdc974f84722142c680d032de14" exitCode=0
Sep 15 11:59:38.691599 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.691254    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" event={"ID":"500bdfc4-4364-43f4-aead-8d08ec609bd6","Type":"ContainerDied","Data":"6dca843f844eff0d523934662b3193028c26cbdc974f84722142c680d032de14"}
Sep 15 11:59:38.691599 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.691309    2570 scope.go:117] "RemoveContainer" containerID="e3d0a59ef65c2bfa093acf0813de9cb16073689de062e4ec9b989ba5bbea7ea1"
Sep 15 11:59:38.765379 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.765355    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:59:38.902313 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902237    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpcgb\" (UniqueName: \"kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-kube-api-access-gpcgb\") pod \"500bdfc4-4364-43f4-aead-8d08ec609bd6\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") "
Sep 15 11:59:38.902313 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902287    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-socket\") pod \"500bdfc4-4364-43f4-aead-8d08ec609bd6\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") "
Sep 15 11:59:38.902313 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902313    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-envoy\") pod \"500bdfc4-4364-43f4-aead-8d08ec609bd6\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") "
Sep 15 11:59:38.902552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902341    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-token\") pod \"500bdfc4-4364-43f4-aead-8d08ec609bd6\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") "
Sep 15 11:59:38.902552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902395    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-data\") pod \"500bdfc4-4364-43f4-aead-8d08ec609bd6\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") "
Sep 15 11:59:38.902552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902428    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/500bdfc4-4364-43f4-aead-8d08ec609bd6-istiod-ca-cert\") pod \"500bdfc4-4364-43f4-aead-8d08ec609bd6\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") "
Sep 15 11:59:38.902552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902458    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-credential-socket\") pod \"500bdfc4-4364-43f4-aead-8d08ec609bd6\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") "
Sep 15 11:59:38.902552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902491    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-podinfo\") pod \"500bdfc4-4364-43f4-aead-8d08ec609bd6\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") "
Sep 15 11:59:38.902552 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902544    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-certs\") pod \"500bdfc4-4364-43f4-aead-8d08ec609bd6\" (UID: \"500bdfc4-4364-43f4-aead-8d08ec609bd6\") "
Sep 15 11:59:38.902967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902688    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "500bdfc4-4364-43f4-aead-8d08ec609bd6" (UID: "500bdfc4-4364-43f4-aead-8d08ec609bd6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:38.902967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902859    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "500bdfc4-4364-43f4-aead-8d08ec609bd6" (UID: "500bdfc4-4364-43f4-aead-8d08ec609bd6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:38.902967 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902872    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-data" (OuterVolumeSpecName: "istio-data") pod "500bdfc4-4364-43f4-aead-8d08ec609bd6" (UID: "500bdfc4-4364-43f4-aead-8d08ec609bd6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:38.903124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902966    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:38.903124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902985    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:38.903124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.902998    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:38.903124 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.903062    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "500bdfc4-4364-43f4-aead-8d08ec609bd6" (UID: "500bdfc4-4364-43f4-aead-8d08ec609bd6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:38.903408 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.903381    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/500bdfc4-4364-43f4-aead-8d08ec609bd6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "500bdfc4-4364-43f4-aead-8d08ec609bd6" (UID: "500bdfc4-4364-43f4-aead-8d08ec609bd6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:59:38.904597 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.904569    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-kube-api-access-gpcgb" (OuterVolumeSpecName: "kube-api-access-gpcgb") pod "500bdfc4-4364-43f4-aead-8d08ec609bd6" (UID: "500bdfc4-4364-43f4-aead-8d08ec609bd6"). InnerVolumeSpecName "kube-api-access-gpcgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:38.904733 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.904710    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "500bdfc4-4364-43f4-aead-8d08ec609bd6" (UID: "500bdfc4-4364-43f4-aead-8d08ec609bd6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:59:38.904888 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.904865    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-token" (OuterVolumeSpecName: "istio-token") pod "500bdfc4-4364-43f4-aead-8d08ec609bd6" (UID: "500bdfc4-4364-43f4-aead-8d08ec609bd6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:38.904971 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:38.904890    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "500bdfc4-4364-43f4-aead-8d08ec609bd6" (UID: "500bdfc4-4364-43f4-aead-8d08ec609bd6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:39.003808 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:39.003772    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpcgb\" (UniqueName: \"kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-kube-api-access-gpcgb\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:39.003808 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:39.003798    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:39.003808 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:39.003809    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:39.003808 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:39.003816    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/500bdfc4-4364-43f4-aead-8d08ec609bd6-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:39.004054 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:39.003826    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bdfc4-4364-43f4-aead-8d08ec609bd6-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:39.004054 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:39.003833    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/500bdfc4-4364-43f4-aead-8d08ec609bd6-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:39.698068 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:39.698036    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9" event={"ID":"500bdfc4-4364-43f4-aead-8d08ec609bd6","Type":"ContainerDied","Data":"70c5959fe314b2225c41391c3366c68a5ee569369d7596e37e800b649a5a768b"}
Sep 15 11:59:39.698068 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:39.698060    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"
Sep 15 11:59:39.698507 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:39.698096    2570 scope.go:117] "RemoveContainer" containerID="6dca843f844eff0d523934662b3193028c26cbdc974f84722142c680d032de14"
Sep 15 11:59:39.721134 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:39.721096    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"]
Sep 15 11:59:39.724492 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:39.724466    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9"]
Sep 15 11:59:40.787316 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:40.787280    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" path="/var/lib/kubelet/pods/500bdfc4-4364-43f4-aead-8d08ec609bd6/volumes"
Sep 15 11:59:44.269712 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.269677    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"]
Sep 15 11:59:44.270242 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.269898    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc" podUID="cea7d4a9-d35e-47e4-a2e8-f510f63605ee" containerName="maas-api" containerID="cri-o://8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5" gracePeriod=30
Sep 15 11:59:44.297442 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.297409    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:44.356797 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.356765    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:44.473589 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.473533    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:44.502794 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.502773    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:59:44.543365 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.543256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:44.653141 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.653046    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dfrf\" (UniqueName: \"kubernetes.io/projected/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-kube-api-access-9dfrf\") pod \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") "
Sep 15 11:59:44.653141 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.653120    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-openshift-service-ca\") pod \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") "
Sep 15 11:59:44.653499 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.653162    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-metrics-certs\") pod \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") "
Sep 15 11:59:44.653499 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.653209    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-maas-api-tls\") pod \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\" (UID: \"cea7d4a9-d35e-47e4-a2e8-f510f63605ee\") "
Sep 15 11:59:44.653928 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.653758    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cea7d4a9-d35e-47e4-a2e8-f510f63605ee" (UID: "cea7d4a9-d35e-47e4-a2e8-f510f63605ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:59:44.656270 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.656239    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-kube-api-access-9dfrf" (OuterVolumeSpecName: "kube-api-access-9dfrf") pod "cea7d4a9-d35e-47e4-a2e8-f510f63605ee" (UID: "cea7d4a9-d35e-47e4-a2e8-f510f63605ee"). InnerVolumeSpecName "kube-api-access-9dfrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:44.658211 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.657280    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cea7d4a9-d35e-47e4-a2e8-f510f63605ee" (UID: "cea7d4a9-d35e-47e4-a2e8-f510f63605ee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:59:44.661189 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.661160    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cea7d4a9-d35e-47e4-a2e8-f510f63605ee" (UID: "cea7d4a9-d35e-47e4-a2e8-f510f63605ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:59:44.731077 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.731044    2570 generic.go:356] "Generic (PLEG): container finished" podID="cea7d4a9-d35e-47e4-a2e8-f510f63605ee" containerID="8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5" exitCode=0
Sep 15 11:59:44.731187 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.731089    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"
Sep 15 11:59:44.731187 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.731129    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc" event={"ID":"cea7d4a9-d35e-47e4-a2e8-f510f63605ee","Type":"ContainerDied","Data":"8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5"}
Sep 15 11:59:44.731187 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.731182    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc" event={"ID":"cea7d4a9-d35e-47e4-a2e8-f510f63605ee","Type":"ContainerDied","Data":"9b978461c6a8b9bac8e9cf1e117e22358f39d61151c7f4437d29637ed3908b37"}
Sep 15 11:59:44.731298 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.731205    2570 scope.go:117] "RemoveContainer" containerID="8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5"
Sep 15 11:59:44.740548 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.740531    2570 scope.go:117] "RemoveContainer" containerID="8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5"
Sep 15 11:59:44.740871 ip-10-0-139-116 kubenswrapper[2570]: E0915 11:59:44.740853    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5\": container with ID starting with 8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5 not found: ID does not exist" containerID="8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5"
Sep 15 11:59:44.740961 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.740881    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5"} err="failed to get container status \"8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5\": rpc error: code = NotFound desc = could not find container \"8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5\": container with ID starting with 8c6ef0945cc71bba0c2d847e511ce61ebc199fdf7a0f44bce5293f952c75b4d5 not found: ID does not exist"
Sep 15 11:59:44.752777 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.752754    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"]
Sep 15 11:59:44.754543 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.754511    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dfrf\" (UniqueName: \"kubernetes.io/projected/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-kube-api-access-9dfrf\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:44.754643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.754547    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-openshift-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:44.754643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.754580    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-metrics-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:44.754643 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.754595    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea7d4a9-d35e-47e4-a2e8-f510f63605ee-maas-api-tls\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 11:59:44.756524 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.756504    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2023d5-9b876fddb-ntrkc"]
Sep 15 11:59:44.780636 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.780606    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cea7d4a9-d35e-47e4-a2e8-f510f63605ee" path="/var/lib/kubelet/pods/cea7d4a9-d35e-47e4-a2e8-f510f63605ee/volumes"
Sep 15 11:59:44.846497 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.846417    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:44.955684 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:44.955651    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:45.558356 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:45.558323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:46.311372 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:46.311333    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:47.386830 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:47.386793    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 11:59:50.523960 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:50.523924    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:50.624701 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:50.624668    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:50.798847 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:50.798764    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:51.792666 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:51.792625    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:52.607791 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:52.607748    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:53.320544 ip-10-0-139-116 kubenswrapper[2570]: I0915 11:59:53.320511    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:00.138238 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.138200    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj"]
Sep 15 12:00:00.138792 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.138771    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy"
Sep 15 12:00:00.138878 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.138793    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy"
Sep 15 12:00:00.138878 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.138816    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy"
Sep 15 12:00:00.138878 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.138824    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy"
Sep 15 12:00:00.138878 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.138856    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdfb1e31-ab26-418d-a863-3c3ba68fa8b4" containerName="maas-api"
Sep 15 12:00:00.138878 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.138865    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdfb1e31-ab26-418d-a863-3c3ba68fa8b4" containerName="maas-api"
Sep 15 12:00:00.138878 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.138874    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cea7d4a9-d35e-47e4-a2e8-f510f63605ee" containerName="maas-api"
Sep 15 12:00:00.139164 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.138883    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cea7d4a9-d35e-47e4-a2e8-f510f63605ee" containerName="maas-api"
Sep 15 12:00:00.139164 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.138974    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdfb1e31-ab26-418d-a863-3c3ba68fa8b4" containerName="maas-api"
Sep 15 12:00:00.139164 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.138990    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy"
Sep 15 12:00:00.139164 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.139001    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cea7d4a9-d35e-47e4-a2e8-f510f63605ee" containerName="maas-api"
Sep 15 12:00:00.139164 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.139011    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="500bdfc4-4364-43f4-aead-8d08ec609bd6" containerName="istio-proxy"
Sep 15 12:00:00.143703 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.143682    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj"
Sep 15 12:00:00.146264 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.146238    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2w6g9\""
Sep 15 12:00:00.155298 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.155274    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj"
Sep 15 12:00:00.156848 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.156826    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj"]
Sep 15 12:00:00.429372 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.429336    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj"]
Sep 15 12:00:00.430995 ip-10-0-139-116 kubenswrapper[2570]: W0915 12:00:00.430972    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6d9930_aae6_4dc7_b6e2_ced717879ade.slice/crio-5de2ad6c4d742047c6a3ecdf33c91ca0ba8b0014fafab0356ff3ffb8754d4609 WatchSource:0}: Error finding container 5de2ad6c4d742047c6a3ecdf33c91ca0ba8b0014fafab0356ff3ffb8754d4609: Status 404 returned error can't find the container with id 5de2ad6c4d742047c6a3ecdf33c91ca0ba8b0014fafab0356ff3ffb8754d4609
Sep 15 12:00:00.833642 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.833605    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj" event={"ID":"7a6d9930-aae6-4dc7-b6e2-ced717879ade","Type":"ContainerStarted","Data":"559280dbcc0810e8c7d8ae9275bca8b7d8fbba6c663b884061b52ad5e3c21b9c"}
Sep 15 12:00:00.833790 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.833667    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj" event={"ID":"7a6d9930-aae6-4dc7-b6e2-ced717879ade","Type":"ContainerStarted","Data":"5de2ad6c4d742047c6a3ecdf33c91ca0ba8b0014fafab0356ff3ffb8754d4609"}
Sep 15 12:00:00.849203 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:00.849154    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj" podStartSLOduration=0.849140346 podStartE2EDuration="849.140346ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:00:00.847803074 +0000 UTC m=+2102.604049452" watchObservedRunningTime="2026-09-15 12:00:00.849140346 +0000 UTC m=+2102.605386723"
Sep 15 12:00:01.800079 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:01.800038    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:01.841968 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:01.841932    2570 generic.go:356] "Generic (PLEG): container finished" podID="7a6d9930-aae6-4dc7-b6e2-ced717879ade" containerID="559280dbcc0810e8c7d8ae9275bca8b7d8fbba6c663b884061b52ad5e3c21b9c" exitCode=0
Sep 15 12:00:01.842140 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:01.841974    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj" event={"ID":"7a6d9930-aae6-4dc7-b6e2-ced717879ade","Type":"ContainerDied","Data":"559280dbcc0810e8c7d8ae9275bca8b7d8fbba6c663b884061b52ad5e3c21b9c"}
Sep 15 12:00:01.996356 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:01.996322    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:02.115982 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:02.115891    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:02.379182 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:02.379096    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:02.692533 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:02.692444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:02.980257 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:02.980225    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj"
Sep 15 12:00:03.277467 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:03.277428    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:03.854628 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:03.854599    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj"
Sep 15 12:00:03.854802 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:03.854625    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-68fzj" event={"ID":"7a6d9930-aae6-4dc7-b6e2-ced717879ade","Type":"ContainerDied","Data":"5de2ad6c4d742047c6a3ecdf33c91ca0ba8b0014fafab0356ff3ffb8754d4609"}
Sep 15 12:00:03.854802 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:03.854675    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5de2ad6c4d742047c6a3ecdf33c91ca0ba8b0014fafab0356ff3ffb8754d4609"
Sep 15 12:00:04.502844 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:04.502806    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:00:08.065697 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:08.065660    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:08.125551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:08.125507    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:08.310352 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:08.310306    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"]
Sep 15 12:00:08.310597 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:08.310570    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy" containerID="cri-o://7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210" gracePeriod=30
Sep 15 12:00:08.331259 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:08.331184    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:09.490478 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:09.490446    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:10.120616 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:10.120554    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:13.564852 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.564825    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 12:00:13.627300 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627217    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-certs\") pod \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") "
Sep 15 12:00:13.627300 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627260    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxkw6\" (UniqueName: \"kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-kube-api-access-sxkw6\") pod \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") "
Sep 15 12:00:13.627300 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627291    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-token\") pod \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") "
Sep 15 12:00:13.627595 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627324    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-credential-socket\") pod \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") "
Sep 15 12:00:13.627595 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627363    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-data\") pod \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") "
Sep 15 12:00:13.627595 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627402    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-envoy\") pod \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") "
Sep 15 12:00:13.627595 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627452    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istiod-ca-cert\") pod \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") "
Sep 15 12:00:13.627595 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627524    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-socket\") pod \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") "
Sep 15 12:00:13.627595 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627523    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" (UID: "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:13.627595 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627577    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-podinfo\") pod \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\" (UID: \"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de\") "
Sep 15 12:00:13.627942 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627722    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" (UID: "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:13.627942 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627743    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-data" (OuterVolumeSpecName: "istio-data") pod "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" (UID: "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:13.627942 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627870    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" (UID: "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:00:13.628112 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.627995    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" (UID: "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:13.628166 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.628111    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:13.628166 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.628126    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:13.628166 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.628136    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:13.628166 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.628144    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:13.628166 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.628152    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:13.629654 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.629626    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" (UID: "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:13.629752 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.629720    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-kube-api-access-sxkw6" (OuterVolumeSpecName: "kube-api-access-sxkw6") pod "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" (UID: "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de"). InnerVolumeSpecName "kube-api-access-sxkw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:13.629885 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.629861    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-token" (OuterVolumeSpecName: "istio-token") pod "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" (UID: "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:13.629999 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.629945    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" (UID: "847ebb4f-8b5a-4ab7-8457-f0e88b54c4de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:00:13.729514 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.729489    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:13.729514 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.729511    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxkw6\" (UniqueName: \"kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-kube-api-access-sxkw6\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:13.729693 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.729521    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:13.729693 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.729529    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:13.917409 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.917326    2570 generic.go:356] "Generic (PLEG): container finished" podID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerID="7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210" exitCode=0
Sep 15 12:00:13.917409 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.917375    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"
Sep 15 12:00:13.917598 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.917413    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" event={"ID":"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de","Type":"ContainerDied","Data":"7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210"}
Sep 15 12:00:13.917598 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.917466    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm" event={"ID":"847ebb4f-8b5a-4ab7-8457-f0e88b54c4de","Type":"ContainerDied","Data":"6e7ad322a52b7c05375948cea9ad74cc2e3946e06e3ea458156fa64a07f16153"}
Sep 15 12:00:13.917598 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.917488    2570 scope.go:117] "RemoveContainer" containerID="7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210"
Sep 15 12:00:13.931151 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.931133    2570 scope.go:117] "RemoveContainer" containerID="1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0"
Sep 15 12:00:13.939625 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.939608    2570 scope.go:117] "RemoveContainer" containerID="7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210"
Sep 15 12:00:13.939879 ip-10-0-139-116 kubenswrapper[2570]: E0915 12:00:13.939860    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210\": container with ID starting with 7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210 not found: ID does not exist" containerID="7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210"
Sep 15 12:00:13.939922 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.939887    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210"} err="failed to get container status \"7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210\": rpc error: code = NotFound desc = could not find container \"7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210\": container with ID starting with 7ae98a13118eb7b4b96e3c112496b0b056d359b705a39332fed3ab979ca15210 not found: ID does not exist"
Sep 15 12:00:13.939922 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.939903    2570 scope.go:117] "RemoveContainer" containerID="1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0"
Sep 15 12:00:13.940119 ip-10-0-139-116 kubenswrapper[2570]: E0915 12:00:13.940100    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0\": container with ID starting with 1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0 not found: ID does not exist" containerID="1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0"
Sep 15 12:00:13.940166 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.940125    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0"} err="failed to get container status \"1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0\": rpc error: code = NotFound desc = could not find container \"1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0\": container with ID starting with 1d4a052281f40768cd258277a6d5e234b7a60fa8d9db9fd06d39efa172aad7d0 not found: ID does not exist"
Sep 15 12:00:13.944954 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.944929    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"]
Sep 15 12:00:13.947291 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:13.947271    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm"]
Sep 15 12:00:14.779647 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:14.779617    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" path="/var/lib/kubelet/pods/847ebb4f-8b5a-4ab7-8457-f0e88b54c4de/volumes"
Sep 15 12:00:19.402107 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.402072    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"]
Sep 15 12:00:19.402618 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.402277    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8" podUID="538a14e5-c871-48e0-b547-ca4a79b55039" containerName="maas-api" containerID="cri-o://18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5" gracePeriod=30
Sep 15 12:00:19.454167 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.454136    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:19.555266 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.555215    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:19.635649 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.635504    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:19.647704 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.647683    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 12:00:19.688589 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.688498    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:19.780303 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.780261    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-metrics-certs\") pod \"538a14e5-c871-48e0-b547-ca4a79b55039\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") "
Sep 15 12:00:19.780511 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.780345    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pthfl\" (UniqueName: \"kubernetes.io/projected/538a14e5-c871-48e0-b547-ca4a79b55039-kube-api-access-pthfl\") pod \"538a14e5-c871-48e0-b547-ca4a79b55039\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") "
Sep 15 12:00:19.780511 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.780461    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/538a14e5-c871-48e0-b547-ca4a79b55039-openshift-service-ca\") pod \"538a14e5-c871-48e0-b547-ca4a79b55039\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") "
Sep 15 12:00:19.780511 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.780500    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-maas-api-tls\") pod \"538a14e5-c871-48e0-b547-ca4a79b55039\" (UID: \"538a14e5-c871-48e0-b547-ca4a79b55039\") "
Sep 15 12:00:19.780866 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.780830    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/538a14e5-c871-48e0-b547-ca4a79b55039-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "538a14e5-c871-48e0-b547-ca4a79b55039" (UID: "538a14e5-c871-48e0-b547-ca4a79b55039"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:00:19.783004 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.782974    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "538a14e5-c871-48e0-b547-ca4a79b55039" (UID: "538a14e5-c871-48e0-b547-ca4a79b55039"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:19.783159 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.783129    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "538a14e5-c871-48e0-b547-ca4a79b55039" (UID: "538a14e5-c871-48e0-b547-ca4a79b55039"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:19.783266 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.783238    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/538a14e5-c871-48e0-b547-ca4a79b55039-kube-api-access-pthfl" (OuterVolumeSpecName: "kube-api-access-pthfl") pod "538a14e5-c871-48e0-b547-ca4a79b55039" (UID: "538a14e5-c871-48e0-b547-ca4a79b55039"). InnerVolumeSpecName "kube-api-access-pthfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:19.882016 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.881970    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/538a14e5-c871-48e0-b547-ca4a79b55039-openshift-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:19.882016 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.882005    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-maas-api-tls\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:19.882016 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.882021    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/538a14e5-c871-48e0-b547-ca4a79b55039-metrics-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:19.882351 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.882032    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pthfl\" (UniqueName: \"kubernetes.io/projected/538a14e5-c871-48e0-b547-ca4a79b55039-kube-api-access-pthfl\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:19.953884 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.953806    2570 generic.go:356] "Generic (PLEG): container finished" podID="538a14e5-c871-48e0-b547-ca4a79b55039" containerID="18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5" exitCode=0
Sep 15 12:00:19.953884 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.953847    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"
Sep 15 12:00:19.954121 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.953887    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8" event={"ID":"538a14e5-c871-48e0-b547-ca4a79b55039","Type":"ContainerDied","Data":"18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5"}
Sep 15 12:00:19.954121 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.953947    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8" event={"ID":"538a14e5-c871-48e0-b547-ca4a79b55039","Type":"ContainerDied","Data":"b457702943ab13288b83d3476868fffb9a32c2cd2a4d69a62d7d72940561c71b"}
Sep 15 12:00:19.954121 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.953980    2570 scope.go:117] "RemoveContainer" containerID="18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5"
Sep 15 12:00:19.963516 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.963497    2570 scope.go:117] "RemoveContainer" containerID="18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5"
Sep 15 12:00:19.963801 ip-10-0-139-116 kubenswrapper[2570]: E0915 12:00:19.963783    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5\": container with ID starting with 18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5 not found: ID does not exist" containerID="18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5"
Sep 15 12:00:19.963865 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.963809    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5"} err="failed to get container status \"18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5\": rpc error: code = NotFound desc = could not find container \"18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5\": container with ID starting with 18af41584dce22ed5377dc16634b307dc768b591371ebbb97a21db145136f8b5 not found: ID does not exist"
Sep 15 12:00:19.975152 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.975132    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"]
Sep 15 12:00:19.978834 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:19.978814    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd6959-66df8df79d-bgdg8"]
Sep 15 12:00:20.004402 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:20.004348    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:20.105546 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:20.105518    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:20.781306 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:20.781274    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="538a14e5-c871-48e0-b547-ca4a79b55039" path="/var/lib/kubelet/pods/538a14e5-c871-48e0-b547-ca4a79b55039/volumes"
Sep 15 12:00:22.198088 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:22.198051    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:00:26.164193 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:26.164159    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"]
Sep 15 12:00:26.164679 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:26.164449    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy" containerID="cri-o://01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa" gracePeriod=30
Sep 15 12:00:29.154713 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:29.154672    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:29.253661 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:29.253622    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:30.293934 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:30.293896    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 12:00:30.294289 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:30.293954    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 12:00:30.381518 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:30.381487    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:00:31.422937 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.422909    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 12:00:31.593091 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593064    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn999\" (UniqueName: \"kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-kube-api-access-mn999\") pod \"a20bd381-ab4b-491d-b5af-2df04bda447c\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") "
Sep 15 12:00:31.593292 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593101    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a20bd381-ab4b-491d-b5af-2df04bda447c-istiod-ca-cert\") pod \"a20bd381-ab4b-491d-b5af-2df04bda447c\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") "
Sep 15 12:00:31.593292 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593123    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-token\") pod \"a20bd381-ab4b-491d-b5af-2df04bda447c\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") "
Sep 15 12:00:31.593292 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593144    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-podinfo\") pod \"a20bd381-ab4b-491d-b5af-2df04bda447c\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") "
Sep 15 12:00:31.593292 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593190    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-data\") pod \"a20bd381-ab4b-491d-b5af-2df04bda447c\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") "
Sep 15 12:00:31.593292 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593230    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-certs\") pod \"a20bd381-ab4b-491d-b5af-2df04bda447c\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") "
Sep 15 12:00:31.593292 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593255    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-socket\") pod \"a20bd381-ab4b-491d-b5af-2df04bda447c\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") "
Sep 15 12:00:31.593646 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593409    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-credential-socket\") pod \"a20bd381-ab4b-491d-b5af-2df04bda447c\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") "
Sep 15 12:00:31.593646 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593451    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-envoy\") pod \"a20bd381-ab4b-491d-b5af-2df04bda447c\" (UID: \"a20bd381-ab4b-491d-b5af-2df04bda447c\") "
Sep 15 12:00:31.593646 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593496    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a20bd381-ab4b-491d-b5af-2df04bda447c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a20bd381-ab4b-491d-b5af-2df04bda447c" (UID: "a20bd381-ab4b-491d-b5af-2df04bda447c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:00:31.593646 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593579    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a20bd381-ab4b-491d-b5af-2df04bda447c" (UID: "a20bd381-ab4b-491d-b5af-2df04bda447c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:31.593646 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593604    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a20bd381-ab4b-491d-b5af-2df04bda447c" (UID: "a20bd381-ab4b-491d-b5af-2df04bda447c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:31.593892 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593733    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a20bd381-ab4b-491d-b5af-2df04bda447c" (UID: "a20bd381-ab4b-491d-b5af-2df04bda447c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:31.593892 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593795    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a20bd381-ab4b-491d-b5af-2df04bda447c" (UID: "a20bd381-ab4b-491d-b5af-2df04bda447c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:31.593996 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593922    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a20bd381-ab4b-491d-b5af-2df04bda447c-istiod-ca-cert\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:31.593996 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593940    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-data\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:31.593996 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593952    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:31.593996 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593967    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-workload-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:31.593996 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.593981    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-credential-socket\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:31.595434 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.595411    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a20bd381-ab4b-491d-b5af-2df04bda447c" (UID: "a20bd381-ab4b-491d-b5af-2df04bda447c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:31.595592 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.595449    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-kube-api-access-mn999" (OuterVolumeSpecName: "kube-api-access-mn999") pod "a20bd381-ab4b-491d-b5af-2df04bda447c" (UID: "a20bd381-ab4b-491d-b5af-2df04bda447c"). InnerVolumeSpecName "kube-api-access-mn999". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:31.595925 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.595900    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a20bd381-ab4b-491d-b5af-2df04bda447c" (UID: "a20bd381-ab4b-491d-b5af-2df04bda447c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:00:31.596016 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.595937    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a20bd381-ab4b-491d-b5af-2df04bda447c" (UID: "a20bd381-ab4b-491d-b5af-2df04bda447c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:31.695235 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.695208    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn999\" (UniqueName: \"kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-kube-api-access-mn999\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:31.695235 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.695232    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-token\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:31.695385 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.695241    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-podinfo\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:31.695385 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:31.695249    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a20bd381-ab4b-491d-b5af-2df04bda447c-istio-envoy\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:00:32.030744 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.030709    2570 generic.go:356] "Generic (PLEG): container finished" podID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerID="01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa" exitCode=0
Sep 15 12:00:32.030916 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.030768    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" event={"ID":"a20bd381-ab4b-491d-b5af-2df04bda447c","Type":"ContainerDied","Data":"01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa"}
Sep 15 12:00:32.030916 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.030778    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"
Sep 15 12:00:32.030916 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.030844    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8" event={"ID":"a20bd381-ab4b-491d-b5af-2df04bda447c","Type":"ContainerDied","Data":"16642b0fd00d0239d3bc1f4da4f8ce36bbf94b6eef316de51a9574cd97944fff"}
Sep 15 12:00:32.030916 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.030869    2570 scope.go:117] "RemoveContainer" containerID="01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa"
Sep 15 12:00:32.041355 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.041340    2570 scope.go:117] "RemoveContainer" containerID="b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76"
Sep 15 12:00:32.049432 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.049411    2570 scope.go:117] "RemoveContainer" containerID="01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa"
Sep 15 12:00:32.049730 ip-10-0-139-116 kubenswrapper[2570]: E0915 12:00:32.049709    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa\": container with ID starting with 01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa not found: ID does not exist" containerID="01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa"
Sep 15 12:00:32.049813 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.049738    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa"} err="failed to get container status \"01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa\": rpc error: code = NotFound desc = could not find container \"01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa\": container with ID starting with 01c778a632f7d46f30ee0d6b09903cffb1d500a1b5631e8b30e79d734ac484fa not found: ID does not exist"
Sep 15 12:00:32.049813 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.049756    2570 scope.go:117] "RemoveContainer" containerID="b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76"
Sep 15 12:00:32.050032 ip-10-0-139-116 kubenswrapper[2570]: E0915 12:00:32.050011    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76\": container with ID starting with b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76 not found: ID does not exist" containerID="b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76"
Sep 15 12:00:32.050094 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.050041    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76"} err="failed to get container status \"b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76\": rpc error: code = NotFound desc = could not find container \"b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76\": container with ID starting with b1956be95359b043dc17dae36deac91a34f56e429c0f76d50dc5c9b788a72f76 not found: ID does not exist"
Sep 15 12:00:32.055316 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.055292    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"]
Sep 15 12:00:32.059247 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.059227    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8"]
Sep 15 12:00:32.780415 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:00:32.780379    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" path="/var/lib/kubelet/pods/a20bd381-ab4b-491d-b5af-2df04bda447c/volumes"
Sep 15 12:01:51.193241 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:01:51.193202    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:01:51.565965 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:01:51.565928    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:55.937622 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:01:55.937576    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:32.383826 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:02:32.383746    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:02:40.179737 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:02:40.179692    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:02:47.197760 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:02:47.197726    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:02:52.982983 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:02:52.982936    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:03:11.381490 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:11.381451    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:03:17.977641 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:17.977607    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:03:21.107784 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:21.107746    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"]
Sep 15 12:03:21.108260 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:21.107996    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44" podUID="3fa13815-c567-406f-b3e7-368753cf3eb0" containerName="manager" containerID="cri-o://85cf3ff1a6850c2d0978b269738f8a61ab6d655b0ff8ae31dbc7ffd92571a102" gracePeriod=10
Sep 15 12:03:22.002512 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:22.002477    2570 generic.go:356] "Generic (PLEG): container finished" podID="3fa13815-c567-406f-b3e7-368753cf3eb0" containerID="85cf3ff1a6850c2d0978b269738f8a61ab6d655b0ff8ae31dbc7ffd92571a102" exitCode=0
Sep 15 12:03:22.002666 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:22.002545    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44" event={"ID":"3fa13815-c567-406f-b3e7-368753cf3eb0","Type":"ContainerDied","Data":"85cf3ff1a6850c2d0978b269738f8a61ab6d655b0ff8ae31dbc7ffd92571a102"}
Sep 15 12:03:22.002666 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:22.002641    2570 scope.go:117] "RemoveContainer" containerID="794e0616b82ba62b8f1054ba046f4c9b063068422954189fb67e5aee67c66e67"
Sep 15 12:03:22.055725 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:22.055700    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 12:03:22.108783 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:22.108754    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fa13815-c567-406f-b3e7-368753cf3eb0-extensions-socket-volume\") pod \"3fa13815-c567-406f-b3e7-368753cf3eb0\" (UID: \"3fa13815-c567-406f-b3e7-368753cf3eb0\") "
Sep 15 12:03:22.109132 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:22.108839    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dbnr\" (UniqueName: \"kubernetes.io/projected/3fa13815-c567-406f-b3e7-368753cf3eb0-kube-api-access-6dbnr\") pod \"3fa13815-c567-406f-b3e7-368753cf3eb0\" (UID: \"3fa13815-c567-406f-b3e7-368753cf3eb0\") "
Sep 15 12:03:22.109190 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:22.109171    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa13815-c567-406f-b3e7-368753cf3eb0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3fa13815-c567-406f-b3e7-368753cf3eb0" (UID: "3fa13815-c567-406f-b3e7-368753cf3eb0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:03:22.110945 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:22.110911    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa13815-c567-406f-b3e7-368753cf3eb0-kube-api-access-6dbnr" (OuterVolumeSpecName: "kube-api-access-6dbnr") pod "3fa13815-c567-406f-b3e7-368753cf3eb0" (UID: "3fa13815-c567-406f-b3e7-368753cf3eb0"). InnerVolumeSpecName "kube-api-access-6dbnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:03:22.210434 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:22.210351    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dbnr\" (UniqueName: \"kubernetes.io/projected/3fa13815-c567-406f-b3e7-368753cf3eb0-kube-api-access-6dbnr\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:03:22.210434 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:22.210381    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fa13815-c567-406f-b3e7-368753cf3eb0-extensions-socket-volume\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:03:23.009518 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:23.009487    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"
Sep 15 12:03:23.009728 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:23.009494    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44" event={"ID":"3fa13815-c567-406f-b3e7-368753cf3eb0","Type":"ContainerDied","Data":"1e4b874a501554f070dd2abe97dc7e40c7feb6b6ae559143e8a5775db3a74d5c"}
Sep 15 12:03:23.009728 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:23.009617    2570 scope.go:117] "RemoveContainer" containerID="85cf3ff1a6850c2d0978b269738f8a61ab6d655b0ff8ae31dbc7ffd92571a102"
Sep 15 12:03:23.029293 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:23.029263    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"]
Sep 15 12:03:23.033296 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:23.033268    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fjc44"]
Sep 15 12:03:24.780481 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:03:24.780446    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fa13815-c567-406f-b3e7-368753cf3eb0" path="/var/lib/kubelet/pods/3fa13815-c567-406f-b3e7-368753cf3eb0/volumes"
Sep 15 12:04:21.789887 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.789851    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"]
Sep 15 12:04:21.790296 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790237    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa13815-c567-406f-b3e7-368753cf3eb0" containerName="manager"
Sep 15 12:04:21.790296 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790249    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa13815-c567-406f-b3e7-368753cf3eb0" containerName="manager"
Sep 15 12:04:21.790296 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790262    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy"
Sep 15 12:04:21.790296 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790267    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy"
Sep 15 12:04:21.790296 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790279    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy"
Sep 15 12:04:21.790296 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790285    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy"
Sep 15 12:04:21.790296 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790293    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy"
Sep 15 12:04:21.790296 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790298    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790308    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa13815-c567-406f-b3e7-368753cf3eb0" containerName="manager"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790313    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa13815-c567-406f-b3e7-368753cf3eb0" containerName="manager"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790321    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6d9930-aae6-4dc7-b6e2-ced717879ade" containerName="cleanup"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790326    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6d9930-aae6-4dc7-b6e2-ced717879ade" containerName="cleanup"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790333    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="538a14e5-c871-48e0-b547-ca4a79b55039" containerName="maas-api"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790338    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="538a14e5-c871-48e0-b547-ca4a79b55039" containerName="maas-api"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790401    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="538a14e5-c871-48e0-b547-ca4a79b55039" containerName="maas-api"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790408    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a6d9930-aae6-4dc7-b6e2-ced717879ade" containerName="cleanup"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790415    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790420    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790425    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790430    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="847ebb4f-8b5a-4ab7-8457-f0e88b54c4de" containerName="istio-proxy"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790436    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa13815-c567-406f-b3e7-368753cf3eb0" containerName="manager"
Sep 15 12:04:21.790551 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.790441    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa13815-c567-406f-b3e7-368753cf3eb0" containerName="manager"
Sep 15 12:04:21.793543 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.793526    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"
Sep 15 12:04:21.800088 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.800022    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-d7k7z\""
Sep 15 12:04:21.819296 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.819271    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"]
Sep 15 12:04:21.940753 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.940718    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99f907a2-faf4-43c5-9e17-d96baa3313ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6mwhf\" (UID: \"99f907a2-faf4-43c5-9e17-d96baa3313ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"
Sep 15 12:04:21.940955 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:21.940765    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk4r6\" (UniqueName: \"kubernetes.io/projected/99f907a2-faf4-43c5-9e17-d96baa3313ea-kube-api-access-lk4r6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6mwhf\" (UID: \"99f907a2-faf4-43c5-9e17-d96baa3313ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"
Sep 15 12:04:22.042150 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:22.042060    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99f907a2-faf4-43c5-9e17-d96baa3313ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6mwhf\" (UID: \"99f907a2-faf4-43c5-9e17-d96baa3313ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"
Sep 15 12:04:22.042150 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:22.042095    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk4r6\" (UniqueName: \"kubernetes.io/projected/99f907a2-faf4-43c5-9e17-d96baa3313ea-kube-api-access-lk4r6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6mwhf\" (UID: \"99f907a2-faf4-43c5-9e17-d96baa3313ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"
Sep 15 12:04:22.042424 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:22.042404    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99f907a2-faf4-43c5-9e17-d96baa3313ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6mwhf\" (UID: \"99f907a2-faf4-43c5-9e17-d96baa3313ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"
Sep 15 12:04:22.052592 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:22.052553    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk4r6\" (UniqueName: \"kubernetes.io/projected/99f907a2-faf4-43c5-9e17-d96baa3313ea-kube-api-access-lk4r6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6mwhf\" (UID: \"99f907a2-faf4-43c5-9e17-d96baa3313ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"
Sep 15 12:04:22.103491 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:22.103462    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"
Sep 15 12:04:22.385338 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:22.385306    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"]
Sep 15 12:04:22.386583 ip-10-0-139-116 kubenswrapper[2570]: W0915 12:04:22.386542    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f907a2_faf4_43c5_9e17_d96baa3313ea.slice/crio-06d708982c67321c1d4c22f455cd2d800c5059e336d63d1b487720037c41a9fd WatchSource:0}: Error finding container 06d708982c67321c1d4c22f455cd2d800c5059e336d63d1b487720037c41a9fd: Status 404 returned error can't find the container with id 06d708982c67321c1d4c22f455cd2d800c5059e336d63d1b487720037c41a9fd
Sep 15 12:04:23.345866 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:23.345826    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf" event={"ID":"99f907a2-faf4-43c5-9e17-d96baa3313ea","Type":"ContainerStarted","Data":"f6d7420c9a55c6e663b9497aae8351dd905ae0a223a7dd304ba1fd8470739dd0"}
Sep 15 12:04:23.346280 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:23.345895    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"
Sep 15 12:04:23.346280 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:23.345918    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf" event={"ID":"99f907a2-faf4-43c5-9e17-d96baa3313ea","Type":"ContainerStarted","Data":"06d708982c67321c1d4c22f455cd2d800c5059e336d63d1b487720037c41a9fd"}
Sep 15 12:04:23.366518 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:23.366474    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf" podStartSLOduration=2.3664575279999998 podStartE2EDuration="2.366457528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:04:23.366154135 +0000 UTC m=+2365.122400514" watchObservedRunningTime="2026-09-15 12:04:23.366457528 +0000 UTC m=+2365.122703905"
Sep 15 12:04:34.353575 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:34.353527    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6mwhf"
Sep 15 12:04:40.308337 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:40.308303    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:45.879821 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:45.879782    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:04:53.886822 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:53.886785    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:04:56.378015 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:56.377978    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:59.795924 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:04:59.795886    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:05:02.889222 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:02.889181    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:11.277736 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:11.277700    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:05:26.021555 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:26.021472    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:27.010540 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:27.010504    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:27.678962 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:27.678927    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:27.980596 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:27.980495    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:05:37.186331 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:37.186295    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:05:43.387844 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:43.387803    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:05:47.578881 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.578849    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:05:47.769603 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.769551    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"]
Sep 15 12:05:47.769957 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.769944    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy"
Sep 15 12:05:47.770005 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.769959    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20bd381-ab4b-491d-b5af-2df04bda447c" containerName="istio-proxy"
Sep 15 12:05:47.773255 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.773238    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:47.776824 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.776798    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 12:05:47.776824 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.776813    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-x24k9\""
Sep 15 12:05:47.777032 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.776813    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 12:05:47.777032 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.776862    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 12:05:47.777032 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.776900    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 12:05:47.786272 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.786249    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"]
Sep 15 12:05:47.790161 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.790136    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-679d646747-zfntr"]
Sep 15 12:05:47.794164 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.794143    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:47.799302 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.799280    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-679d646747-zfntr"]
Sep 15 12:05:47.934528 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.934434    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6235d108-435d-4ddb-9e04-a3d224cb4cd6-metrics-certs\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:47.934528 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.934474    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fr26\" (UniqueName: \"kubernetes.io/projected/6235d108-435d-4ddb-9e04-a3d224cb4cd6-kube-api-access-9fr26\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:47.934528 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.934496    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6235d108-435d-4ddb-9e04-a3d224cb4cd6-maas-api-tls\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:47.934776 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.934638    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvgnc\" (UniqueName: \"kubernetes.io/projected/0f29ab18-7221-4a37-bfce-fa6cdf77587f-kube-api-access-kvgnc\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:47.934776 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.934668    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f29ab18-7221-4a37-bfce-fa6cdf77587f-openshift-service-ca\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:47.934776 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.934695    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6235d108-435d-4ddb-9e04-a3d224cb4cd6-openshift-service-ca\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:47.934776 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.934765    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-maas-api-tls\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:47.934911 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:47.934788    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-metrics-certs\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:48.035823 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.035776    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvgnc\" (UniqueName: \"kubernetes.io/projected/0f29ab18-7221-4a37-bfce-fa6cdf77587f-kube-api-access-kvgnc\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:48.036032 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.035838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f29ab18-7221-4a37-bfce-fa6cdf77587f-openshift-service-ca\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:48.036032 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.035875    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6235d108-435d-4ddb-9e04-a3d224cb4cd6-openshift-service-ca\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:48.036032 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.035907    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-maas-api-tls\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:48.036032 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.035938    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-metrics-certs\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:48.036032 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.035981    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6235d108-435d-4ddb-9e04-a3d224cb4cd6-metrics-certs\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:48.036032 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.036010    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fr26\" (UniqueName: \"kubernetes.io/projected/6235d108-435d-4ddb-9e04-a3d224cb4cd6-kube-api-access-9fr26\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:48.036363 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.036043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6235d108-435d-4ddb-9e04-a3d224cb4cd6-maas-api-tls\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:48.036781 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.036753    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f29ab18-7221-4a37-bfce-fa6cdf77587f-openshift-service-ca\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:48.036946 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.036774    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6235d108-435d-4ddb-9e04-a3d224cb4cd6-openshift-service-ca\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:48.038547 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.038525    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-maas-api-tls\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:48.038689 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.038658    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6235d108-435d-4ddb-9e04-a3d224cb4cd6-maas-api-tls\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:48.038765 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.038745    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-metrics-certs\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:48.038765 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.038757    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6235d108-435d-4ddb-9e04-a3d224cb4cd6-metrics-certs\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:48.043456 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.043436    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fr26\" (UniqueName: \"kubernetes.io/projected/6235d108-435d-4ddb-9e04-a3d224cb4cd6-kube-api-access-9fr26\") pod \"maas-api-679d646747-zfntr\" (UID: \"6235d108-435d-4ddb-9e04-a3d224cb4cd6\") " pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:48.043719 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.043700    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvgnc\" (UniqueName: \"kubernetes.io/projected/0f29ab18-7221-4a37-bfce-fa6cdf77587f-kube-api-access-kvgnc\") pod \"maas-api-9fb85669f-q4x8l\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:48.083778 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.083756    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:48.106699 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.106675    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:48.366088 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.366060    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"]
Sep 15 12:05:48.367360 ip-10-0-139-116 kubenswrapper[2570]: W0915 12:05:48.367329    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f29ab18_7221_4a37_bfce_fa6cdf77587f.slice/crio-1188fdb05b4c1b6be2b41abcd184414736171354b69bb30f0b5fb7ed615be4db WatchSource:0}: Error finding container 1188fdb05b4c1b6be2b41abcd184414736171354b69bb30f0b5fb7ed615be4db: Status 404 returned error can't find the container with id 1188fdb05b4c1b6be2b41abcd184414736171354b69bb30f0b5fb7ed615be4db
Sep 15 12:05:48.368701 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.368684    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:05:48.397723 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.397700    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-679d646747-zfntr"]
Sep 15 12:05:48.399293 ip-10-0-139-116 kubenswrapper[2570]: W0915 12:05:48.399267    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6235d108_435d_4ddb_9e04_a3d224cb4cd6.slice/crio-eb0b9cea64a95ca1491fb71f918d9fc813eab0972558287d9125cbd69c2ee221 WatchSource:0}: Error finding container eb0b9cea64a95ca1491fb71f918d9fc813eab0972558287d9125cbd69c2ee221: Status 404 returned error can't find the container with id eb0b9cea64a95ca1491fb71f918d9fc813eab0972558287d9125cbd69c2ee221
Sep 15 12:05:48.827749 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.827712    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr" event={"ID":"6235d108-435d-4ddb-9e04-a3d224cb4cd6","Type":"ContainerStarted","Data":"eb0b9cea64a95ca1491fb71f918d9fc813eab0972558287d9125cbd69c2ee221"}
Sep 15 12:05:48.829149 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:48.829119    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l" event={"ID":"0f29ab18-7221-4a37-bfce-fa6cdf77587f","Type":"ContainerStarted","Data":"1188fdb05b4c1b6be2b41abcd184414736171354b69bb30f0b5fb7ed615be4db"}
Sep 15 12:05:49.837910 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:49.837870    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l" event={"ID":"0f29ab18-7221-4a37-bfce-fa6cdf77587f","Type":"ContainerStarted","Data":"59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc"}
Sep 15 12:05:49.838395 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:49.837964    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:49.839627 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:49.839604    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr" event={"ID":"6235d108-435d-4ddb-9e04-a3d224cb4cd6","Type":"ContainerStarted","Data":"37e1ed55b46bd74951b8492a635ab309588bf7e2b447a379e28cebacdf6e595e"}
Sep 15 12:05:49.839764 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:49.839703    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:49.858396 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:49.858347    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l" podStartSLOduration=2.378259158 podStartE2EDuration="2.858332786s" totalImagesPullingTime="480.073628ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:05:49.856840419 +0000 UTC m=+2451.613086814" watchObservedRunningTime="2026-09-15 12:05:49.858332786 +0000 UTC m=+2451.614579165"
Sep 15 12:05:49.876344 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:49.876290    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr" podStartSLOduration=2.440341443 podStartE2EDuration="2.876276438s" totalImagesPullingTime="435.934995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:05:49.873860968 +0000 UTC m=+2451.630107373" watchObservedRunningTime="2026-09-15 12:05:49.876276438 +0000 UTC m=+2451.632522816"
Sep 15 12:05:55.492217 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:55.492180    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:05:55.853069 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:55.853036    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-679d646747-zfntr"
Sep 15 12:05:55.853416 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:55.853387    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:55.922579 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:55.922529    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"]
Sep 15 12:05:55.922832 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:55.922783    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l" podUID="0f29ab18-7221-4a37-bfce-fa6cdf77587f" containerName="maas-api" containerID="cri-o://59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc" gracePeriod=30
Sep 15 12:05:56.170609 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.170579    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:56.313667 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.313629    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-metrics-certs\") pod \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") "
Sep 15 12:05:56.313667 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.313675    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-maas-api-tls\") pod \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") "
Sep 15 12:05:56.313927 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.313754    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f29ab18-7221-4a37-bfce-fa6cdf77587f-openshift-service-ca\") pod \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") "
Sep 15 12:05:56.313927 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.313833    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvgnc\" (UniqueName: \"kubernetes.io/projected/0f29ab18-7221-4a37-bfce-fa6cdf77587f-kube-api-access-kvgnc\") pod \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\" (UID: \"0f29ab18-7221-4a37-bfce-fa6cdf77587f\") "
Sep 15 12:05:56.314175 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.314148    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f29ab18-7221-4a37-bfce-fa6cdf77587f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0f29ab18-7221-4a37-bfce-fa6cdf77587f" (UID: "0f29ab18-7221-4a37-bfce-fa6cdf77587f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:05:56.315807 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.315780    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0f29ab18-7221-4a37-bfce-fa6cdf77587f" (UID: "0f29ab18-7221-4a37-bfce-fa6cdf77587f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:05:56.315807 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.315801    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f29ab18-7221-4a37-bfce-fa6cdf77587f-kube-api-access-kvgnc" (OuterVolumeSpecName: "kube-api-access-kvgnc") pod "0f29ab18-7221-4a37-bfce-fa6cdf77587f" (UID: "0f29ab18-7221-4a37-bfce-fa6cdf77587f"). InnerVolumeSpecName "kube-api-access-kvgnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:56.315971 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.315914    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0f29ab18-7221-4a37-bfce-fa6cdf77587f" (UID: "0f29ab18-7221-4a37-bfce-fa6cdf77587f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:05:56.414645 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.414525    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f29ab18-7221-4a37-bfce-fa6cdf77587f-openshift-service-ca\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:05:56.414645 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.414582    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvgnc\" (UniqueName: \"kubernetes.io/projected/0f29ab18-7221-4a37-bfce-fa6cdf77587f-kube-api-access-kvgnc\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:05:56.414645 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.414596    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-metrics-certs\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:05:56.414645 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.414605    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f29ab18-7221-4a37-bfce-fa6cdf77587f-maas-api-tls\") on node \"ip-10-0-139-116.ec2.internal\" DevicePath \"\""
Sep 15 12:05:56.881169 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.881136    2570 generic.go:356] "Generic (PLEG): container finished" podID="0f29ab18-7221-4a37-bfce-fa6cdf77587f" containerID="59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc" exitCode=0
Sep 15 12:05:56.881683 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.881188    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"
Sep 15 12:05:56.881683 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.881224    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l" event={"ID":"0f29ab18-7221-4a37-bfce-fa6cdf77587f","Type":"ContainerDied","Data":"59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc"}
Sep 15 12:05:56.881683 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.881279    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l" event={"ID":"0f29ab18-7221-4a37-bfce-fa6cdf77587f","Type":"ContainerDied","Data":"1188fdb05b4c1b6be2b41abcd184414736171354b69bb30f0b5fb7ed615be4db"}
Sep 15 12:05:56.881683 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.881307    2570 scope.go:117] "RemoveContainer" containerID="59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc"
Sep 15 12:05:56.890414 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.890393    2570 scope.go:117] "RemoveContainer" containerID="59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc"
Sep 15 12:05:56.890713 ip-10-0-139-116 kubenswrapper[2570]: E0915 12:05:56.890691    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc\": container with ID starting with 59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc not found: ID does not exist" containerID="59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc"
Sep 15 12:05:56.890794 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.890722    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc"} err="failed to get container status \"59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc\": rpc error: code = NotFound desc = could not find container \"59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc\": container with ID starting with 59f01d2c071a89a4fc0b4af1c3bbaf96b79614514e3452ba6c965661fca77dfc not found: ID does not exist"
Sep 15 12:05:56.915028 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.914996    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"]
Sep 15 12:05:56.934669 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:56.934638    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-q4x8l"]
Sep 15 12:05:58.780606 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:05:58.780572    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f29ab18-7221-4a37-bfce-fa6cdf77587f" path="/var/lib/kubelet/pods/0f29ab18-7221-4a37-bfce-fa6cdf77587f/volumes"
Sep 15 12:06:02.274461 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:02.274426    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:06:04.911825 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:04.911787    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:07.981375 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:07.981340    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:06:15.202592 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:15.202542    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-s65td"]
Sep 15 12:06:22.407808 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:22.407763    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:22.462748 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:22.462714    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:23.369244 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:23.369210    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7mrqd_72ca6670-4a3b-4bb3-83b4-bb35006cd56c/server/0.log"
Sep 15 12:06:23.488436 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:23.488399    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8c5dw_3ee0fd7b-968e-48d9-af30-4253db5991f8/manager/0.log"
Sep 15 12:06:23.833368 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:23.833329    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99f4658c8-z47gb_897c21f2-2e72-4eb7-b254-d5f8c61ea0fe/manager/0.log"
Sep 15 12:06:23.838803 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:23.838779    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99f4658c8-z47gb_897c21f2-2e72-4eb7-b254-d5f8c61ea0fe/copy-manifests/0.log"
Sep 15 12:06:24.272188 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:24.272159    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-679d646747-zfntr_6235d108-435d-4ddb-9e04-a3d224cb4cd6/maas-api/0.log"
Sep 15 12:06:24.486106 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:24.486073    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824560-68fzj_7a6d9930-aae6-4dc7-b6e2-ced717879ade/cleanup/0.log"
Sep 15 12:06:25.684158 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:25.684129    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-hhzmf_7833c826-98b0-4bd5-8e61-03e27d1c6691/kuadrant-console-plugin/0.log"
Sep 15 12:06:25.799707 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:25.799680    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6mwhf_99f907a2-faf4-43c5-9e17-d96baa3313ea/manager/0.log"
Sep 15 12:06:25.912450 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:25.912417    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-s65td_5941d1bb-2a63-47ad-96e8-eba4895095fa/limitador/0.log"
Sep 15 12:06:26.366433 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:26.366407    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb_6781897f-e47d-4691-a433-3c0cb776eb42/istio-proxy/0.log"
Sep 15 12:06:26.816080 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:26.816039    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w6hn5_cbcd7376-fc71-429f-8274-798305714971/istio-proxy/1.log"
Sep 15 12:06:27.737539 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:27.737507    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-vjdqf_505beefd-975e-46e8-bc56-87c7d612b3d8/main/0.log"
Sep 15 12:06:33.440894 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.440852    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rmwp6/must-gather-vgh75"]
Sep 15 12:06:33.441442 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.441420    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f29ab18-7221-4a37-bfce-fa6cdf77587f" containerName="maas-api"
Sep 15 12:06:33.441526 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.441445    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f29ab18-7221-4a37-bfce-fa6cdf77587f" containerName="maas-api"
Sep 15 12:06:33.441626 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.441598    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f29ab18-7221-4a37-bfce-fa6cdf77587f" containerName="maas-api"
Sep 15 12:06:33.445123 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.445103    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rmwp6/must-gather-vgh75"
Sep 15 12:06:33.448031 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.448008    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rmwp6\"/\"default-dockercfg-k4p5p\""
Sep 15 12:06:33.449054 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.449039    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rmwp6\"/\"kube-root-ca.crt\""
Sep 15 12:06:33.449123 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.449063    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rmwp6\"/\"openshift-service-ca.crt\""
Sep 15 12:06:33.458917 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.458881    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rmwp6/must-gather-vgh75"]
Sep 15 12:06:33.460708 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.460682    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:33.560520 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.560483    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/543ea71a-8b43-44c9-9039-444e6c016ed5-must-gather-output\") pod \"must-gather-vgh75\" (UID: \"543ea71a-8b43-44c9-9039-444e6c016ed5\") " pod="openshift-must-gather-rmwp6/must-gather-vgh75"
Sep 15 12:06:33.560726 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.560645    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s9xj\" (UniqueName: \"kubernetes.io/projected/543ea71a-8b43-44c9-9039-444e6c016ed5-kube-api-access-4s9xj\") pod \"must-gather-vgh75\" (UID: \"543ea71a-8b43-44c9-9039-444e6c016ed5\") " pod="openshift-must-gather-rmwp6/must-gather-vgh75"
Sep 15 12:06:33.561720 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.561697    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:33.661732 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.661689    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/543ea71a-8b43-44c9-9039-444e6c016ed5-must-gather-output\") pod \"must-gather-vgh75\" (UID: \"543ea71a-8b43-44c9-9039-444e6c016ed5\") " pod="openshift-must-gather-rmwp6/must-gather-vgh75"
Sep 15 12:06:33.661872 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.661798    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s9xj\" (UniqueName: \"kubernetes.io/projected/543ea71a-8b43-44c9-9039-444e6c016ed5-kube-api-access-4s9xj\") pod \"must-gather-vgh75\" (UID: \"543ea71a-8b43-44c9-9039-444e6c016ed5\") " pod="openshift-must-gather-rmwp6/must-gather-vgh75"
Sep 15 12:06:33.662040 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.662020    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/543ea71a-8b43-44c9-9039-444e6c016ed5-must-gather-output\") pod \"must-gather-vgh75\" (UID: \"543ea71a-8b43-44c9-9039-444e6c016ed5\") " pod="openshift-must-gather-rmwp6/must-gather-vgh75"
Sep 15 12:06:33.669759 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.669727    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s9xj\" (UniqueName: \"kubernetes.io/projected/543ea71a-8b43-44c9-9039-444e6c016ed5-kube-api-access-4s9xj\") pod \"must-gather-vgh75\" (UID: \"543ea71a-8b43-44c9-9039-444e6c016ed5\") " pod="openshift-must-gather-rmwp6/must-gather-vgh75"
Sep 15 12:06:33.754882 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:33.754794    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rmwp6/must-gather-vgh75"
Sep 15 12:06:34.028361 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:34.028328    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rmwp6/must-gather-vgh75"]
Sep 15 12:06:34.030453 ip-10-0-139-116 kubenswrapper[2570]: W0915 12:06:34.030424    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod543ea71a_8b43_44c9_9039_444e6c016ed5.slice/crio-4c0e85c1aa0041531ff65a90c55b1d1101e13c9b08b7b38810ba280893dd5d7d WatchSource:0}: Error finding container 4c0e85c1aa0041531ff65a90c55b1d1101e13c9b08b7b38810ba280893dd5d7d: Status 404 returned error can't find the container with id 4c0e85c1aa0041531ff65a90c55b1d1101e13c9b08b7b38810ba280893dd5d7d
Sep 15 12:06:34.092765 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:34.092730    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rmwp6/must-gather-vgh75" event={"ID":"543ea71a-8b43-44c9-9039-444e6c016ed5","Type":"ContainerStarted","Data":"4c0e85c1aa0041531ff65a90c55b1d1101e13c9b08b7b38810ba280893dd5d7d"}
Sep 15 12:06:35.101374 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:35.101341    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rmwp6/must-gather-vgh75" event={"ID":"543ea71a-8b43-44c9-9039-444e6c016ed5","Type":"ContainerStarted","Data":"c2dfceceec94f6107698d871b8f9fb2dbb25b022db9ab0b595c82226a5980ab6"}
Sep 15 12:06:36.111092 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:36.111059    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rmwp6/must-gather-vgh75" event={"ID":"543ea71a-8b43-44c9-9039-444e6c016ed5","Type":"ContainerStarted","Data":"795184d0da46a4e4937f1b2f2c28d04e86b744d973cbc4cc7cc5cc5852c44a87"}
Sep 15 12:06:36.127655 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:36.127599    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rmwp6/must-gather-vgh75" podStartSLOduration=2.251620029 podStartE2EDuration="3.12758221s" totalImagesPullingTime="875.962181ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:06:36.126373626 +0000 UTC m=+2497.882620006" watchObservedRunningTime="2026-09-15 12:06:36.12758221 +0000 UTC m=+2497.883828589"
Sep 15 12:06:36.477849 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:36.477776    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2gnj8_e89114c8-5946-4fdc-b752-7568f994e251/global-pull-secret-syncer/0.log"
Sep 15 12:06:36.599633 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:36.599604    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2wfh5_ea91870e-ff4f-46de-9a9c-d4984ac39f88/konnectivity-agent/0.log"
Sep 15 12:06:36.700210 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:36.700175    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-116.ec2.internal_06f232f311e4bd0ea0f4417f4173efba/haproxy/0.log"
Sep 15 12:06:41.267936 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:41.267906    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-hhzmf_7833c826-98b0-4bd5-8e61-03e27d1c6691/kuadrant-console-plugin/0.log"
Sep 15 12:06:41.313954 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:41.313878    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6mwhf_99f907a2-faf4-43c5-9e17-d96baa3313ea/manager/0.log"
Sep 15 12:06:41.341874 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:41.341845    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-s65td_5941d1bb-2a63-47ad-96e8-eba4895095fa/limitador/0.log"
Sep 15 12:06:42.857000 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:42.856941    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b298d836-ff62-42d8-a730-46ab86a1af23/alertmanager/0.log"
Sep 15 12:06:42.876153 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:42.876117    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b298d836-ff62-42d8-a730-46ab86a1af23/config-reloader/0.log"
Sep 15 12:06:42.896468 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:42.896439    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b298d836-ff62-42d8-a730-46ab86a1af23/kube-rbac-proxy-web/0.log"
Sep 15 12:06:42.918660 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:42.918626    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b298d836-ff62-42d8-a730-46ab86a1af23/kube-rbac-proxy/0.log"
Sep 15 12:06:42.941489 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:42.941457    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b298d836-ff62-42d8-a730-46ab86a1af23/kube-rbac-proxy-metric/0.log"
Sep 15 12:06:42.961074 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:42.961042    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b298d836-ff62-42d8-a730-46ab86a1af23/prom-label-proxy/0.log"
Sep 15 12:06:42.980842 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:42.980810    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b298d836-ff62-42d8-a730-46ab86a1af23/init-config-reloader/0.log"
Sep 15 12:06:43.113661 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:43.113542    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-74d8658d7b-pn87p_7efc19f9-3b1d-4edf-b86c-7cf8c953eeaf/metrics-server/0.log"
Sep 15 12:06:43.156780 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:43.156744    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-ct48g_fe721367-3aa6-4aef-9b5f-9c799c93b7f5/monitoring-plugin/0.log"
Sep 15 12:06:43.283436 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:43.283405    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpktd_b2a73114-03e7-4be6-83bb-1107f1290127/node-exporter/0.log"
Sep 15 12:06:43.305363 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:43.305330    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpktd_b2a73114-03e7-4be6-83bb-1107f1290127/kube-rbac-proxy/0.log"
Sep 15 12:06:43.333792 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:43.333753    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpktd_b2a73114-03e7-4be6-83bb-1107f1290127/init-textfile/0.log"
Sep 15 12:06:43.796818 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:43.796780    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cc4fc9ff6-d6ztx_5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798/telemeter-client/0.log"
Sep 15 12:06:43.819962 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:43.819926    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cc4fc9ff6-d6ztx_5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798/reload/0.log"
Sep 15 12:06:43.849074 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:43.849040    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cc4fc9ff6-d6ztx_5f458cdf-1c0c-445a-a4e3-0e2ec5b0a798/kube-rbac-proxy/0.log"
Sep 15 12:06:45.587404 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:45.587347    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-q6tjj_499b0286-0e77-4a9e-b576-9d4b2c224b93/networking-console-plugin/0.log"
Sep 15 12:06:46.730597 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:46.730537    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5dddc58d6-6mgwx_fe4e12a7-6b6c-4e4c-b14f-874bcd4814af/console/0.log"
Sep 15 12:06:47.424914 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:47.424878    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-ckmzf_47eb8d3a-6c40-441d-bdb4-073735e5922b/volume-data-source-validator/0.log"
Sep 15 12:06:48.575411 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:48.575387    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qz727_4a8f8849-55a5-4213-b482-83f452708e0f/dns/0.log"
Sep 15 12:06:48.596779 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:48.596749    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qz727_4a8f8849-55a5-4213-b482-83f452708e0f/kube-rbac-proxy/0.log"
Sep 15 12:06:48.668397 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:48.668369    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8gtj9_450a1f25-d9e7-4c3e-9a2f-106752daca9d/dns-node-resolver/0.log"
Sep 15 12:06:49.244138 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.244111    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-889s2_71a45129-8300-4e2f-83fc-138206ef4396/node-ca/0.log"
Sep 15 12:06:49.523031 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.522993    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"]
Sep 15 12:06:49.540513 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.539676    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"]
Sep 15 12:06:49.540513 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.539823    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.646011 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.645968    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-sys\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.646632 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.646045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-proc\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.646632 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.646127    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xslvv\" (UniqueName: \"kubernetes.io/projected/55abadeb-8f27-4eff-9447-df5756862871-kube-api-access-xslvv\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.646632 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.646168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-podres\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.646632 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.646276    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-lib-modules\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.747786 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.747750    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-lib-modules\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.747975 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.747807    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-sys\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.747975 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.747838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-proc\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.747975 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.747905    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xslvv\" (UniqueName: \"kubernetes.io/projected/55abadeb-8f27-4eff-9447-df5756862871-kube-api-access-xslvv\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.747975 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.747949    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-lib-modules\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.748291 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.747949    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-sys\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.748291 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.747993    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-proc\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.748291 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.747958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-podres\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.748291 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.748075    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55abadeb-8f27-4eff-9447-df5756862871-podres\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.757593 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.757543    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xslvv\" (UniqueName: \"kubernetes.io/projected/55abadeb-8f27-4eff-9447-df5756862871-kube-api-access-xslvv\") pod \"perf-node-gather-daemonset-qlkpp\" (UID: \"55abadeb-8f27-4eff-9447-df5756862871\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:49.854839 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:49.854733    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:50.151463 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:50.151431    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"]
Sep 15 12:06:50.153820 ip-10-0-139-116 kubenswrapper[2570]: W0915 12:06:50.153770    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod55abadeb_8f27_4eff_9447_df5756862871.slice/crio-5bd8dbedbc377067457854854e76ab94778644bd745182be19e6c86072e464b9 WatchSource:0}: Error finding container 5bd8dbedbc377067457854854e76ab94778644bd745182be19e6c86072e464b9: Status 404 returned error can't find the container with id 5bd8dbedbc377067457854854e76ab94778644bd745182be19e6c86072e464b9
Sep 15 12:06:50.233393 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:50.233306    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp" event={"ID":"55abadeb-8f27-4eff-9447-df5756862871","Type":"ContainerStarted","Data":"5bd8dbedbc377067457854854e76ab94778644bd745182be19e6c86072e464b9"}
Sep 15 12:06:50.282544 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:50.282507    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb_6781897f-e47d-4691-a433-3c0cb776eb42/istio-proxy/0.log"
Sep 15 12:06:50.760388 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:50.760362    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w6hn5_cbcd7376-fc71-429f-8274-798305714971/istio-proxy/0.log"
Sep 15 12:06:50.763711 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:50.763686    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w6hn5_cbcd7376-fc71-429f-8274-798305714971/istio-proxy/1.log"
Sep 15 12:06:51.241577 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:51.241433    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp" event={"ID":"55abadeb-8f27-4eff-9447-df5756862871","Type":"ContainerStarted","Data":"77e3d4a1e4b9830546c9cf6a3ef2b3573e884be6ebc4df22b115255f67b4f6c6"}
Sep 15 12:06:51.241577 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:51.241514    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:51.258794 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:51.258730    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp" podStartSLOduration=2.2587085780000002 podStartE2EDuration="2.258708578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:06:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:06:51.256991135 +0000 UTC m=+2513.013237518" watchObservedRunningTime="2026-09-15 12:06:51.258708578 +0000 UTC m=+2513.014954958"
Sep 15 12:06:51.864659 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:51.864635    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tfnbf_ba9ce9cc-5e32-423e-83cc-a947cdd88641/serve-healthcheck-canary/0.log"
Sep 15 12:06:52.459894 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:52.459839    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-whksv_06f38fb1-df45-4e79-982f-0c027386144c/kube-rbac-proxy/0.log"
Sep 15 12:06:52.478659 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:52.478628    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-whksv_06f38fb1-df45-4e79-982f-0c027386144c/exporter/0.log"
Sep 15 12:06:52.499209 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:52.499181    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-whksv_06f38fb1-df45-4e79-982f-0c027386144c/extractor/0.log"
Sep 15 12:06:55.019673 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:55.019643    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7mrqd_72ca6670-4a3b-4bb3-83b4-bb35006cd56c/server/0.log"
Sep 15 12:06:55.129251 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:55.129206    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8c5dw_3ee0fd7b-968e-48d9-af30-4253db5991f8/manager/0.log"
Sep 15 12:06:55.288070 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:55.287987    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99f4658c8-z47gb_897c21f2-2e72-4eb7-b254-d5f8c61ea0fe/manager/0.log"
Sep 15 12:06:55.308642 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:55.308615    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99f4658c8-z47gb_897c21f2-2e72-4eb7-b254-d5f8c61ea0fe/copy-manifests/0.log"
Sep 15 12:06:56.451105 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:56.451074    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f6db84f6f-xjp8c_a6dc0392-0914-4ccf-a71d-4c233ebc0f74/manager/0.log"
Sep 15 12:06:56.844046 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:56.843997    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb_6781897f-e47d-4691-a433-3c0cb776eb42/istio-proxy/0.log"
Sep 15 12:06:57.261299 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:57.261264    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-qlkpp"
Sep 15 12:06:57.322660 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:57.322617    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w6hn5_cbcd7376-fc71-429f-8274-798305714971/istio-proxy/0.log"
Sep 15 12:06:57.326866 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:57.326834    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w6hn5_cbcd7376-fc71-429f-8274-798305714971/istio-proxy/1.log"
Sep 15 12:06:59.098186 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:59.098135    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb_6781897f-e47d-4691-a433-3c0cb776eb42/istio-proxy/0.log"
Sep 15 12:06:59.592398 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:59.592367    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w6hn5_cbcd7376-fc71-429f-8274-798305714971/istio-proxy/0.log"
Sep 15 12:06:59.596395 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:06:59.596361    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w6hn5_cbcd7376-fc71-429f-8274-798305714971/istio-proxy/1.log"
Sep 15 12:07:02.036149 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:02.036118    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-z6mxg_289effb1-ed78-47a8-aa75-176886152757/migrator/0.log"
Sep 15 12:07:02.056207 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:02.056179    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-z6mxg_289effb1-ed78-47a8-aa75-176886152757/graceful-termination/0.log"
Sep 15 12:07:03.695460 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:03.695430    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmwfg_f140243f-0052-4d96-b1fe-fe0803ac135b/kube-multus-additional-cni-plugins/0.log"
Sep 15 12:07:03.714234 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:03.714207    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmwfg_f140243f-0052-4d96-b1fe-fe0803ac135b/egress-router-binary-copy/0.log"
Sep 15 12:07:03.737357 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:03.737333    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmwfg_f140243f-0052-4d96-b1fe-fe0803ac135b/cni-plugins/0.log"
Sep 15 12:07:03.755446 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:03.755414    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmwfg_f140243f-0052-4d96-b1fe-fe0803ac135b/bond-cni-plugin/0.log"
Sep 15 12:07:03.773921 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:03.773896    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmwfg_f140243f-0052-4d96-b1fe-fe0803ac135b/routeoverride-cni/0.log"
Sep 15 12:07:03.792535 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:03.792504    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmwfg_f140243f-0052-4d96-b1fe-fe0803ac135b/whereabouts-cni-bincopy/0.log"
Sep 15 12:07:03.812999 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:03.812973    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmwfg_f140243f-0052-4d96-b1fe-fe0803ac135b/whereabouts-cni/0.log"
Sep 15 12:07:03.947645 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:03.947549    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vjfkp_7e721517-cfb0-4ff3-8c41-c5e1e08cdd6c/kube-multus/0.log"
Sep 15 12:07:04.008631 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:04.008600    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7dh7b_05b2d78d-4daf-451e-8d23-dfd20c0e8abb/network-metrics-daemon/0.log"
Sep 15 12:07:04.024814 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:04.024744    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7dh7b_05b2d78d-4daf-451e-8d23-dfd20c0e8abb/kube-rbac-proxy/0.log"
Sep 15 12:07:05.388853 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:05.388813    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-psfsv_ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d/ovn-controller/0.log"
Sep 15 12:07:05.406115 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:05.406086    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-psfsv_ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d/ovn-acl-logging/0.log"
Sep 15 12:07:05.430150 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:05.430126    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-psfsv_ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d/kube-rbac-proxy-node/0.log"
Sep 15 12:07:05.451936 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:05.451892    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-psfsv_ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d/kube-rbac-proxy-ovn-metrics/0.log"
Sep 15 12:07:05.471692 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:05.471666    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-psfsv_ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d/northd/0.log"
Sep 15 12:07:05.491213 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:05.491189    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-psfsv_ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d/nbdb/0.log"
Sep 15 12:07:05.513390 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:05.513366    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-psfsv_ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d/sbdb/0.log"
Sep 15 12:07:05.580963 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:05.580930    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-psfsv_ef5945f9-1cd5-4822-a37e-e7e0bcd8b34d/ovnkube-controller/0.log"
Sep 15 12:07:06.663948 ip-10-0-139-116 kubenswrapper[2570]: I0915 12:07:06.663921    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-clnqp_eeb30891-2c06-4839-9f72-3aa1b489b8b3/network-check-target-container/0.log"