Sep 14 10:48:58.702586 ip-10-0-142-201 systemd[1]: Starting Kubernetes Kubelet...
Sep 14 10:48:59.098399 ip-10-0-142-201 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 10:48:59.098399 ip-10-0-142-201 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 14 10:48:59.098399 ip-10-0-142-201 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 10:48:59.098399 ip-10-0-142-201 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 14 10:48:59.098399 ip-10-0-142-201 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 10:48:59.099513 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.099393    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 14 10:48:59.103336 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103317    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:48:59.103336 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103334    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:48:59.103336 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103339    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103356    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103360    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103364    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103368    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103372    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103376    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103381    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103384    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103388    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103394    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103401    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103405    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103409    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103412    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103416    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103420    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103424    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103428    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:48:59.103529 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103432    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103437    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103443    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103449    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103454    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103459    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103464    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103469    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103474    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103478    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103483    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103488    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103494    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103499    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103503    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103509    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103514    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103518    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103522    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103526    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:48:59.104320 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103530    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103534    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103539    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103543    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103547    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103551    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103555    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103562    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103567    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103571    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103576    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103580    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103584    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103588    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103592    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103597    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103601    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103605    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103611    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103617    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:48:59.105143 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103621    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103625    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103630    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103635    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103639    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103644    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103648    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103654    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103658    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103663    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103667    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103671    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103676    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103680    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103685    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103689    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103693    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103697    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103701    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:48:59.106006 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103705    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103709    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103714    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103718    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103722    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103729    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103735    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103739    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103743    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103748    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103752    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103757    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103762    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103766    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103771    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103775    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103780    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103785    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.103789    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:48:59.106840 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104933    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104947    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104955    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104960    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104965    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104969    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104974    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104978    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104983    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104987    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104991    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.104995    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105000    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105004    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105008    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105012    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105016    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105020    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105025    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:48:59.107577 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105029    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105033    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105037    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105041    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105046    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105050    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105054    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105058    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105062    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105067    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105071    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105075    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105081    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105085    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105090    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105094    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105098    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105102    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105107    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105112    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:48:59.108050 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105116    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105121    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105125    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105130    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105134    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105138    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105142    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105148    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105151    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105156    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105159    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105164    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105168    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105173    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105177    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105182    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105186    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105192    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105197    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:48:59.108642 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105201    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105205    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105209    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105213    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105218    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105230    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105236    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105240    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105245    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105249    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105254    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105260    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105265    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105269    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105273    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105277    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105282    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105286    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105290    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:48:59.109094 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105296    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105300    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105318    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105322    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105326    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105332    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105339    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105345    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105350    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105355    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105360    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105364    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105369    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105373    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105378    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105382    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105387    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105391    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105396    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105400    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:48:59.109587 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105406    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.105410    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106099    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106109    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106114    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106119    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106123    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106130    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106135    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106139    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106144    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106148    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106152    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106157    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106161    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106165    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106170    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106174    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106178    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106183    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:48:59.110072 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106188    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106192    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106196    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106200    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106204    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106208    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106213    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106218    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106222    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106226    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106231    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106235    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106240    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106245    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106249    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106253    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106258    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106262    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106266    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106270    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:48:59.110568 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106276    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106280    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106285    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106289    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106293    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106298    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106319    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106325    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106329    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106333    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106337    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106341    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106345    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106349    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106353    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106357    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106362    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106366    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106370    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106375    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:48:59.111039 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106379    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106383    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106387    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106391    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106395    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106400    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106404    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106409    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106413    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106417    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106421    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106425    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106429    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106433    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106438    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106445    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106450    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106455    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106460    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:48:59.111537 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106465    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106471    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106477    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106481    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106488    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106493    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106497    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106502    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106507    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106512    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106516    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106520    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106524    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106529    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106534    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106538    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106542    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106546    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106550    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:48:59.112008 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106555    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106559    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.106564    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106659    2576 flags.go:64] FLAG: --address="0.0.0.0"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106708    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106717    2576 flags.go:64] FLAG: --anonymous-auth="true"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106724    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106731    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106736    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106743    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106750    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106755    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106760    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106765    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106771    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106776    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106781    2576 flags.go:64] FLAG: --cgroup-root=""
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106785    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106790    2576 flags.go:64] FLAG: --client-ca-file=""
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106795    2576 flags.go:64] FLAG: --cloud-provider="external"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106799    2576 flags.go:64] FLAG: --cluster-dns="[]"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106806    2576 flags.go:64] FLAG: --cluster-domain=""
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106811    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106816    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 14 10:48:59.112508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106822    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106827    2576 flags.go:64] FLAG: --container-log-max-files="5"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106833    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106838    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106842    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106847    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106852    2576 flags.go:64] FLAG: --contention-profiling="false"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106856    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106861    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106868    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106873    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106880    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106885    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106890    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106895    2576 flags.go:64] FLAG: --enable-load-reader="false"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106899    2576 flags.go:64] FLAG: --enable-server="true"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106907    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106914    2576 flags.go:64] FLAG: --event-burst="100"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106919    2576 flags.go:64] FLAG: --event-qps="50"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106923    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106928    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106933    2576 flags.go:64] FLAG: --eviction-hard=""
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106939    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106943    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106949    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 14 10:48:59.113081 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106954    2576 flags.go:64] FLAG: --eviction-soft=""
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106958    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106963    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106967    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106972    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106977    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106982    2576 flags.go:64] FLAG: --fail-swap-on="true"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106986    2576 flags.go:64] FLAG: --feature-gates=""
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106993    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.106999    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107004    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107011    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107016    2576 flags.go:64] FLAG: --healthz-port="10248"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107021    2576 flags.go:64] FLAG: --help="false"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107025    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107030    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107035    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107041    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107046    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107052    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107056    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107061    2576 flags.go:64] FLAG: --image-service-endpoint=""
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107065    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 14 10:48:59.113733 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107072    2576 flags.go:64] FLAG: --kube-api-burst="100"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107076    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107081    2576 flags.go:64] FLAG: --kube-api-qps="50"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107086    2576 flags.go:64] FLAG: --kube-reserved=""
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107090    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107095    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107100    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107104    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107109    2576 flags.go:64] FLAG: --lock-file=""
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107113    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107118    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107123    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107132    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107138    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107143    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107148    2576 flags.go:64] FLAG: --logging-format="text"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107152    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107158    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107162    2576 flags.go:64] FLAG: --manifest-url=""
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107167    2576 flags.go:64] FLAG: --manifest-url-header=""
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107173    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107178    2576 flags.go:64] FLAG: --max-open-files="1000000"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107185    2576 flags.go:64] FLAG: --max-pods="110"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107189    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107194    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 14 10:48:59.114350 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107199    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107203    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107209    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107214    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107218    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107229    2576 flags.go:64] FLAG: --node-status-max-images="50"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107234    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107241    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107246    2576 flags.go:64] FLAG: --pod-cidr=""
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107250    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107260    2576 flags.go:64] FLAG: --pod-manifest-path=""
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107265    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107270    2576 flags.go:64] FLAG: --pods-per-core="0"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107274    2576 flags.go:64] FLAG: --port="10250"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107280    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107285    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07cc463e818e28038"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107291    2576 flags.go:64] FLAG: --qos-reserved=""
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107296    2576 flags.go:64] FLAG: --read-only-port="10255"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107301    2576 flags.go:64] FLAG: --register-node="true"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107324    2576 flags.go:64] FLAG: --register-with-taints=""
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107337    2576 flags.go:64] FLAG: --registry-burst="10"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107343    2576 flags.go:64] FLAG: --registry-qps="5"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107347    2576 flags.go:64] FLAG: --reserved-cpus=""
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107352    2576 flags.go:64] FLAG: --reserved-memory=""
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107358    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 14 10:48:59.114960 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107387    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107406    2576 flags.go:64] FLAG: --rotate-certificates="false"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107412    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107415    2576 flags.go:64] FLAG: --runonce="false"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107419    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107423    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107428    2576 flags.go:64] FLAG: --seccomp-default="false"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107431    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107434    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107438    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107441    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107444    2576 flags.go:64] FLAG: --storage-driver-password="root"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107447    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107450    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107453    2576 flags.go:64] FLAG: --storage-driver-user="root"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107456    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107459    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107463    2576 flags.go:64] FLAG: --system-cgroups=""
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107466    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107474    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107477    2576 flags.go:64] FLAG: --tls-cert-file=""
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107480    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107487    2576 flags.go:64] FLAG: --tls-min-version=""
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107490    2576 flags.go:64] FLAG: --tls-private-key-file=""
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107493    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 14 10:48:59.115620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107496    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107499    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107503    2576 flags.go:64] FLAG: --v="2"
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107508    2576 flags.go:64] FLAG: --version="false"
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107512    2576 flags.go:64] FLAG: --vmodule=""
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107516    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.107519    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107651    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107657    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107661    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107666    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107669    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107673    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107676    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107679    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107681    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107684    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107687    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107691    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107694    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:48:59.116254 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107696    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107699    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107702    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107705    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107708    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107711    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107713    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107716    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107719    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107721    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107724    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107727    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107729    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107732    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107734    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107737    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107740    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107742    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107745    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107747    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:48:59.117060 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107752    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107756    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107760    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107763    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107766    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107768    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107771    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107774    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107776    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107779    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107782    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107784    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107787    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107790    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107792    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107795    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107798    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107801    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107804    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107806    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:48:59.117736 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107809    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107812    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107814    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107817    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107820    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107822    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107825    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107827    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107830    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107832    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107835    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107837    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107842    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107845    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107848    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107851    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107853    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107856    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107859    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107861    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:48:59.118295 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107864    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107866    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107869    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107871    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107874    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107877    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107879    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107881    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107884    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107886    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107889    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107891    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107894    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107896    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107899    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107902    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107904    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107907    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107909    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107912    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:48:59.118855 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107914    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107917    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107919    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107923    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107930    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.107933    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.108512    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.117733    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.117865    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.118938    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.118959    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119052    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119061    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119067    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:48:59.119357 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119071    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119077    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119082    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119086    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119090    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119095    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119099    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119103    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119107    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119111    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119115    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119120    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119124    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119128    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119133    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119139    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119144    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119148    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119153    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119157    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:48:59.119743 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119161    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119166    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119171    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119177    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119182    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119187    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119193    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119198    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119203    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119207    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119211    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119216    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119220    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119224    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119232    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119238    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119242    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119246    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119252    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:48:59.120368 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119256    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119261    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119265    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119269    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119273    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119277    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119285    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119290    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119295    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119300    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119322    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119327    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119332    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119336    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119340    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119345    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119349    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119354    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119358    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:48:59.120823 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119363    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119367    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119371    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119375    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119380    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119384    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119388    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119392    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119396    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119403    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119408    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119412    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119416    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119420    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119423    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119427    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119432    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119436    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119441    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119445    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:48:59.121282 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119448    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119452    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119456    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119459    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119463    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119467    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119470    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119474    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119478    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119482    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119486    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119489    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119494    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119498    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119501    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119505    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119508    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:48:59.121794 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119512    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.119519    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119690    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119698    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119702    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119706    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119710    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119714    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119718    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119722    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119728    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119733    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119737    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119741    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:48:59.122206 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119747    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119752    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119756    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119760    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119764    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119767    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119772    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119776    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119779    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119783    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119786    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119790    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119795    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119799    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119803    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119808    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119812    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119816    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119820    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:48:59.122571 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119824    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119830    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119834    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119838    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119842    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119846    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119853    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119858    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119863    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119867    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119871    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119875    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119879    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119883    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119887    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119892    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119895    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119899    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119903    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:48:59.123027 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119907    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119911    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119914    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119918    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119922    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119927    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119931    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119936    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119940    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119944    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119948    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119952    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119956    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119960    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119964    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119967    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119972    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119976    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119980    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119984    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:48:59.123497 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119988    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119991    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119996    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.119999    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120004    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120008    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120012    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120016    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120022    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120026    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120030    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120034    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120038    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120042    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120047    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120051    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120055    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120059    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120064    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120068    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:48:59.123968 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120073    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:48:59.124460 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120077    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:48:59.124460 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120081    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:48:59.124460 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120085    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:48:59.124460 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120090    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:48:59.124460 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120094    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:48:59.124460 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120098    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:48:59.124460 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120102    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:48:59.124460 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:48:59.120106    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:48:59.124460 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.120114    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 10:48:59.124460 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.120279    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 14 10:48:59.124460 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.124433    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 14 10:48:59.125478 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.125457    2576 server.go:1019] "Starting client certificate rotation"
Sep 14 10:48:59.125582 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.125564    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 10:48:59.125620 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.125602    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 10:48:59.128295 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.128282    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 10:48:59.132501 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.132477    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 10:48:59.141370 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.141350    2576 log.go:25] "Validated CRI v1 runtime API"
Sep 14 10:48:59.144502 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.144487    2576 log.go:25] "Validated CRI v1 image API"
Sep 14 10:48:59.145417 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.145401    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 14 10:48:59.150517 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.150490    2576 fs.go:135] Filesystem UUIDs: map[6f08adb1-f098-4584-a832-29a0544e04b2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e06ca1df-1642-4795-b4a6-9504199cf5cc:/dev/nvme0n1p4]
Sep 14 10:48:59.150588 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.150514    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 14 10:48:59.156591 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.156492    2576 manager.go:216] Machine: {Timestamp:2026-09-14 10:48:59.155042631 +0000 UTC m=+0.356020598 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3066552 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ee26639683ad3c4309488d124b32b SystemUUID:ec2ee266-3968-3ad3-c430-9488d124b32b BootID:c57153af-1deb-4552-9ba4-ae5ea5452177 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c9:be:37:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c9:be:37:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:0b:b4:17:72:17 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 14 10:48:59.156591 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.156586    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 14 10:48:59.156693 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.156681    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 14 10:48:59.160202 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.160179    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 14 10:48:59.160341 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.160205    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-201.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 14 10:48:59.160892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.160877    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 10:48:59.161667 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.161656    2576 topology_manager.go:138] "Creating topology manager with none policy"
Sep 14 10:48:59.161702 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.161671    2576 container_manager_linux.go:309] "Creating device plugin manager"
Sep 14 10:48:59.161702 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.161679    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 10:48:59.162449 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.162439    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 10:48:59.163645 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.163636    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 14 10:48:59.167967 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.167957    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 10:48:59.168076 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.168067    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 14 10:48:59.168105 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.168094    2576 kubelet.go:486] "Attempting to sync node with API server"
Sep 14 10:48:59.168105 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.168103    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 14 10:48:59.168167 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.168113    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 14 10:48:59.168167 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.168123    2576 kubelet.go:398] "Adding apiserver pod source"
Sep 14 10:48:59.168167 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.168132    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 14 10:48:59.168506 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.168489    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 10:48:59.168548 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.168527    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 10:48:59.175078 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.175052    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 14 10:48:59.178072 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.178057    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 14 10:48:59.178143 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.178097    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 14 10:48:59.180241 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180227    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 14 10:48:59.180241 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180243    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 14 10:48:59.180359 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180249    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 14 10:48:59.180359 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180255    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 14 10:48:59.180359 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180264    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 14 10:48:59.180359 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180270    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 14 10:48:59.180359 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180283    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 14 10:48:59.180359 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180288    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 14 10:48:59.180359 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180295    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 14 10:48:59.180359 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180301    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 14 10:48:59.180359 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180326    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 14 10:48:59.180359 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.180332    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 14 10:48:59.182098 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.182084    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 14 10:48:59.182146 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.182102    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 14 10:48:59.182960 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.182939    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 14 10:48:59.182960 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.182941    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 14 10:48:59.184737 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.184720    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-201.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 14 10:48:59.186027 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.186013    2576 server.go:1268] "Started kubelet"
Sep 14 10:48:59.186113 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.186090    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 14 10:48:59.186164 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.186112    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 14 10:48:59.186164 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.186131    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 14 10:48:59.186723 ip-10-0-142-201 systemd[1]: Started Kubernetes Kubelet.
Sep 14 10:48:59.187770 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.187723    2576 server.go:310] "Adding debug handlers to kubelet server"
Sep 14 10:48:59.187957 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.187937    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 14 10:48:59.190554 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.190538    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n9lft"
Sep 14 10:48:59.192289 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.192265    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 14 10:48:59.196347 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.196329    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 14 10:48:59.197066 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.197046    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 14 10:48:59.197262 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.197213    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-201.ec2.internal\" not found"
Sep 14 10:48:59.197950 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.197934    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 14 10:48:59.197950 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.197937    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 14 10:48:59.198085 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.197957    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 14 10:48:59.198085 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.198019    2576 reconstruct.go:97] "Volume reconstruction finished"
Sep 14 10:48:59.198085 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.198029    2576 reconciler.go:29] "Reconciler: start to sync state"
Sep 14 10:48:59.198696 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.198679    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 14 10:48:59.198882 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.198861    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 14 10:48:59.199173 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.199155    2576 factory.go:55] Registering systemd factory
Sep 14 10:48:59.199173 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.199174    2576 factory.go:223] Registration of the systemd container factory successfully
Sep 14 10:48:59.199297 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.199242    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n9lft"
Sep 14 10:48:59.199394 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.199383    2576 factory.go:153] Registering CRI-O factory
Sep 14 10:48:59.199435 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.199396    2576 factory.go:223] Registration of the crio container factory successfully
Sep 14 10:48:59.199473 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.199439    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 14 10:48:59.199473 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.199453    2576 factory.go:103] Registering Raw factory
Sep 14 10:48:59.199473 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.199463    2576 manager.go:1196] Started watching for new ooms in manager
Sep 14 10:48:59.199968 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.199949    2576 manager.go:349] Starting recovery of all containers
Sep 14 10:48:59.200052 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.198555    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-201.ec2.internal.18d52a4d79533705  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-201.ec2.internal,UID:ip-10-0-142-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-201.ec2.internal,},FirstTimestamp:2026-09-14 10:48:59.185985285 +0000 UTC m=+0.386963251,LastTimestamp:2026-09-14 10:48:59.185985285 +0000 UTC m=+0.386963251,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-201.ec2.internal,}"
Sep 14 10:48:59.210790 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.210774    2576 manager.go:354] Recovery completed
Sep 14 10:48:59.215660 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.215641    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:48:59.217983 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.217967    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:48:59.218056 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.218000    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:48:59.218056 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.218016    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:48:59.218770 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.218743    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 14 10:48:59.218770 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.218757    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 14 10:48:59.218770 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.218763    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:48:59.218770 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.218774    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 10:48:59.219465 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.219450    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:48:59.219556 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.219470    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:48:59.219556 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.219479    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:48:59.220884 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.220872    2576 policy_none.go:49] "None policy: Start"
Sep 14 10:48:59.220933 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.220891    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 14 10:48:59.220933 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.220903    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 14 10:48:59.222898 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.222883    2576 policy_none.go:47] "Start"
Sep 14 10:48:59.249921 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.249907    2576 manager.go:337] "Starting Device Plugin manager"
Sep 14 10:48:59.274531 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.249950    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 14 10:48:59.274531 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.249961    2576 server.go:87] "Starting device plugin registration server"
Sep 14 10:48:59.274531 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.250174    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 14 10:48:59.274531 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.250184    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 14 10:48:59.274531 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.250265    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 14 10:48:59.274531 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.250365    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 14 10:48:59.274531 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.250372    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 14 10:48:59.274531 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.251126    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 14 10:48:59.274531 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.251177    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-201.ec2.internal\" not found"
Sep 14 10:48:59.332095 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.332064    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 14 10:48:59.333301 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.333278    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 14 10:48:59.333398 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.333356    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 14 10:48:59.333398 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.333386    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 14 10:48:59.333491 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.333424    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 14 10:48:59.335894 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.335876    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:48:59.350932 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.350858    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:48:59.351764 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.351749    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:48:59.351860 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.351779    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:48:59.351860 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.351793    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:48:59.351860 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.351827    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.357956 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.357943    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.358013 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.357961    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-201.ec2.internal\": node \"ip-10-0-142-201.ec2.internal\" not found"
Sep 14 10:48:59.370678 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.370656    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-201.ec2.internal\" not found"
Sep 14 10:48:59.434113 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.434088    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-201.ec2.internal"]
Sep 14 10:48:59.434250 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.434152    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:48:59.435395 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.435381    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:48:59.435457 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.435410    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:48:59.435457 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.435422    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:48:59.437769 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.437758    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:48:59.437892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.437876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.437928 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.437909    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:48:59.438506 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.438491    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:48:59.438506 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.438498    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:48:59.438601 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.438518    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:48:59.438601 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.438533    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:48:59.438601 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.438518    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:48:59.438681 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.438619    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:48:59.441386 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.441370    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.441469 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.441394    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:48:59.442119 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.442104    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:48:59.442181 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.442132    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:48:59.442181 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.442146    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:48:59.464827 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.464807    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-201.ec2.internal\" not found" node="ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.470467 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.470449    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-201.ec2.internal\" not found" node="ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.470712 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.470697    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-201.ec2.internal\" not found"
Sep 14 10:48:59.500184 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.500163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb46e686325d84730d02f0119973c3b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal\" (UID: \"fb46e686325d84730d02f0119973c3b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.500244 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.500188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb46e686325d84730d02f0119973c3b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal\" (UID: \"fb46e686325d84730d02f0119973c3b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.500244 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.500204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bdffdae562a11beaff0a15fcd57b726-config\") pod \"kube-apiserver-proxy-ip-10-0-142-201.ec2.internal\" (UID: \"3bdffdae562a11beaff0a15fcd57b726\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.571012 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.570993    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-201.ec2.internal\" not found"
Sep 14 10:48:59.601055 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.601004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb46e686325d84730d02f0119973c3b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal\" (UID: \"fb46e686325d84730d02f0119973c3b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.601055 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.601030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb46e686325d84730d02f0119973c3b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal\" (UID: \"fb46e686325d84730d02f0119973c3b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.601055 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.601046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bdffdae562a11beaff0a15fcd57b726-config\") pod \"kube-apiserver-proxy-ip-10-0-142-201.ec2.internal\" (UID: \"3bdffdae562a11beaff0a15fcd57b726\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.601189 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.601084    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bdffdae562a11beaff0a15fcd57b726-config\") pod \"kube-apiserver-proxy-ip-10-0-142-201.ec2.internal\" (UID: \"3bdffdae562a11beaff0a15fcd57b726\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.601189 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.601105    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb46e686325d84730d02f0119973c3b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal\" (UID: \"fb46e686325d84730d02f0119973c3b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.601189 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.601115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb46e686325d84730d02f0119973c3b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal\" (UID: \"fb46e686325d84730d02f0119973c3b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.672054 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.672022    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-201.ec2.internal\" not found"
Sep 14 10:48:59.767565 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.767534    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.772630 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.772331    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-201.ec2.internal\" not found"
Sep 14 10:48:59.773425 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:48:59.773413    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-201.ec2.internal"
Sep 14 10:48:59.873499 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:48:59.873422    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-201.ec2.internal\" not found"
Sep 14 10:49:01.194360 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.194328    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-201.ec2.internal\" not found"
Sep 14 10:49:01.294867 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.294821    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-201.ec2.internal\" not found"
Sep 14 10:49:01.302985 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.302963    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:49:01.318086 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.318064    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-201.ec2.internal"
Sep 14 10:49:01.328279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.328262    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 10:49:01.329998 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.329986    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal"
Sep 14 10:49:01.341190 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.341176    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 10:49:01.345341 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.345306    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 14 10:49:01.345413 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.345398    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 14 10:49:01.345464 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.345443    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 14 10:49:01.389614 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.389583    2576 apiserver.go:52] "Watching apiserver"
Sep 14 10:49:01.408151 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.408129    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 14 10:49:01.409032 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.409012    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-p9rc9","openshift-multus/network-metrics-daemon-mxgs8","openshift-network-diagnostics/network-check-target-7j6cf","kube-system/kube-apiserver-proxy-ip-10-0-142-201.ec2.internal","openshift-dns/node-resolver-vfwxz","openshift-image-registry/node-ca-8xmsc","openshift-multus/multus-q2sr2","openshift-network-operator/iptables-alerter-67krr","openshift-ovn-kubernetes/ovnkube-node-n99qp","kube-system/global-pull-secret-syncer-zmdnx","kube-system/konnectivity-agent-gpp5n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t","openshift-cluster-node-tuning-operator/tuned-2g6wd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal"]
Sep 14 10:49:01.411618 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.411601    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:01.411702 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.411676    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:01.413494 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.413477    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.415603 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.415580    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lhzpd\""
Sep 14 10:49:01.415738 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.415723    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:01.415799 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.415763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 14 10:49:01.415799 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.415790    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:01.415901 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.415803    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:49:01.416789 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.416771    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 14 10:49:01.417900 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.417883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-67krr"
Sep 14 10:49:01.419795 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.419779    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 14 10:49:01.420000 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.419982    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vfwxz"
Sep 14 10:49:01.420188 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.420094    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 14 10:49:01.420415 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.420395    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r758b\""
Sep 14 10:49:01.420472 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.420399    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:49:01.421899 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.421880    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 14 10:49:01.421992 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.421920    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 14 10:49:01.421992 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.421941    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8hqh4\""
Sep 14 10:49:01.423523 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.423505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8xmsc"
Sep 14 10:49:01.424606 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424585    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:01.424711 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-modprobe-d\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.424711 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-sysconfig\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.424711 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp6sm\" (UniqueName: \"kubernetes.io/projected/14abef7b-782a-46a1-9554-ef292563452d-kube-api-access-vp6sm\") pod \"node-resolver-vfwxz\" (UID: \"14abef7b-782a-46a1-9554-ef292563452d\") " pod="openshift-dns/node-resolver-vfwxz"
Sep 14 10:49:01.424711 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32bf6cd3-707a-4ad0-9294-9198e4a4765f-kubelet-config\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:01.424881 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-kubernetes\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.424881 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-sysctl-conf\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.424881 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6772377d-920d-484f-a6c1-ea0a42809be5-host-slash\") pod \"iptables-alerter-67krr\" (UID: \"6772377d-920d-484f-a6c1-ea0a42809be5\") " pod="openshift-network-operator/iptables-alerter-67krr"
Sep 14 10:49:01.424881 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-sysctl-d\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.424881 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-systemd\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.424881 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-run\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.424881 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-sys\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-lib-modules\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-var-lib-kubelet\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-host\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424937    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6772377d-920d-484f-a6c1-ea0a42809be5-iptables-alerter-script\") pod \"iptables-alerter-67krr\" (UID: \"6772377d-920d-484f-a6c1-ea0a42809be5\") " pod="openshift-network-operator/iptables-alerter-67krr"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl4w7\" (UniqueName: \"kubernetes.io/projected/6772377d-920d-484f-a6c1-ea0a42809be5-kube-api-access-dl4w7\") pod \"iptables-alerter-67krr\" (UID: \"6772377d-920d-484f-a6c1-ea0a42809be5\") " pod="openshift-network-operator/iptables-alerter-67krr"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14abef7b-782a-46a1-9554-ef292563452d-hosts-file\") pod \"node-resolver-vfwxz\" (UID: \"14abef7b-782a-46a1-9554-ef292563452d\") " pod="openshift-dns/node-resolver-vfwxz"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.424987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14abef7b-782a-46a1-9554-ef292563452d-tmp-dir\") pod \"node-resolver-vfwxz\" (UID: \"14abef7b-782a-46a1-9554-ef292563452d\") " pod="openshift-dns/node-resolver-vfwxz"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.425004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32bf6cd3-707a-4ad0-9294-9198e4a4765f-dbus\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.425022    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfrv2\" (UniqueName: \"kubernetes.io/projected/5f7dd6e5-19f8-439c-b1f2-e40891332385-kube-api-access-zfrv2\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.425047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg7h8\" (UniqueName: \"kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8\") pod \"network-check-target-7j6cf\" (UID: \"f82376a7-f339-4946-b4ce-ef59eff7cf2b\") " pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.425066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-tuned\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.425085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f7dd6e5-19f8-439c-b1f2-e40891332385-tmp\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.425108    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-13 10:44:00 +0000 UTC" deadline="2028-05-01 21:27:19.186027833 +0000 UTC"
Sep 14 10:49:01.425222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.425147    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14290h38m17.760884595s"
Sep 14 10:49:01.425864 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.425316    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 14 10:49:01.425864 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.425748    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 14 10:49:01.425864 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.425832    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qc5gr\""
Sep 14 10:49:01.425864 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.425848    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 14 10:49:01.426849 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.426824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.428843 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.428826    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 14 10:49:01.428972 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.428943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.430050 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.430030    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 14 10:49:01.430133 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.430081    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 14 10:49:01.430133 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.430081    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 14 10:49:01.430133 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.430081    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 10:49:01.430133 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.430122    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 14 10:49:01.430367 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.430352    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 14 10:49:01.430434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.430383    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x9vrl\""
Sep 14 10:49:01.430891 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.430876    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 14 10:49:01.431074 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.431059    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 14 10:49:01.431147 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.431073    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 14 10:49:01.431147 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.431083    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-82hqr\""
Sep 14 10:49:01.431587 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.431574    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:01.431676 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.431659    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:01.432147 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.432130    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 14 10:49:01.434224 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.434207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.436253 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.436238    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 14 10:49:01.436328 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.436272    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 14 10:49:01.436328 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.436279    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6z8b5\""
Sep 14 10:49:01.436719 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.436706    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:01.438689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.438673    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 14 10:49:01.439121 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.439110    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-s8fkn\""
Sep 14 10:49:01.439352 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.439336    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 14 10:49:01.439423 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.439358    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.441293 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.441277    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 14 10:49:01.441420 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.441404    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 14 10:49:01.441477 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.441404    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 14 10:49:01.441477 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.441459    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xrhwl\""
Sep 14 10:49:01.453923 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.453762    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8wztw"
Sep 14 10:49:01.463912 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.463894    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8wztw"
Sep 14 10:49:01.519523 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.519500    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 14 10:49:01.525357 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-daemon-config\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.525479 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:01.525479 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32bf6cd3-707a-4ad0-9294-9198e4a4765f-kubelet-config\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:01.525479 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5m8c\" (UniqueName: \"kubernetes.io/projected/3bfa1deb-57c8-400d-9176-6d688b7e54b0-kube-api-access-t5m8c\") pod \"node-ca-8xmsc\" (UID: \"3bfa1deb-57c8-400d-9176-6d688b7e54b0\") " pod="openshift-image-registry/node-ca-8xmsc"
Sep 14 10:49:01.525479 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.525456    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:01.525706 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525499    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32bf6cd3-707a-4ad0-9294-9198e4a4765f-kubelet-config\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:01.525706 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.525531    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret podName:32bf6cd3-707a-4ad0-9294-9198e4a4765f nodeName:}" failed. No retries permitted until 2026-09-14 10:49:02.025500631 +0000 UTC m=+2.006136114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret") pod "global-pull-secret-syncer-zmdnx" (UID: "32bf6cd3-707a-4ad0-9294-9198e4a4765f") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:01.525706 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-sysctl-d\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.525706 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525562    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7h8\" (UniqueName: \"kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8\") pod \"network-check-target-7j6cf\" (UID: \"f82376a7-f339-4946-b4ce-ef59eff7cf2b\") " pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:01.525706 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-var-lib-cni-multus\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.525706 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525602    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-systemd-units\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.525706 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-node-log\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.525706 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94329106-294c-46df-85fb-69e9526d8513-env-overrides\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.525706 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfrv2\" (UniqueName: \"kubernetes.io/projected/5f7dd6e5-19f8-439c-b1f2-e40891332385-kube-api-access-zfrv2\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.525706 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-run-netns\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0217b90e-9602-4158-85d4-c39a2e2cb2d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-sysctl-d\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525755    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-cni-netd\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94329106-294c-46df-85fb-69e9526d8513-ovnkube-config\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-systemd\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-run\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-lib-modules\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525930    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-systemd\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-var-lib-kubelet\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525981    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-tuned\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.525990    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-run\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bfa1deb-57c8-400d-9176-6d688b7e54b0-host\") pod \"node-ca-8xmsc\" (UID: \"3bfa1deb-57c8-400d-9176-6d688b7e54b0\") " pod="openshift-image-registry/node-ca-8xmsc"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-lib-modules\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526018    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-var-lib-kubelet\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp6sm\" (UniqueName: \"kubernetes.io/projected/14abef7b-782a-46a1-9554-ef292563452d-kube-api-access-vp6sm\") pod \"node-resolver-vfwxz\" (UID: \"14abef7b-782a-46a1-9554-ef292563452d\") " pod="openshift-dns/node-resolver-vfwxz"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-sys-fs\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.526170 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6772377d-920d-484f-a6c1-ea0a42809be5-host-slash\") pod \"iptables-alerter-67krr\" (UID: \"6772377d-920d-484f-a6c1-ea0a42809be5\") " pod="openshift-network-operator/iptables-alerter-67krr"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14dd0dea-9be0-4ab4-afc5-3061709d60cb-cni-binary-copy\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-run-netns\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-var-lib-kubelet\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-run-multus-certs\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-var-lib-openvswitch\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-log-socket\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526286    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6772377d-920d-484f-a6c1-ea0a42809be5-iptables-alerter-script\") pod \"iptables-alerter-67krr\" (UID: \"6772377d-920d-484f-a6c1-ea0a42809be5\") " pod="openshift-network-operator/iptables-alerter-67krr"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526270    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6772377d-920d-484f-a6c1-ea0a42809be5-host-slash\") pod \"iptables-alerter-67krr\" (UID: \"6772377d-920d-484f-a6c1-ea0a42809be5\") " pod="openshift-network-operator/iptables-alerter-67krr"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14abef7b-782a-46a1-9554-ef292563452d-tmp-dir\") pod \"node-resolver-vfwxz\" (UID: \"14abef7b-782a-46a1-9554-ef292563452d\") " pod="openshift-dns/node-resolver-vfwxz"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0217b90e-9602-4158-85d4-c39a2e2cb2d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-run-openvswitch\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-run-ovn-kubernetes\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwgzp\" (UniqueName: \"kubernetes.io/projected/94329106-294c-46df-85fb-69e9526d8513-kube-api-access-jwgzp\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-hostroot\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526514    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 14 10:49:01.527041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526573    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-host\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527200    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6772377d-920d-484f-a6c1-ea0a42809be5-iptables-alerter-script\") pod \"iptables-alerter-67krr\" (UID: \"6772377d-920d-484f-a6c1-ea0a42809be5\") " pod="openshift-network-operator/iptables-alerter-67krr"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.526523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-host\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f7dd6e5-19f8-439c-b1f2-e40891332385-tmp\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-modprobe-d\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-kubernetes\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-sysctl-conf\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0217b90e-9602-4158-85d4-c39a2e2cb2d2-cnibin\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527455    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtbj9\" (UniqueName: \"kubernetes.io/projected/0217b90e-9602-4158-85d4-c39a2e2cb2d2-kube-api-access-wtbj9\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14abef7b-782a-46a1-9554-ef292563452d-tmp-dir\") pod \"node-resolver-vfwxz\" (UID: \"14abef7b-782a-46a1-9554-ef292563452d\") " pod="openshift-dns/node-resolver-vfwxz"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14abef7b-782a-46a1-9554-ef292563452d-hosts-file\") pod \"node-resolver-vfwxz\" (UID: \"14abef7b-782a-46a1-9554-ef292563452d\") " pod="openshift-dns/node-resolver-vfwxz"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527497    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-modprobe-d\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-run-k8s-cni-cncf-io\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-device-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14abef7b-782a-46a1-9554-ef292563452d-hosts-file\") pod \"node-resolver-vfwxz\" (UID: \"14abef7b-782a-46a1-9554-ef292563452d\") " pod="openshift-dns/node-resolver-vfwxz"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb2xj\" (UniqueName: \"kubernetes.io/projected/23069e7f-7713-490c-bcfb-f410f2bc723c-kube-api-access-fb2xj\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527587    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-sysctl-conf\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.527896 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527636    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-kubelet\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527638    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-kubernetes\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-run-ovn\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6cb1687-fe61-4d47-b31c-adb35652867a-agent-certs\") pod \"konnectivity-agent-gpp5n\" (UID: \"a6cb1687-fe61-4d47-b31c-adb35652867a\") " pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-etc-kubernetes\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527761    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-socket-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0217b90e-9602-4158-85d4-c39a2e2cb2d2-system-cni-dir\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6cb1687-fe61-4d47-b31c-adb35652867a-konnectivity-ca\") pod \"konnectivity-agent-gpp5n\" (UID: \"a6cb1687-fe61-4d47-b31c-adb35652867a\") " pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-sys\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527872    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-sys\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-sysconfig\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-cni-dir\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-socket-dir-parent\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-sysconfig\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.527995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-var-lib-cni-bin\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k56dz\" (UniqueName: \"kubernetes.io/projected/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-kube-api-access-k56dz\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-slash\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.528539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-etc-selinux\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3bfa1deb-57c8-400d-9176-6d688b7e54b0-serviceca\") pod \"node-ca-8xmsc\" (UID: \"3bfa1deb-57c8-400d-9176-6d688b7e54b0\") " pod="openshift-image-registry/node-ca-8xmsc"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj7ws\" (UniqueName: \"kubernetes.io/projected/14dd0dea-9be0-4ab4-afc5-3061709d60cb-kube-api-access-pj7ws\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94329106-294c-46df-85fb-69e9526d8513-ovn-node-metrics-cert\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl4w7\" (UniqueName: \"kubernetes.io/projected/6772377d-920d-484f-a6c1-ea0a42809be5-kube-api-access-dl4w7\") pod \"iptables-alerter-67krr\" (UID: \"6772377d-920d-484f-a6c1-ea0a42809be5\") " pod="openshift-network-operator/iptables-alerter-67krr"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32bf6cd3-707a-4ad0-9294-9198e4a4765f-dbus\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-conf-dir\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-registration-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32bf6cd3-707a-4ad0-9294-9198e4a4765f-dbus\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-run-systemd\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0217b90e-9602-4158-85d4-c39a2e2cb2d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-etc-openvswitch\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528397    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-cni-bin\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94329106-294c-46df-85fb-69e9526d8513-ovnkube-script-lib\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.529264 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0217b90e-9602-4158-85d4-c39a2e2cb2d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.530031 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-system-cni-dir\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.530031 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.528499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-cnibin\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.531598 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.530704    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f7dd6e5-19f8-439c-b1f2-e40891332385-tmp\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.531598 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.530748    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5f7dd6e5-19f8-439c-b1f2-e40891332385-etc-tuned\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.536593 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.536574    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:49:01.536593 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.536593    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:49:01.536752 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.536604    2576 projected.go:196] Error preparing data for projected volume kube-api-access-bg7h8 for pod openshift-network-diagnostics/network-check-target-7j6cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:01.536752 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.536688    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8 podName:f82376a7-f339-4946-b4ce-ef59eff7cf2b nodeName:}" failed. No retries permitted until 2026-09-14 10:49:02.036674468 +0000 UTC m=+2.017309950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bg7h8" (UniqueName: "kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8") pod "network-check-target-7j6cf" (UID: "f82376a7-f339-4946-b4ce-ef59eff7cf2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:01.538880 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.538860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp6sm\" (UniqueName: \"kubernetes.io/projected/14abef7b-782a-46a1-9554-ef292563452d-kube-api-access-vp6sm\") pod \"node-resolver-vfwxz\" (UID: \"14abef7b-782a-46a1-9554-ef292563452d\") " pod="openshift-dns/node-resolver-vfwxz"
Sep 14 10:49:01.540777 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.540759    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfrv2\" (UniqueName: \"kubernetes.io/projected/5f7dd6e5-19f8-439c-b1f2-e40891332385-kube-api-access-zfrv2\") pod \"tuned-2g6wd\" (UID: \"5f7dd6e5-19f8-439c-b1f2-e40891332385\") " pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.543024 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.543002    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl4w7\" (UniqueName: \"kubernetes.io/projected/6772377d-920d-484f-a6c1-ea0a42809be5-kube-api-access-dl4w7\") pod \"iptables-alerter-67krr\" (UID: \"6772377d-920d-484f-a6c1-ea0a42809be5\") " pod="openshift-network-operator/iptables-alerter-67krr"
Sep 14 10:49:01.602122 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:01.602052    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bdffdae562a11beaff0a15fcd57b726.slice/crio-4b6519f77bd82b0a6e1acfd3a06b704a265e2dbd2d8930df0720e6fce3ad6641 WatchSource:0}: Error finding container 4b6519f77bd82b0a6e1acfd3a06b704a265e2dbd2d8930df0720e6fce3ad6641: Status 404 returned error can't find the container with id 4b6519f77bd82b0a6e1acfd3a06b704a265e2dbd2d8930df0720e6fce3ad6641
Sep 14 10:49:01.606275 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.606259    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:49:01.629634 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtbj9\" (UniqueName: \"kubernetes.io/projected/0217b90e-9602-4158-85d4-c39a2e2cb2d2-kube-api-access-wtbj9\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.629771 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-run-k8s-cni-cncf-io\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.629771 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-device-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.629771 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629739    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-device-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.629771 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629742    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-run-k8s-cni-cncf-io\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.629951 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb2xj\" (UniqueName: \"kubernetes.io/projected/23069e7f-7713-490c-bcfb-f410f2bc723c-kube-api-access-fb2xj\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.629951 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-kubelet\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.629951 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-run-ovn\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.629951 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6cb1687-fe61-4d47-b31c-adb35652867a-agent-certs\") pod \"konnectivity-agent-gpp5n\" (UID: \"a6cb1687-fe61-4d47-b31c-adb35652867a\") " pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:01.629951 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-etc-kubernetes\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.629951 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-socket-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.629951 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0217b90e-9602-4158-85d4-c39a2e2cb2d2-system-cni-dir\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.629951 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-kubelet\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.629951 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6cb1687-fe61-4d47-b31c-adb35652867a-konnectivity-ca\") pod \"konnectivity-agent-gpp5n\" (UID: \"a6cb1687-fe61-4d47-b31c-adb35652867a\") " pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:01.629951 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629942    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-etc-kubernetes\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-cni-dir\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629962    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-run-ovn\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.629981    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-socket-dir-parent\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-var-lib-cni-bin\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0217b90e-9602-4158-85d4-c39a2e2cb2d2-system-cni-dir\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k56dz\" (UniqueName: \"kubernetes.io/projected/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-kube-api-access-k56dz\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-slash\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-cni-dir\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-socket-dir-parent\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630099    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-var-lib-cni-bin\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-socket-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630147    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630159    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-slash\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-etc-selinux\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3bfa1deb-57c8-400d-9176-6d688b7e54b0-serviceca\") pod \"node-ca-8xmsc\" (UID: \"3bfa1deb-57c8-400d-9176-6d688b7e54b0\") " pod="openshift-image-registry/node-ca-8xmsc"
Sep 14 10:49:01.630434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj7ws\" (UniqueName: \"kubernetes.io/projected/14dd0dea-9be0-4ab4-afc5-3061709d60cb-kube-api-access-pj7ws\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630270    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94329106-294c-46df-85fb-69e9526d8513-ovn-node-metrics-cert\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-etc-selinux\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-conf-dir\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630368    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-conf-dir\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-registration-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630484    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-registration-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.630501    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-run-systemd\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:01.630577    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs podName:2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08 nodeName:}" failed. No retries permitted until 2026-09-14 10:49:02.130550597 +0000 UTC m=+2.111186085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs") pod "network-metrics-daemon-mxgs8" (UID: "2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630580    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3bfa1deb-57c8-400d-9176-6d688b7e54b0-serviceca\") pod \"node-ca-8xmsc\" (UID: \"3bfa1deb-57c8-400d-9176-6d688b7e54b0\") " pod="openshift-image-registry/node-ca-8xmsc"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630592    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-run-systemd\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6cb1687-fe61-4d47-b31c-adb35652867a-konnectivity-ca\") pod \"konnectivity-agent-gpp5n\" (UID: \"a6cb1687-fe61-4d47-b31c-adb35652867a\") " pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0217b90e-9602-4158-85d4-c39a2e2cb2d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-etc-openvswitch\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-cni-bin\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.631279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630692    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-etc-openvswitch\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94329106-294c-46df-85fb-69e9526d8513-ovnkube-script-lib\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0217b90e-9602-4158-85d4-c39a2e2cb2d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-cni-bin\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0217b90e-9602-4158-85d4-c39a2e2cb2d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-system-cni-dir\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-cnibin\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-system-cni-dir\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-daemon-config\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630868    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-cnibin\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5m8c\" (UniqueName: \"kubernetes.io/projected/3bfa1deb-57c8-400d-9176-6d688b7e54b0-kube-api-access-t5m8c\") pod \"node-ca-8xmsc\" (UID: \"3bfa1deb-57c8-400d-9176-6d688b7e54b0\") " pod="openshift-image-registry/node-ca-8xmsc"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630934    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-var-lib-cni-multus\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-systemd-units\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.630978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-node-log\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94329106-294c-46df-85fb-69e9526d8513-env-overrides\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-run-netns\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631029    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-var-lib-cni-multus\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-run-netns\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0217b90e-9602-4158-85d4-c39a2e2cb2d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-cni-netd\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-node-log\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94329106-294c-46df-85fb-69e9526d8513-ovnkube-config\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bfa1deb-57c8-400d-9176-6d688b7e54b0-host\") pod \"node-ca-8xmsc\" (UID: \"3bfa1deb-57c8-400d-9176-6d688b7e54b0\") " pod="openshift-image-registry/node-ca-8xmsc"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-sys-fs\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14dd0dea-9be0-4ab4-afc5-3061709d60cb-cni-binary-copy\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-run-netns\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-var-lib-kubelet\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-run-multus-certs\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-var-lib-openvswitch\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631316    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0217b90e-9602-4158-85d4-c39a2e2cb2d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-log-socket\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0217b90e-9602-4158-85d4-c39a2e2cb2d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94329106-294c-46df-85fb-69e9526d8513-ovnkube-script-lib\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631379    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-systemd-units\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.632689 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631430    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14dd0dea-9be0-4ab4-afc5-3061709d60cb-multus-daemon-config\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-sys-fs\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-run-openvswitch\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631477    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94329106-294c-46df-85fb-69e9526d8513-env-overrides\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-cni-netd\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-run-ovn-kubernetes\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bfa1deb-57c8-400d-9176-6d688b7e54b0-host\") pod \"node-ca-8xmsc\" (UID: \"3bfa1deb-57c8-400d-9176-6d688b7e54b0\") " pod="openshift-image-registry/node-ca-8xmsc"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631522    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-var-lib-openvswitch\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631430    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-log-socket\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwgzp\" (UniqueName: \"kubernetes.io/projected/94329106-294c-46df-85fb-69e9526d8513-kube-api-access-jwgzp\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-hostroot\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-host-run-ovn-kubernetes\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631579    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/23069e7f-7713-490c-bcfb-f410f2bc723c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631600    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-run-netns\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631618    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-var-lib-kubelet\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-host-run-multus-certs\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631488    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94329106-294c-46df-85fb-69e9526d8513-run-openvswitch\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0217b90e-9602-4158-85d4-c39a2e2cb2d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.633154 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14dd0dea-9be0-4ab4-afc5-3061709d60cb-hostroot\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.633643 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0217b90e-9602-4158-85d4-c39a2e2cb2d2-cnibin\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.633643 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.631945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0217b90e-9602-4158-85d4-c39a2e2cb2d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.633643 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.632001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0217b90e-9602-4158-85d4-c39a2e2cb2d2-cnibin\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.633643 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.632023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94329106-294c-46df-85fb-69e9526d8513-ovnkube-config\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.633643 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.632060    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14dd0dea-9be0-4ab4-afc5-3061709d60cb-cni-binary-copy\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.633643 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.632788    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94329106-294c-46df-85fb-69e9526d8513-ovn-node-metrics-cert\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.633643 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.632893    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6cb1687-fe61-4d47-b31c-adb35652867a-agent-certs\") pod \"konnectivity-agent-gpp5n\" (UID: \"a6cb1687-fe61-4d47-b31c-adb35652867a\") " pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:01.657684 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.657663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb2xj\" (UniqueName: \"kubernetes.io/projected/23069e7f-7713-490c-bcfb-f410f2bc723c-kube-api-access-fb2xj\") pod \"aws-ebs-csi-driver-node-82k8t\" (UID: \"23069e7f-7713-490c-bcfb-f410f2bc723c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.657809 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.657734    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj7ws\" (UniqueName: \"kubernetes.io/projected/14dd0dea-9be0-4ab4-afc5-3061709d60cb-kube-api-access-pj7ws\") pod \"multus-q2sr2\" (UID: \"14dd0dea-9be0-4ab4-afc5-3061709d60cb\") " pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.659246 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.659222    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwgzp\" (UniqueName: \"kubernetes.io/projected/94329106-294c-46df-85fb-69e9526d8513-kube-api-access-jwgzp\") pod \"ovnkube-node-n99qp\" (UID: \"94329106-294c-46df-85fb-69e9526d8513\") " pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.659683 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.659665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k56dz\" (UniqueName: \"kubernetes.io/projected/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-kube-api-access-k56dz\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:01.659925 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.659910    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtbj9\" (UniqueName: \"kubernetes.io/projected/0217b90e-9602-4158-85d4-c39a2e2cb2d2-kube-api-access-wtbj9\") pod \"multus-additional-cni-plugins-p9rc9\" (UID: \"0217b90e-9602-4158-85d4-c39a2e2cb2d2\") " pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.660301 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.660278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5m8c\" (UniqueName: \"kubernetes.io/projected/3bfa1deb-57c8-400d-9176-6d688b7e54b0-kube-api-access-t5m8c\") pod \"node-ca-8xmsc\" (UID: \"3bfa1deb-57c8-400d-9176-6d688b7e54b0\") " pod="openshift-image-registry/node-ca-8xmsc"
Sep 14 10:49:01.667236 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.667217    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:49:01.670881 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:01.670853    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb46e686325d84730d02f0119973c3b3.slice/crio-930d3c4815153e66af63545aa994b0b9c9fcb55d196885eb6f4d75a54a7fa4c8 WatchSource:0}: Error finding container 930d3c4815153e66af63545aa994b0b9c9fcb55d196885eb6f4d75a54a7fa4c8: Status 404 returned error can't find the container with id 930d3c4815153e66af63545aa994b0b9c9fcb55d196885eb6f4d75a54a7fa4c8
Sep 14 10:49:01.751872 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.751842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2g6wd"
Sep 14 10:49:01.760429 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:01.760404    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7dd6e5_19f8_439c_b1f2_e40891332385.slice/crio-38f95984ca815af8087c227709eb6fba83ab4fc8636384e9ff1866084a5bff23 WatchSource:0}: Error finding container 38f95984ca815af8087c227709eb6fba83ab4fc8636384e9ff1866084a5bff23: Status 404 returned error can't find the container with id 38f95984ca815af8087c227709eb6fba83ab4fc8636384e9ff1866084a5bff23
Sep 14 10:49:01.775517 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.775495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-67krr"
Sep 14 10:49:01.783192 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:01.783168    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6772377d_920d_484f_a6c1_ea0a42809be5.slice/crio-68c6cf761060ba889404e78d6c7e040acc0d4094c8319c9df08db2bfa25648df WatchSource:0}: Error finding container 68c6cf761060ba889404e78d6c7e040acc0d4094c8319c9df08db2bfa25648df: Status 404 returned error can't find the container with id 68c6cf761060ba889404e78d6c7e040acc0d4094c8319c9df08db2bfa25648df
Sep 14 10:49:01.788174 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.788158    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vfwxz"
Sep 14 10:49:01.795560 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:01.795541    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14abef7b_782a_46a1_9554_ef292563452d.slice/crio-117e68bcd329688d8d75fe7bbde672a5dbd356b2cda5746e56e498e9a10d0507 WatchSource:0}: Error finding container 117e68bcd329688d8d75fe7bbde672a5dbd356b2cda5746e56e498e9a10d0507: Status 404 returned error can't find the container with id 117e68bcd329688d8d75fe7bbde672a5dbd356b2cda5746e56e498e9a10d0507
Sep 14 10:49:01.801820 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.801799    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8xmsc"
Sep 14 10:49:01.809152 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:01.809133    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bfa1deb_57c8_400d_9176_6d688b7e54b0.slice/crio-c1b6205e1e84bc6a551962f932d42f84f0774f14b8a0354d7f40f737a8d00bf7 WatchSource:0}: Error finding container c1b6205e1e84bc6a551962f932d42f84f0774f14b8a0354d7f40f737a8d00bf7: Status 404 returned error can't find the container with id c1b6205e1e84bc6a551962f932d42f84f0774f14b8a0354d7f40f737a8d00bf7
Sep 14 10:49:01.823594 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.823578    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:01.831186 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:01.831165    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94329106_294c_46df_85fb_69e9526d8513.slice/crio-d713e00b887b8d30c8598137136f99067e1f7f1bc0e98adad61202179a78b4af WatchSource:0}: Error finding container d713e00b887b8d30c8598137136f99067e1f7f1bc0e98adad61202179a78b4af: Status 404 returned error can't find the container with id d713e00b887b8d30c8598137136f99067e1f7f1bc0e98adad61202179a78b4af
Sep 14 10:49:01.848850 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.848826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q2sr2"
Sep 14 10:49:01.856424 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:01.856405    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14dd0dea_9be0_4ab4_afc5_3061709d60cb.slice/crio-f75f508d09b4321738359c76c05c8eaca5aac1fe1b02fb055c398a6b7b31014f WatchSource:0}: Error finding container f75f508d09b4321738359c76c05c8eaca5aac1fe1b02fb055c398a6b7b31014f: Status 404 returned error can't find the container with id f75f508d09b4321738359c76c05c8eaca5aac1fe1b02fb055c398a6b7b31014f
Sep 14 10:49:01.863833 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.863816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p9rc9"
Sep 14 10:49:01.871312 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:01.871283    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0217b90e_9602_4158_85d4_c39a2e2cb2d2.slice/crio-d1119f76cf8b1e552f18422193622a555aecf1bd7be2e929464ca81697922df1 WatchSource:0}: Error finding container d1119f76cf8b1e552f18422193622a555aecf1bd7be2e929464ca81697922df1: Status 404 returned error can't find the container with id d1119f76cf8b1e552f18422193622a555aecf1bd7be2e929464ca81697922df1
Sep 14 10:49:01.879421 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.879406    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:01.884212 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:01.884199    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t"
Sep 14 10:49:01.886931 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:01.886914    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cb1687_fe61_4d47_b31c_adb35652867a.slice/crio-17af2bb4b622cae540089f6c86a91375471755ddf40932def37768ff3d2d08ca WatchSource:0}: Error finding container 17af2bb4b622cae540089f6c86a91375471755ddf40932def37768ff3d2d08ca: Status 404 returned error can't find the container with id 17af2bb4b622cae540089f6c86a91375471755ddf40932def37768ff3d2d08ca
Sep 14 10:49:01.893708 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:01.893681    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23069e7f_7713_490c_bcfb_f410f2bc723c.slice/crio-9fd6ffd2d5f3087f02a01be59a3742ea4a5053d078244b3fdca037e06cdace4d WatchSource:0}: Error finding container 9fd6ffd2d5f3087f02a01be59a3742ea4a5053d078244b3fdca037e06cdace4d: Status 404 returned error can't find the container with id 9fd6ffd2d5f3087f02a01be59a3742ea4a5053d078244b3fdca037e06cdace4d
Sep 14 10:49:02.003463 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.003436    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:49:02.034836 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.034809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:02.034980 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:02.034926    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:02.034980 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:02.034979    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret podName:32bf6cd3-707a-4ad0-9294-9198e4a4765f nodeName:}" failed. No retries permitted until 2026-09-14 10:49:03.034962204 +0000 UTC m=+3.015597690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret") pod "global-pull-secret-syncer-zmdnx" (UID: "32bf6cd3-707a-4ad0-9294-9198e4a4765f") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:02.135728 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.135638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:02.135728 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.135725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7h8\" (UniqueName: \"kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8\") pod \"network-check-target-7j6cf\" (UID: \"f82376a7-f339-4946-b4ce-ef59eff7cf2b\") " pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:02.135943 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:02.135768    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:02.135943 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:02.135836    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs podName:2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08 nodeName:}" failed. No retries permitted until 2026-09-14 10:49:03.135817152 +0000 UTC m=+3.116452642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs") pod "network-metrics-daemon-mxgs8" (UID: "2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:02.135943 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:02.135857    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:49:02.135943 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:02.135887    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:49:02.135943 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:02.135901    2576 projected.go:196] Error preparing data for projected volume kube-api-access-bg7h8 for pod openshift-network-diagnostics/network-check-target-7j6cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:02.136196 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:02.135961    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8 podName:f82376a7-f339-4946-b4ce-ef59eff7cf2b nodeName:}" failed. No retries permitted until 2026-09-14 10:49:03.135944919 +0000 UTC m=+3.116580408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bg7h8" (UniqueName: "kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8") pod "network-check-target-7j6cf" (UID: "f82376a7-f339-4946-b4ce-ef59eff7cf2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:02.467010 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.466871    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 10:44:01 +0000 UTC" deadline="2028-03-08 17:31:20.816200089 +0000 UTC"
Sep 14 10:49:02.467010 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.466934    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12990h42m18.34927021s"
Sep 14 10:49:02.555500 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.554765    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:02.555500 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:02.554969    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:02.555500 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.555365    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:02.555500 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:02.555452    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:02.556269 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.555969    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:02.556269 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:02.556060    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:02.578036 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.577977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal" event={"ID":"fb46e686325d84730d02f0119973c3b3","Type":"ContainerStarted","Data":"930d3c4815153e66af63545aa994b0b9c9fcb55d196885eb6f4d75a54a7fa4c8"}
Sep 14 10:49:02.585469 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.585374    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gpp5n" event={"ID":"a6cb1687-fe61-4d47-b31c-adb35652867a","Type":"ContainerStarted","Data":"17af2bb4b622cae540089f6c86a91375471755ddf40932def37768ff3d2d08ca"}
Sep 14 10:49:02.593754 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.593640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9rc9" event={"ID":"0217b90e-9602-4158-85d4-c39a2e2cb2d2","Type":"ContainerStarted","Data":"d1119f76cf8b1e552f18422193622a555aecf1bd7be2e929464ca81697922df1"}
Sep 14 10:49:02.605041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.604982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp" event={"ID":"94329106-294c-46df-85fb-69e9526d8513","Type":"ContainerStarted","Data":"d713e00b887b8d30c8598137136f99067e1f7f1bc0e98adad61202179a78b4af"}
Sep 14 10:49:02.622755 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.622527    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vfwxz" event={"ID":"14abef7b-782a-46a1-9554-ef292563452d","Type":"ContainerStarted","Data":"117e68bcd329688d8d75fe7bbde672a5dbd356b2cda5746e56e498e9a10d0507"}
Sep 14 10:49:02.640309 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.640272    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-67krr" event={"ID":"6772377d-920d-484f-a6c1-ea0a42809be5","Type":"ContainerStarted","Data":"68c6cf761060ba889404e78d6c7e040acc0d4094c8319c9df08db2bfa25648df"}
Sep 14 10:49:02.673695 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.673630    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-201.ec2.internal" event={"ID":"3bdffdae562a11beaff0a15fcd57b726","Type":"ContainerStarted","Data":"4b6519f77bd82b0a6e1acfd3a06b704a265e2dbd2d8930df0720e6fce3ad6641"}
Sep 14 10:49:02.681845 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.681810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t" event={"ID":"23069e7f-7713-490c-bcfb-f410f2bc723c","Type":"ContainerStarted","Data":"9fd6ffd2d5f3087f02a01be59a3742ea4a5053d078244b3fdca037e06cdace4d"}
Sep 14 10:49:02.702724 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.702619    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q2sr2" event={"ID":"14dd0dea-9be0-4ab4-afc5-3061709d60cb","Type":"ContainerStarted","Data":"f75f508d09b4321738359c76c05c8eaca5aac1fe1b02fb055c398a6b7b31014f"}
Sep 14 10:49:02.716474 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.716418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8xmsc" event={"ID":"3bfa1deb-57c8-400d-9176-6d688b7e54b0","Type":"ContainerStarted","Data":"c1b6205e1e84bc6a551962f932d42f84f0774f14b8a0354d7f40f737a8d00bf7"}
Sep 14 10:49:02.733600 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.733559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2g6wd" event={"ID":"5f7dd6e5-19f8-439c-b1f2-e40891332385","Type":"ContainerStarted","Data":"38f95984ca815af8087c227709eb6fba83ab4fc8636384e9ff1866084a5bff23"}
Sep 14 10:49:02.866990 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:02.866793    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:49:03.043408 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:03.043325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:03.043567 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:03.043520    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:03.043630 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:03.043584    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret podName:32bf6cd3-707a-4ad0-9294-9198e4a4765f nodeName:}" failed. No retries permitted until 2026-09-14 10:49:05.043566041 +0000 UTC m=+5.024201542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret") pod "global-pull-secret-syncer-zmdnx" (UID: "32bf6cd3-707a-4ad0-9294-9198e4a4765f") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:03.144248 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:03.144210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7h8\" (UniqueName: \"kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8\") pod \"network-check-target-7j6cf\" (UID: \"f82376a7-f339-4946-b4ce-ef59eff7cf2b\") " pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:03.144437 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:03.144299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:03.144437 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:03.144420    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:03.144546 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:03.144481    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs podName:2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08 nodeName:}" failed. No retries permitted until 2026-09-14 10:49:05.144463519 +0000 UTC m=+5.125099019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs") pod "network-metrics-daemon-mxgs8" (UID: "2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:03.144605 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:03.144572    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:49:03.144605 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:03.144597    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:49:03.144738 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:03.144610    2576 projected.go:196] Error preparing data for projected volume kube-api-access-bg7h8 for pod openshift-network-diagnostics/network-check-target-7j6cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:03.144738 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:03.144679    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8 podName:f82376a7-f339-4946-b4ce-ef59eff7cf2b nodeName:}" failed. No retries permitted until 2026-09-14 10:49:05.144662502 +0000 UTC m=+5.125298009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bg7h8" (UniqueName: "kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8") pod "network-check-target-7j6cf" (UID: "f82376a7-f339-4946-b4ce-ef59eff7cf2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:03.467446 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:03.467359    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 10:44:01 +0000 UTC" deadline="2028-04-23 11:53:55.188339321 +0000 UTC"
Sep 14 10:49:03.467446 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:03.467402    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14089h4m51.720943606s"
Sep 14 10:49:03.582915 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:03.582883    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:49:04.556696 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:04.554782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:04.556696 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:04.554932    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:04.556696 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:04.555334    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:04.556696 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:04.555486    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:04.556696 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:04.555550    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:04.556696 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:04.555616    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:05.061909 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:05.061853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:05.062077 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:05.062012    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:05.062136 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:05.062077    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret podName:32bf6cd3-707a-4ad0-9294-9198e4a4765f nodeName:}" failed. No retries permitted until 2026-09-14 10:49:09.062058007 +0000 UTC m=+9.042693507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret") pod "global-pull-secret-syncer-zmdnx" (UID: "32bf6cd3-707a-4ad0-9294-9198e4a4765f") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:05.162265 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:05.162222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:05.162519 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:05.162292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7h8\" (UniqueName: \"kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8\") pod \"network-check-target-7j6cf\" (UID: \"f82376a7-f339-4946-b4ce-ef59eff7cf2b\") " pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:05.162519 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:05.162433    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:49:05.162519 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:05.162456    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:49:05.162519 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:05.162469    2576 projected.go:196] Error preparing data for projected volume kube-api-access-bg7h8 for pod openshift-network-diagnostics/network-check-target-7j6cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:05.162745 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:05.162526    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8 podName:f82376a7-f339-4946-b4ce-ef59eff7cf2b nodeName:}" failed. No retries permitted until 2026-09-14 10:49:09.162508676 +0000 UTC m=+9.143144162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bg7h8" (UniqueName: "kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8") pod "network-check-target-7j6cf" (UID: "f82376a7-f339-4946-b4ce-ef59eff7cf2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:05.162807 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:05.162776    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:05.162859 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:05.162840    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs podName:2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08 nodeName:}" failed. No retries permitted until 2026-09-14 10:49:09.162821156 +0000 UTC m=+9.143456656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs") pod "network-metrics-daemon-mxgs8" (UID: "2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:06.554345 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:06.554309    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:06.554968 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:06.554319    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:06.554968 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:06.554415    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:06.554968 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:06.554489    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:06.554968 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:06.554319    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:06.554968 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:06.554562    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:08.558814 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:08.558777    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:08.559277 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:08.558903    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:08.559277 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:08.558911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:08.559277 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:08.558907    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:08.559277 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:08.559018    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:08.559277 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:08.559118    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:09.096014 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:09.095975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:09.096164 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:09.096122    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:09.096200 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:09.096186    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret podName:32bf6cd3-707a-4ad0-9294-9198e4a4765f nodeName:}" failed. No retries permitted until 2026-09-14 10:49:17.096168975 +0000 UTC m=+17.076804471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret") pod "global-pull-secret-syncer-zmdnx" (UID: "32bf6cd3-707a-4ad0-9294-9198e4a4765f") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:09.197900 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:09.197316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7h8\" (UniqueName: \"kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8\") pod \"network-check-target-7j6cf\" (UID: \"f82376a7-f339-4946-b4ce-ef59eff7cf2b\") " pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:09.197900 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:09.197389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:09.197900 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:09.197507    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:09.197900 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:09.197566    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs podName:2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08 nodeName:}" failed. No retries permitted until 2026-09-14 10:49:17.197553747 +0000 UTC m=+17.178189234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs") pod "network-metrics-daemon-mxgs8" (UID: "2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:09.197900 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:09.197569    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:49:09.197900 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:09.197626    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:49:09.197900 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:09.197672    2576 projected.go:196] Error preparing data for projected volume kube-api-access-bg7h8 for pod openshift-network-diagnostics/network-check-target-7j6cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:09.199366 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:09.198271    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8 podName:f82376a7-f339-4946-b4ce-ef59eff7cf2b nodeName:}" failed. No retries permitted until 2026-09-14 10:49:17.197710529 +0000 UTC m=+17.178346030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bg7h8" (UniqueName: "kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8") pod "network-check-target-7j6cf" (UID: "f82376a7-f339-4946-b4ce-ef59eff7cf2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:10.556180 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:10.555455    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:10.556180 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:10.555573    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:10.556180 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:10.555936    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:10.556180 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:10.556028    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:10.556180 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:10.556090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:10.556180 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:10.556147    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:12.554122 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:12.554085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:12.554122 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:12.554115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:12.554607 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:12.554086    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:12.554607 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:12.554182    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:12.554607 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:12.554301    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:12.554607 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:12.554394    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:14.554663 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:14.554613    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:14.555126 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:14.554618    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:14.555126 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:14.554740    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:14.555126 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:14.554846    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:14.555126 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:14.554618    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:14.555126 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:14.554937    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:16.554565 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:16.554475    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:16.554565 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:16.554507    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:16.555047 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:16.554478    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:16.555047 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:16.554599    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:16.555047 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:16.554703    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:16.555047 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:16.554800    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:17.156920 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:17.156883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:17.157146 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:17.157037    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:17.157146 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:17.157099    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret podName:32bf6cd3-707a-4ad0-9294-9198e4a4765f nodeName:}" failed. No retries permitted until 2026-09-14 10:49:33.157081826 +0000 UTC m=+33.137717314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret") pod "global-pull-secret-syncer-zmdnx" (UID: "32bf6cd3-707a-4ad0-9294-9198e4a4765f") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:17.258233 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:17.258194    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:17.258402 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:17.258264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7h8\" (UniqueName: \"kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8\") pod \"network-check-target-7j6cf\" (UID: \"f82376a7-f339-4946-b4ce-ef59eff7cf2b\") " pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:17.259090 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:17.258606    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:17.259090 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:17.258711    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:49:17.259090 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:17.258740    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:49:17.259090 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:17.258756    2576 projected.go:196] Error preparing data for projected volume kube-api-access-bg7h8 for pod openshift-network-diagnostics/network-check-target-7j6cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:17.259090 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:17.258753    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs podName:2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08 nodeName:}" failed. No retries permitted until 2026-09-14 10:49:33.258718914 +0000 UTC m=+33.239354413 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs") pod "network-metrics-daemon-mxgs8" (UID: "2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:17.259090 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:17.258815    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8 podName:f82376a7-f339-4946-b4ce-ef59eff7cf2b nodeName:}" failed. No retries permitted until 2026-09-14 10:49:33.258797782 +0000 UTC m=+33.239433282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bg7h8" (UniqueName: "kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8") pod "network-check-target-7j6cf" (UID: "f82376a7-f339-4946-b4ce-ef59eff7cf2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:18.554793 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:18.554759    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:18.554793 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:18.554784    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:18.555279 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:18.554767    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:18.555279 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:18.554898    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:18.555279 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:18.555015    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:18.555279 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:18.555103    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:20.555287 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:20.555264    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:20.555639 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:20.555385    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:20.555639 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:20.555451    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:20.555639 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:20.555537    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:20.555639 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:20.555573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:20.555639 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:20.555630    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:20.791405 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:20.791106    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q2sr2" event={"ID":"14dd0dea-9be0-4ab4-afc5-3061709d60cb","Type":"ContainerStarted","Data":"e1803fa49bf119b6070e89f22607dc4adc5f86c8ea4f36a9a7e619991e8275ea"}
Sep 14 10:49:20.804596 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:20.804563    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2g6wd" event={"ID":"5f7dd6e5-19f8-439c-b1f2-e40891332385","Type":"ContainerStarted","Data":"2f324720ae8ec9e644e9ac2632148d291e408abd0cca38088575b0a2e9b058d1"}
Sep 14 10:49:20.809821 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:20.809795    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp" event={"ID":"94329106-294c-46df-85fb-69e9526d8513","Type":"ContainerStarted","Data":"a8f4bd24eab94f617de8589472594236da8e9032a2e958b507c5140bebf4696b"}
Sep 14 10:49:20.810365 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:20.810308    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q2sr2" podStartSLOduration=2.040437058 podStartE2EDuration="20.810288978s" totalImagesPullingTime="18.76985192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:20.809364052 +0000 UTC m=+20.789999558" watchObservedRunningTime="2026-09-14 10:49:20.810288978 +0000 UTC m=+20.790924484"
Sep 14 10:49:20.812075 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:20.812049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-201.ec2.internal" event={"ID":"3bdffdae562a11beaff0a15fcd57b726","Type":"ContainerStarted","Data":"e5ee2ac7c8643ac461a7fc6bd61d43e266a3981c91194d118fe83ca98abdad52"}
Sep 14 10:49:20.844003 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:20.843798    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2g6wd" podStartSLOduration=2.15913707 podStartE2EDuration="20.843777977s" totalImagesPullingTime="18.684640907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:20.82561241 +0000 UTC m=+20.806247915" watchObservedRunningTime="2026-09-14 10:49:20.843777977 +0000 UTC m=+20.824413484"
Sep 14 10:49:20.844394 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:20.844354    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-201.ec2.internal" podStartSLOduration=19.844339281 podStartE2EDuration="19.844339281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:20.843170737 +0000 UTC m=+20.823806263" watchObservedRunningTime="2026-09-14 10:49:20.844339281 +0000 UTC m=+20.824974789"
Sep 14 10:49:21.815979 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.815896    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gpp5n" event={"ID":"a6cb1687-fe61-4d47-b31c-adb35652867a","Type":"ContainerStarted","Data":"523e9bad9ab43b527dc73d894215987b206f562ec257769e250e25d6598d4373"}
Sep 14 10:49:21.817766 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.817734    2576 generic.go:356] "Generic (PLEG): container finished" podID="0217b90e-9602-4158-85d4-c39a2e2cb2d2" containerID="32c7245d902b168ec2c5d28f91f634a1ec48a312b97177bc8bff7b486af2372f" exitCode=0
Sep 14 10:49:21.817910 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.817852    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9rc9" event={"ID":"0217b90e-9602-4158-85d4-c39a2e2cb2d2","Type":"ContainerDied","Data":"32c7245d902b168ec2c5d28f91f634a1ec48a312b97177bc8bff7b486af2372f"}
Sep 14 10:49:21.821641 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.821612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp" event={"ID":"94329106-294c-46df-85fb-69e9526d8513","Type":"ContainerStarted","Data":"cdfc6db4f6d857f9a25ba77f4b8751fa1e597b3fbadc21b12b636b64f1989f55"}
Sep 14 10:49:21.821769 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.821707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp" event={"ID":"94329106-294c-46df-85fb-69e9526d8513","Type":"ContainerStarted","Data":"a3db1e64af892be7239445dab7a7f4984e6fa2cae27aa27a9937d852e57a2b23"}
Sep 14 10:49:21.821769 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.821760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp" event={"ID":"94329106-294c-46df-85fb-69e9526d8513","Type":"ContainerStarted","Data":"86c58f097a56aea919074b846b59199051b9a3ec73a44b245535640e460813bf"}
Sep 14 10:49:21.821940 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.821794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp" event={"ID":"94329106-294c-46df-85fb-69e9526d8513","Type":"ContainerStarted","Data":"1ba3544b93aeefdfb8dd23ebd8d2d8708a0b4b937803bb41ed2343ccec9f3ad4"}
Sep 14 10:49:21.821940 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.821838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp" event={"ID":"94329106-294c-46df-85fb-69e9526d8513","Type":"ContainerStarted","Data":"5879e1418079806bcb7c23c4c0b474f02ea43d20d07d2d32c8b1a24d35347f31"}
Sep 14 10:49:21.823267 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.823239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vfwxz" event={"ID":"14abef7b-782a-46a1-9554-ef292563452d","Type":"ContainerStarted","Data":"5cc335e9ecefcc099d405f041942f317c12fa1b82502abdde8140903d2577d36"}
Sep 14 10:49:21.825082 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.825061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t" event={"ID":"23069e7f-7713-490c-bcfb-f410f2bc723c","Type":"ContainerStarted","Data":"15a7a620e1fd64ff57c5fc59643bf47019fb557e6a8fffd175a3ecf7b91f1d43"}
Sep 14 10:49:21.826934 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.826909    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8xmsc" event={"ID":"3bfa1deb-57c8-400d-9176-6d688b7e54b0","Type":"ContainerStarted","Data":"a57783c066af02195abcc18472e6758dfa3821789d6711912e9df777fbb6ac9f"}
Sep 14 10:49:21.828615 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.828591    2576 generic.go:356] "Generic (PLEG): container finished" podID="fb46e686325d84730d02f0119973c3b3" containerID="3d0754db787c96056875b2ccb2c057c4605a7d3618d38ce650a4cacbe178f7ca" exitCode=0
Sep 14 10:49:21.828786 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.828757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal" event={"ID":"fb46e686325d84730d02f0119973c3b3","Type":"ContainerDied","Data":"3d0754db787c96056875b2ccb2c057c4605a7d3618d38ce650a4cacbe178f7ca"}
Sep 14 10:49:21.831941 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.831898    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gpp5n" podStartSLOduration=7.463817393 podStartE2EDuration="21.831883368s" totalImagesPullingTime="14.368065975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:21.831813067 +0000 UTC m=+21.812448572" watchObservedRunningTime="2026-09-14 10:49:21.831883368 +0000 UTC m=+21.812518882"
Sep 14 10:49:21.847564 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.847528    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vfwxz" podStartSLOduration=3.264175534 podStartE2EDuration="21.847514913s" totalImagesPullingTime="18.583339379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:21.847008472 +0000 UTC m=+21.827643980" watchObservedRunningTime="2026-09-14 10:49:21.847514913 +0000 UTC m=+21.828150414"
Sep 14 10:49:21.866098 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.866066    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8xmsc" podStartSLOduration=3.296331968 podStartE2EDuration="21.866053426s" totalImagesPullingTime="18.569721458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:21.865940511 +0000 UTC m=+21.846576027" watchObservedRunningTime="2026-09-14 10:49:21.866053426 +0000 UTC m=+21.846688930"
Sep 14 10:49:21.964079 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:21.964056    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:22.041443 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.041295    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:22.084826 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.084802    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 14 10:49:22.482410 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.482116    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-14T10:49:22.084822724Z","UUID":"e3067303-77b6-4346-8c09-e5db845f80d4","Handler":null,"Name":"","Endpoint":""}
Sep 14 10:49:22.484087 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.484043    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 14 10:49:22.484236 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.484101    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 14 10:49:22.555164 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.555137    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:22.555164 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.555156    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:22.555394 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.555139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:22.555394 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:22.555253    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:22.555394 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:22.555330    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:22.555544 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:22.555414    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:22.833511 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.833396    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-67krr" event={"ID":"6772377d-920d-484f-a6c1-ea0a42809be5","Type":"ContainerStarted","Data":"c2e1f4eafc6ca5904c2fa557063fafb5f27826d302ce20640439b31952bf0c53"}
Sep 14 10:49:22.835801 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.835770    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t" event={"ID":"23069e7f-7713-490c-bcfb-f410f2bc723c","Type":"ContainerStarted","Data":"c20bc30862e47cf67d07c865f7dd063063145619185565d022ac2340b1965f18"}
Sep 14 10:49:22.837916 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.837889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal" event={"ID":"fb46e686325d84730d02f0119973c3b3","Type":"ContainerStarted","Data":"9a5e02a315b644148a4d58f0ad72637bbb4b7ddf238784c5820b701522a99c6e"}
Sep 14 10:49:22.850068 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.850025    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-67krr" podStartSLOduration=4.184320161 podStartE2EDuration="22.850012802s" totalImagesPullingTime="18.665692641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:22.849787823 +0000 UTC m=+22.830423327" watchObservedRunningTime="2026-09-14 10:49:22.850012802 +0000 UTC m=+22.830648307"
Sep 14 10:49:22.866385 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:22.866332    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-201.ec2.internal" podStartSLOduration=21.866316014 podStartE2EDuration="21.866316014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:22.865727392 +0000 UTC m=+22.846362897" watchObservedRunningTime="2026-09-14 10:49:22.866316014 +0000 UTC m=+22.846951521"
Sep 14 10:49:23.073146 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:23.073111    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:23.179586 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:23.179559    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:23.401735 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:23.401708    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:23.504952 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:23.504916    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:23.844033 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:23.843991    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp" event={"ID":"94329106-294c-46df-85fb-69e9526d8513","Type":"ContainerStarted","Data":"46af3e2d8d839c44cb18e88e72600f7c5f15b1b36481bde6ce6e9b0dfef52c8c"}
Sep 14 10:49:23.846320 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:23.846292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t" event={"ID":"23069e7f-7713-490c-bcfb-f410f2bc723c","Type":"ContainerStarted","Data":"30281869f2c9a44dac59a6414b99420854d85d48d63b35459fd7ff5470a5a8cd"}
Sep 14 10:49:24.557327 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:24.557300    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:24.557327 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:24.557325    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:24.557679 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:24.557328    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:24.557679 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:24.557406    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:24.557679 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:24.557520    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:24.557679 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:24.557607    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:25.853779 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:25.853749    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp" event={"ID":"94329106-294c-46df-85fb-69e9526d8513","Type":"ContainerStarted","Data":"cb7a1016c7f27208e41e44392f1263c66eed1d22c93569852278439ba802a9aa"}
Sep 14 10:49:25.854048 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:25.853995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:25.868930 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:25.868907    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:25.881786 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:25.881578    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp" podStartSLOduration=7.267559834 podStartE2EDuration="25.881553467s" totalImagesPullingTime="18.613993633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:25.881437875 +0000 UTC m=+25.862073381" watchObservedRunningTime="2026-09-14 10:49:25.881553467 +0000 UTC m=+25.862188972"
Sep 14 10:49:25.882021 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:25.881991    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82k8t" podStartSLOduration=5.497070514 podStartE2EDuration="25.88198182s" totalImagesPullingTime="20.384911306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:23.87372611 +0000 UTC m=+23.854361616" watchObservedRunningTime="2026-09-14 10:49:25.88198182 +0000 UTC m=+25.862617325"
Sep 14 10:49:26.050294 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:26.050264    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:26.050877 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:26.050858    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:26.193177 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:26.193137    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:26.554288 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:26.554254    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:26.554500 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:26.554295    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:26.554500 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:26.554260    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:26.554500 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:26.554368    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:26.554500 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:26.554427    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:26.554500 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:26.554482    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:26.857380 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:26.857301    2576 generic.go:356] "Generic (PLEG): container finished" podID="0217b90e-9602-4158-85d4-c39a2e2cb2d2" containerID="a96a2745486edda2dea65c8604a63bb688ee042a91249f7c66dcab6ac3f5c030" exitCode=0
Sep 14 10:49:26.857748 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:26.857386    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9rc9" event={"ID":"0217b90e-9602-4158-85d4-c39a2e2cb2d2","Type":"ContainerDied","Data":"a96a2745486edda2dea65c8604a63bb688ee042a91249f7c66dcab6ac3f5c030"}
Sep 14 10:49:26.857748 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:26.857460    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 14 10:49:26.857820 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:26.857808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:26.872721 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:26.872699    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:27.641429 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:27.641397    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zmdnx"]
Sep 14 10:49:27.641591 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:27.641576    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:27.641737 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:27.641711    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:27.645185 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:27.645156    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mxgs8"]
Sep 14 10:49:27.645327 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:27.645262    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:27.645401 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:27.645364    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:27.649334 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:27.649313    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7j6cf"]
Sep 14 10:49:27.649418 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:27.649397    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:27.649480 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:27.649463    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:27.859742 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:27.859713    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 14 10:49:27.912495 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:27.912469    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:28.633331 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:28.633298    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:28.633504 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:28.633438    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 14 10:49:28.634204 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:28.634180    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gpp5n"
Sep 14 10:49:28.721090 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:28.721053    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:28.863976 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:28.863944    2576 generic.go:356] "Generic (PLEG): container finished" podID="0217b90e-9602-4158-85d4-c39a2e2cb2d2" containerID="bf183f1d637d33a3c76fc6fef53c938832280697961d72edfeeb3f37bd3c5b23" exitCode=0
Sep 14 10:49:28.864373 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:28.863977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9rc9" event={"ID":"0217b90e-9602-4158-85d4-c39a2e2cb2d2","Type":"ContainerDied","Data":"bf183f1d637d33a3c76fc6fef53c938832280697961d72edfeeb3f37bd3c5b23"}
Sep 14 10:49:29.554641 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:29.554422    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:29.554755 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:29.554440    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:29.554815 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:29.554765    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:29.554815 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:29.554445    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:29.554901 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:29.554847    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:29.554901 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:29.554877    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:29.868297 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:29.868267    2576 generic.go:356] "Generic (PLEG): container finished" podID="0217b90e-9602-4158-85d4-c39a2e2cb2d2" containerID="cbda5260aca9eca76379666a510214c0092513392938a2e0db50ac7580a77e90" exitCode=0
Sep 14 10:49:29.868680 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:29.868356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9rc9" event={"ID":"0217b90e-9602-4158-85d4-c39a2e2cb2d2","Type":"ContainerDied","Data":"cbda5260aca9eca76379666a510214c0092513392938a2e0db50ac7580a77e90"}
Sep 14 10:49:31.554858 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:31.554830    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:31.555348 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:31.554830    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:31.555348 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:31.554959    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmdnx" podUID="32bf6cd3-707a-4ad0-9294-9198e4a4765f"
Sep 14 10:49:31.555348 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:31.554833    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:31.555348 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:31.555036    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxgs8" podUID="2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08"
Sep 14 10:49:31.555348 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:31.555092    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j6cf" podUID="f82376a7-f339-4946-b4ce-ef59eff7cf2b"
Sep 14 10:49:33.173678 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.173627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:33.174084 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:33.173762    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:33.174084 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:33.173837    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret podName:32bf6cd3-707a-4ad0-9294-9198e4a4765f nodeName:}" failed. No retries permitted until 2026-09-14 10:50:05.173819731 +0000 UTC m=+65.154455219 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret") pod "global-pull-secret-syncer-zmdnx" (UID: "32bf6cd3-707a-4ad0-9294-9198e4a4765f") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:49:33.274210 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.274177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:33.274381 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.274238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7h8\" (UniqueName: \"kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8\") pod \"network-check-target-7j6cf\" (UID: \"f82376a7-f339-4946-b4ce-ef59eff7cf2b\") " pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:33.274381 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:33.274357    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:33.274381 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:33.274373    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:49:33.274545 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:33.274392    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:49:33.274545 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:33.274404    2576 projected.go:196] Error preparing data for projected volume kube-api-access-bg7h8 for pod openshift-network-diagnostics/network-check-target-7j6cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:33.274545 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:33.274430    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs podName:2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08 nodeName:}" failed. No retries permitted until 2026-09-14 10:50:05.274411998 +0000 UTC m=+65.255047494 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs") pod "network-metrics-daemon-mxgs8" (UID: "2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:49:33.274545 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:33.274446    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8 podName:f82376a7-f339-4946-b4ce-ef59eff7cf2b nodeName:}" failed. No retries permitted until 2026-09-14 10:50:05.274439658 +0000 UTC m=+65.255075142 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bg7h8" (UniqueName: "kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8") pod "network-check-target-7j6cf" (UID: "f82376a7-f339-4946-b4ce-ef59eff7cf2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:49:33.281464 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.281441    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-201.ec2.internal" event="NodeReady"
Sep 14 10:49:33.281580 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.281574    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 14 10:49:33.333499 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.333466    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bc6ks"]
Sep 14 10:49:33.364115 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.364089    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nspvt"]
Sep 14 10:49:33.364255 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.364225    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.366576 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.366553    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 14 10:49:33.366787 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.366769    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qfwcj\""
Sep 14 10:49:33.367114 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.367095    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 14 10:49:33.379823 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.379799    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bc6ks"]
Sep 14 10:49:33.379929 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.379893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nspvt"
Sep 14 10:49:33.379929 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.379924    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nspvt"]
Sep 14 10:49:33.383002 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.382984    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 14 10:49:33.383124 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.383026    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 14 10:49:33.383271 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.383255    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5cjtt\""
Sep 14 10:49:33.383344 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.383286    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 14 10:49:33.475615 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.475548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/863a44cf-93fa-49b1-a3a5-4a6986517c3c-tmp-dir\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.475615 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.475605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.475828 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.475698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rs6d\" (UniqueName: \"kubernetes.io/projected/863a44cf-93fa-49b1-a3a5-4a6986517c3c-kube-api-access-9rs6d\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.475828 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.475722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc4843e8-0d13-489e-9138-cf85eb6a4678-cert\") pod \"ingress-canary-nspvt\" (UID: \"bc4843e8-0d13-489e-9138-cf85eb6a4678\") " pod="openshift-ingress-canary/ingress-canary-nspvt"
Sep 14 10:49:33.475828 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.475763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/863a44cf-93fa-49b1-a3a5-4a6986517c3c-config-volume\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.475828 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.475779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tflr6\" (UniqueName: \"kubernetes.io/projected/bc4843e8-0d13-489e-9138-cf85eb6a4678-kube-api-access-tflr6\") pod \"ingress-canary-nspvt\" (UID: \"bc4843e8-0d13-489e-9138-cf85eb6a4678\") " pod="openshift-ingress-canary/ingress-canary-nspvt"
Sep 14 10:49:33.495961 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.495929    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:33.554908 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.554885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:49:33.555054 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.554885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:49:33.555193 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.554890    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:49:33.557683 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.557661    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 14 10:49:33.557808 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.557663    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 14 10:49:33.557808 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.557740    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fkf2p\""
Sep 14 10:49:33.557932 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.557820    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bckh8\""
Sep 14 10:49:33.557932 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.557921    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 10:49:33.558036 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.557956    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 10:49:33.576017 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.575997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/863a44cf-93fa-49b1-a3a5-4a6986517c3c-tmp-dir\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.576129 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.576055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.576129 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.576095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rs6d\" (UniqueName: \"kubernetes.io/projected/863a44cf-93fa-49b1-a3a5-4a6986517c3c-kube-api-access-9rs6d\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.576254 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:33.576233    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:49:33.576319 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:33.576307    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls podName:863a44cf-93fa-49b1-a3a5-4a6986517c3c nodeName:}" failed. No retries permitted until 2026-09-14 10:49:34.076286251 +0000 UTC m=+34.056921735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls") pod "dns-default-bc6ks" (UID: "863a44cf-93fa-49b1-a3a5-4a6986517c3c") : secret "dns-default-metrics-tls" not found
Sep 14 10:49:33.576443 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.576424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc4843e8-0d13-489e-9138-cf85eb6a4678-cert\") pod \"ingress-canary-nspvt\" (UID: \"bc4843e8-0d13-489e-9138-cf85eb6a4678\") " pod="openshift-ingress-canary/ingress-canary-nspvt"
Sep 14 10:49:33.576508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.576465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/863a44cf-93fa-49b1-a3a5-4a6986517c3c-config-volume\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.576508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.576488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tflr6\" (UniqueName: \"kubernetes.io/projected/bc4843e8-0d13-489e-9138-cf85eb6a4678-kube-api-access-tflr6\") pod \"ingress-canary-nspvt\" (UID: \"bc4843e8-0d13-489e-9138-cf85eb6a4678\") " pod="openshift-ingress-canary/ingress-canary-nspvt"
Sep 14 10:49:33.576605 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.576431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/863a44cf-93fa-49b1-a3a5-4a6986517c3c-tmp-dir\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.577055 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.577035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/863a44cf-93fa-49b1-a3a5-4a6986517c3c-config-volume\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.581132 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.581109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc4843e8-0d13-489e-9138-cf85eb6a4678-cert\") pod \"ingress-canary-nspvt\" (UID: \"bc4843e8-0d13-489e-9138-cf85eb6a4678\") " pod="openshift-ingress-canary/ingress-canary-nspvt"
Sep 14 10:49:33.585441 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.585421    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tflr6\" (UniqueName: \"kubernetes.io/projected/bc4843e8-0d13-489e-9138-cf85eb6a4678-kube-api-access-tflr6\") pod \"ingress-canary-nspvt\" (UID: \"bc4843e8-0d13-489e-9138-cf85eb6a4678\") " pod="openshift-ingress-canary/ingress-canary-nspvt"
Sep 14 10:49:33.585441 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.585427    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rs6d\" (UniqueName: \"kubernetes.io/projected/863a44cf-93fa-49b1-a3a5-4a6986517c3c-kube-api-access-9rs6d\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:33.596943 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.596920    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:33.689139 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:33.689110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nspvt"
Sep 14 10:49:34.080888 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:34.080842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:34.081354 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:34.081325    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:49:34.081499 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:34.081420    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls podName:863a44cf-93fa-49b1-a3a5-4a6986517c3c nodeName:}" failed. No retries permitted until 2026-09-14 10:49:35.081386935 +0000 UTC m=+35.062022432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls") pod "dns-default-bc6ks" (UID: "863a44cf-93fa-49b1-a3a5-4a6986517c3c") : secret "dns-default-metrics-tls" not found
Sep 14 10:49:34.563947 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:34.563741    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nspvt"]
Sep 14 10:49:34.567912 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:34.567890    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4843e8_0d13_489e_9138_cf85eb6a4678.slice/crio-9074247e57b1f15940938260b51c7c1721ed75c99629e7f2fb62072c1ba78007 WatchSource:0}: Error finding container 9074247e57b1f15940938260b51c7c1721ed75c99629e7f2fb62072c1ba78007: Status 404 returned error can't find the container with id 9074247e57b1f15940938260b51c7c1721ed75c99629e7f2fb62072c1ba78007
Sep 14 10:49:34.881593 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:34.881540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nspvt" event={"ID":"bc4843e8-0d13-489e-9138-cf85eb6a4678","Type":"ContainerStarted","Data":"9074247e57b1f15940938260b51c7c1721ed75c99629e7f2fb62072c1ba78007"}
Sep 14 10:49:34.884257 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:34.884235    2576 generic.go:356] "Generic (PLEG): container finished" podID="0217b90e-9602-4158-85d4-c39a2e2cb2d2" containerID="72da71f68f5bacb292610bc16a2e0f4c625f665642d477326d77f220729c3149" exitCode=0
Sep 14 10:49:34.884348 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:34.884268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9rc9" event={"ID":"0217b90e-9602-4158-85d4-c39a2e2cb2d2","Type":"ContainerDied","Data":"72da71f68f5bacb292610bc16a2e0f4c625f665642d477326d77f220729c3149"}
Sep 14 10:49:35.089769 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:35.089747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:35.089917 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:35.089900    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:49:35.089984 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:35.089974    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls podName:863a44cf-93fa-49b1-a3a5-4a6986517c3c nodeName:}" failed. No retries permitted until 2026-09-14 10:49:37.089951681 +0000 UTC m=+37.070587180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls") pod "dns-default-bc6ks" (UID: "863a44cf-93fa-49b1-a3a5-4a6986517c3c") : secret "dns-default-metrics-tls" not found
Sep 14 10:49:35.890665 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:35.890612    2576 generic.go:356] "Generic (PLEG): container finished" podID="0217b90e-9602-4158-85d4-c39a2e2cb2d2" containerID="068eb6ee3d94a18b9be646efeff639cb82be2c790e048a734ed4b0f1040005f4" exitCode=0
Sep 14 10:49:35.891367 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:35.890692    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9rc9" event={"ID":"0217b90e-9602-4158-85d4-c39a2e2cb2d2","Type":"ContainerDied","Data":"068eb6ee3d94a18b9be646efeff639cb82be2c790e048a734ed4b0f1040005f4"}
Sep 14 10:49:36.897710 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:36.897673    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9rc9" event={"ID":"0217b90e-9602-4158-85d4-c39a2e2cb2d2","Type":"ContainerStarted","Data":"bec7d184a6b3702a99cd001c7ba8e3aaca764b8fa2756edea633fd9c46c3614a"}
Sep 14 10:49:36.920298 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:36.920254    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p9rc9" podStartSLOduration=8.002309624 podStartE2EDuration="36.920241191s" totalImagesPullingTime="28.917931567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:36.919911633 +0000 UTC m=+36.900547139" watchObservedRunningTime="2026-09-14 10:49:36.920241191 +0000 UTC m=+36.900876696"
Sep 14 10:49:37.042511 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:37.042482    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:37.104195 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:37.104161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:37.104361 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:37.104289    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:49:37.104361 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:37.104352    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls podName:863a44cf-93fa-49b1-a3a5-4a6986517c3c nodeName:}" failed. No retries permitted until 2026-09-14 10:49:41.104337045 +0000 UTC m=+41.084972550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls") pod "dns-default-bc6ks" (UID: "863a44cf-93fa-49b1-a3a5-4a6986517c3c") : secret "dns-default-metrics-tls" not found
Sep 14 10:49:37.106900 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:37.106867    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:37.901817 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:37.901497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nspvt" event={"ID":"bc4843e8-0d13-489e-9138-cf85eb6a4678","Type":"ContainerStarted","Data":"5d332eb3776e9900377b6e162da2ee3aecc26f95471f82c9a1de4fa4f3dc27bb"}
Sep 14 10:49:37.918558 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:37.918516    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nspvt" podStartSLOduration=1.957995039 podStartE2EDuration="4.918501633s" totalImagesPullingTime="2.960506594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:37.91793732 +0000 UTC m=+37.898572826" watchObservedRunningTime="2026-09-14 10:49:37.918501633 +0000 UTC m=+37.899137137"
Sep 14 10:49:38.861643 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:38.861612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:38.920387 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:38.920363    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:41.132169 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:41.132127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:41.132559 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:41.132259    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:49:41.132559 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:41.132310    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls podName:863a44cf-93fa-49b1-a3a5-4a6986517c3c nodeName:}" failed. No retries permitted until 2026-09-14 10:49:49.132297256 +0000 UTC m=+49.112932739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls") pod "dns-default-bc6ks" (UID: "863a44cf-93fa-49b1-a3a5-4a6986517c3c") : secret "dns-default-metrics-tls" not found
Sep 14 10:49:43.962909 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.962880    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-nk57s"]
Sep 14 10:49:43.981767 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.981743    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c77589b76-877mb"]
Sep 14 10:49:43.981916 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.981865    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-nk57s"
Sep 14 10:49:43.984619 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.984596    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qfpnd\""
Sep 14 10:49:43.996230 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.996207    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"]
Sep 14 10:49:43.996357 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.996326    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:43.998539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.998521    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 14 10:49:43.998765 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.998745    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 14 10:49:43.998859 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.998804    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b9s6k\""
Sep 14 10:49:43.998859 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.998851    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 14 10:49:43.998968 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.998858    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 14 10:49:43.998968 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.998806    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 14 10:49:43.998968 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:43.998806    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 14 10:49:44.006273 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.006254    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-nk57s"]
Sep 14 10:49:44.006373 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.006281    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"]
Sep 14 10:49:44.006373 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.006295    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c77589b76-877mb"]
Sep 14 10:49:44.006476 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.006384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"
Sep 14 10:49:44.009011 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.008988    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 14 10:49:44.009116 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.009054    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tc7kn\""
Sep 14 10:49:44.009116 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.009078    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 14 10:49:44.009229 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.009194    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 14 10:49:44.009347 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.009330    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:49:44.147536 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.147505    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:44.154564 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.154540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b03ca59-a7b8-462d-9754-65461f16518e-serving-cert\") pod \"service-ca-operator-cf7c776b7-tr7kd\" (UID: \"2b03ca59-a7b8-462d-9754-65461f16518e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"
Sep 14 10:49:44.154710 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.154571    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrqh4\" (UniqueName: \"kubernetes.io/projected/2b03ca59-a7b8-462d-9754-65461f16518e-kube-api-access-mrqh4\") pod \"service-ca-operator-cf7c776b7-tr7kd\" (UID: \"2b03ca59-a7b8-462d-9754-65461f16518e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"
Sep 14 10:49:44.154710 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.154631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.154710 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.154677    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-default-certificate\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.154710 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.154702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b03ca59-a7b8-462d-9754-65461f16518e-config\") pod \"service-ca-operator-cf7c776b7-tr7kd\" (UID: \"2b03ca59-a7b8-462d-9754-65461f16518e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"
Sep 14 10:49:44.154837 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.154726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl577\" (UniqueName: \"kubernetes.io/projected/6d9f801b-600f-42a8-9d5d-445a14046fee-kube-api-access-dl577\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.154837 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.154748    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ljw2\" (UniqueName: \"kubernetes.io/projected/705e6123-b5e0-417b-a091-24adf0a1eae3-kube-api-access-4ljw2\") pod \"network-check-source-6f8b768455-nk57s\" (UID: \"705e6123-b5e0-417b-a091-24adf0a1eae3\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-nk57s"
Sep 14 10:49:44.154837 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.154769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.154926 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.154839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-stats-auth\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.211250 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.211205    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:44.255203 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.255169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.255398 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.255214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-stats-auth\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.255398 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.255230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b03ca59-a7b8-462d-9754-65461f16518e-serving-cert\") pod \"service-ca-operator-cf7c776b7-tr7kd\" (UID: \"2b03ca59-a7b8-462d-9754-65461f16518e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"
Sep 14 10:49:44.255398 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.255246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqh4\" (UniqueName: \"kubernetes.io/projected/2b03ca59-a7b8-462d-9754-65461f16518e-kube-api-access-mrqh4\") pod \"service-ca-operator-cf7c776b7-tr7kd\" (UID: \"2b03ca59-a7b8-462d-9754-65461f16518e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"
Sep 14 10:49:44.255398 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.255353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.255398 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:44.255389    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:49:44.7553664 +0000 UTC m=+44.736001887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : configmap references non-existent config key: service-ca.crt
Sep 14 10:49:44.255695 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:44.255433    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:49:44.255695 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.255440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-default-certificate\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.255695 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:44.255483    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:49:44.755467182 +0000 UTC m=+44.736102679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : secret "router-metrics-certs-default" not found
Sep 14 10:49:44.255695 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.255513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b03ca59-a7b8-462d-9754-65461f16518e-config\") pod \"service-ca-operator-cf7c776b7-tr7kd\" (UID: \"2b03ca59-a7b8-462d-9754-65461f16518e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"
Sep 14 10:49:44.255695 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.255562    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl577\" (UniqueName: \"kubernetes.io/projected/6d9f801b-600f-42a8-9d5d-445a14046fee-kube-api-access-dl577\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.255695 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.255595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ljw2\" (UniqueName: \"kubernetes.io/projected/705e6123-b5e0-417b-a091-24adf0a1eae3-kube-api-access-4ljw2\") pod \"network-check-source-6f8b768455-nk57s\" (UID: \"705e6123-b5e0-417b-a091-24adf0a1eae3\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-nk57s"
Sep 14 10:49:44.256179 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.256132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b03ca59-a7b8-462d-9754-65461f16518e-config\") pod \"service-ca-operator-cf7c776b7-tr7kd\" (UID: \"2b03ca59-a7b8-462d-9754-65461f16518e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"
Sep 14 10:49:44.258810 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.258788    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b03ca59-a7b8-462d-9754-65461f16518e-serving-cert\") pod \"service-ca-operator-cf7c776b7-tr7kd\" (UID: \"2b03ca59-a7b8-462d-9754-65461f16518e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"
Sep 14 10:49:44.258930 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.258910    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-stats-auth\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.258989 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.258968    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-default-certificate\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.264001 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.263981    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ljw2\" (UniqueName: \"kubernetes.io/projected/705e6123-b5e0-417b-a091-24adf0a1eae3-kube-api-access-4ljw2\") pod \"network-check-source-6f8b768455-nk57s\" (UID: \"705e6123-b5e0-417b-a091-24adf0a1eae3\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-nk57s"
Sep 14 10:49:44.264290 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.264269    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrqh4\" (UniqueName: \"kubernetes.io/projected/2b03ca59-a7b8-462d-9754-65461f16518e-kube-api-access-mrqh4\") pod \"service-ca-operator-cf7c776b7-tr7kd\" (UID: \"2b03ca59-a7b8-462d-9754-65461f16518e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"
Sep 14 10:49:44.264341 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.264269    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl577\" (UniqueName: \"kubernetes.io/projected/6d9f801b-600f-42a8-9d5d-445a14046fee-kube-api-access-dl577\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.297827 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.297794    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-nk57s"
Sep 14 10:49:44.314104 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.314080    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"
Sep 14 10:49:44.605977 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.605905    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-nk57s"]
Sep 14 10:49:44.608868 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:44.608843    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705e6123_b5e0_417b_a091_24adf0a1eae3.slice/crio-11411dadfe4f76cca388e05ad705fbc1839d3fcf9637d88d5865b60024c37fd8 WatchSource:0}: Error finding container 11411dadfe4f76cca388e05ad705fbc1839d3fcf9637d88d5865b60024c37fd8: Status 404 returned error can't find the container with id 11411dadfe4f76cca388e05ad705fbc1839d3fcf9637d88d5865b60024c37fd8
Sep 14 10:49:44.633398 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.633374    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd"]
Sep 14 10:49:44.636533 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:44.636507    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b03ca59_a7b8_462d_9754_65461f16518e.slice/crio-6b70f149f7df7b269ce861a1e47a71d38d1a00c8ae3add8d3f19a74b330268e2 WatchSource:0}: Error finding container 6b70f149f7df7b269ce861a1e47a71d38d1a00c8ae3add8d3f19a74b330268e2: Status 404 returned error can't find the container with id 6b70f149f7df7b269ce861a1e47a71d38d1a00c8ae3add8d3f19a74b330268e2
Sep 14 10:49:44.758943 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.758903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.759140 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.758966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:44.759140 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:44.759119    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:49:45.759097604 +0000 UTC m=+45.739733104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : configmap references non-existent config key: service-ca.crt
Sep 14 10:49:44.759253 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:44.759165    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:49:44.759253 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:44.759214    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:49:45.759202199 +0000 UTC m=+45.739837682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : secret "router-metrics-certs-default" not found
Sep 14 10:49:44.918835 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.918741    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd" event={"ID":"2b03ca59-a7b8-462d-9754-65461f16518e","Type":"ContainerStarted","Data":"6b70f149f7df7b269ce861a1e47a71d38d1a00c8ae3add8d3f19a74b330268e2"}
Sep 14 10:49:44.919818 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:44.919797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-nk57s" event={"ID":"705e6123-b5e0-417b-a091-24adf0a1eae3","Type":"ContainerStarted","Data":"11411dadfe4f76cca388e05ad705fbc1839d3fcf9637d88d5865b60024c37fd8"}
Sep 14 10:49:45.765805 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:45.765762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:45.766193 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:45.765858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:45.766193 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:45.765966    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:49:47.765943061 +0000 UTC m=+47.746578564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : configmap references non-existent config key: service-ca.crt
Sep 14 10:49:45.766193 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:45.765993    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:49:45.766193 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:45.766042    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:49:47.76602766 +0000 UTC m=+47.746663148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : secret "router-metrics-certs-default" not found
Sep 14 10:49:46.324012 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:46.323973    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:46.424116 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:46.424083    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:47.310608 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:47.310576    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:47.552122 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:47.552014    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:47.782989 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:47.782952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:47.783174 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:47.783045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:47.783174 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:47.783126    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:49:47.783298 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:47.783197    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:49:51.783182212 +0000 UTC m=+51.763817695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : configmap references non-existent config key: service-ca.crt
Sep 14 10:49:47.783298 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:47.783216    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:49:51.783209536 +0000 UTC m=+51.763845018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : secret "router-metrics-certs-default" not found
Sep 14 10:49:48.436056 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.436021    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p5tmq"]
Sep 14 10:49:48.455438 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.455410    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p5tmq"]
Sep 14 10:49:48.455554 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.455523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.457761 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.457741    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 14 10:49:48.457892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.457782    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 14 10:49:48.458316 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.458103    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 14 10:49:48.458316 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.458138    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6n6bp\""
Sep 14 10:49:48.458498 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.458477    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 14 10:49:48.590609 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.590578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.590767 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.590674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.590767 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.590704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf4nx\" (UniqueName: \"kubernetes.io/projected/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-api-access-nf4nx\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.590767 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.590720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17df435e-cf4f-4b0b-8731-6a4757e6f0db-data-volume\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.590767 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.590741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17df435e-cf4f-4b0b-8731-6a4757e6f0db-crio-socket\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.691575 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.691508    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17df435e-cf4f-4b0b-8731-6a4757e6f0db-crio-socket\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.691575 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.691553    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.691786 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.691620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.691786 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.691675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf4nx\" (UniqueName: \"kubernetes.io/projected/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-api-access-nf4nx\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.691786 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.691701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17df435e-cf4f-4b0b-8731-6a4757e6f0db-data-volume\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.691786 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:48.691736    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 10:49:48.691786 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:48.691768    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 10:49:48.691786 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.691778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17df435e-cf4f-4b0b-8731-6a4757e6f0db-crio-socket\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.692060 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:48.691824    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm podName:17df435e-cf4f-4b0b-8731-6a4757e6f0db nodeName:}" failed. No retries permitted until 2026-09-14 10:49:49.191804715 +0000 UTC m=+49.172440214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p5tmq" (UID: "17df435e-cf4f-4b0b-8731-6a4757e6f0db") : configmap "kube-rbac-proxy" not found
Sep 14 10:49:48.692060 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:48.691843    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls podName:17df435e-cf4f-4b0b-8731-6a4757e6f0db nodeName:}" failed. No retries permitted until 2026-09-14 10:49:49.191833869 +0000 UTC m=+49.172469353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p5tmq" (UID: "17df435e-cf4f-4b0b-8731-6a4757e6f0db") : secret "insights-runtime-extractor-tls" not found
Sep 14 10:49:48.692060 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.691977    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17df435e-cf4f-4b0b-8731-6a4757e6f0db-data-volume\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.704480 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.701723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf4nx\" (UniqueName: \"kubernetes.io/projected/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-api-access-nf4nx\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:48.846760 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.846727    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:48.933197 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.933163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd" event={"ID":"2b03ca59-a7b8-462d-9754-65461f16518e","Type":"ContainerStarted","Data":"5ef1c0bb757de4aaf4eed7b9688263d10fd5a78065423f4df67f6cf0ee38f459"}
Sep 14 10:49:48.934744 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.934718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-nk57s" event={"ID":"705e6123-b5e0-417b-a091-24adf0a1eae3","Type":"ContainerStarted","Data":"e646dcf7b306169d91f4d9d3d5555a7338b5494c6c35dd809f46ac32341e1091"}
Sep 14 10:49:48.949334 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.949247    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd" podStartSLOduration=1.8796818800000001 podStartE2EDuration="5.949227836s" totalImagesPullingTime="4.069545956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:48.948281823 +0000 UTC m=+48.928917327" watchObservedRunningTime="2026-09-14 10:49:48.949227836 +0000 UTC m=+48.929863342"
Sep 14 10:49:48.962812 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.962764    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-nk57s" podStartSLOduration=1.85618647 podStartE2EDuration="5.962751349s" totalImagesPullingTime="4.106564879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:48.96266713 +0000 UTC m=+48.943302645" watchObservedRunningTime="2026-09-14 10:49:48.962751349 +0000 UTC m=+48.943386854"
Sep 14 10:49:48.966762 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:48.966737    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:49.195909 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.195855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:49.196098 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:49.196029    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 10:49:49.196098 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.196049    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:49:49.196211 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:49.196104    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls podName:17df435e-cf4f-4b0b-8731-6a4757e6f0db nodeName:}" failed. No retries permitted until 2026-09-14 10:49:50.196083794 +0000 UTC m=+50.176719284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p5tmq" (UID: "17df435e-cf4f-4b0b-8731-6a4757e6f0db") : secret "insights-runtime-extractor-tls" not found
Sep 14 10:49:49.196211 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.196127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:49.196211 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:49.196159    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:49:49.196211 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:49.196199    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls podName:863a44cf-93fa-49b1-a3a5-4a6986517c3c nodeName:}" failed. No retries permitted until 2026-09-14 10:50:05.196185992 +0000 UTC m=+65.176821474 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls") pod "dns-default-bc6ks" (UID: "863a44cf-93fa-49b1-a3a5-4a6986517c3c") : secret "dns-default-metrics-tls" not found
Sep 14 10:49:49.196415 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:49.196221    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 10:49:49.196415 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:49.196254    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm podName:17df435e-cf4f-4b0b-8731-6a4757e6f0db nodeName:}" failed. No retries permitted until 2026-09-14 10:49:50.196243001 +0000 UTC m=+50.176878488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p5tmq" (UID: "17df435e-cf4f-4b0b-8731-6a4757e6f0db") : configmap "kube-rbac-proxy" not found
Sep 14 10:49:49.502456 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.502423    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2"]
Sep 14 10:49:49.523678 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.523637    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2"]
Sep 14 10:49:49.523829 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.523737    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2"
Sep 14 10:49:49.525926 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.525903    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 14 10:49:49.525926 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.525918    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nr8vx\""
Sep 14 10:49:49.526812 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.526794    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 14 10:49:49.545150 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.545124    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:49.601432 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.601398    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:49.700007 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.699965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4msrb\" (UniqueName: \"kubernetes.io/projected/dfab5228-0991-4a92-a5c8-c09ffa676ae4-kube-api-access-4msrb\") pod \"migrator-8b4d697c5-qgtp2\" (UID: \"dfab5228-0991-4a92-a5c8-c09ffa676ae4\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2"
Sep 14 10:49:49.793196 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.793119    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:49.801284 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.801261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4msrb\" (UniqueName: \"kubernetes.io/projected/dfab5228-0991-4a92-a5c8-c09ffa676ae4-kube-api-access-4msrb\") pod \"migrator-8b4d697c5-qgtp2\" (UID: \"dfab5228-0991-4a92-a5c8-c09ffa676ae4\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2"
Sep 14 10:49:49.809162 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.809133    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4msrb\" (UniqueName: \"kubernetes.io/projected/dfab5228-0991-4a92-a5c8-c09ffa676ae4-kube-api-access-4msrb\") pod \"migrator-8b4d697c5-qgtp2\" (UID: \"dfab5228-0991-4a92-a5c8-c09ffa676ae4\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2"
Sep 14 10:49:49.834062 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.834039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2"
Sep 14 10:49:49.855821 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:49.855794    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:50.121288 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:50.121206    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2"]
Sep 14 10:49:50.124372 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:49:50.124344    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfab5228_0991_4a92_a5c8_c09ffa676ae4.slice/crio-946dc40823a09cf8c1656bb1a898d72e4454182945f9405a1132f0a264c141de WatchSource:0}: Error finding container 946dc40823a09cf8c1656bb1a898d72e4454182945f9405a1132f0a264c141de: Status 404 returned error can't find the container with id 946dc40823a09cf8c1656bb1a898d72e4454182945f9405a1132f0a264c141de
Sep 14 10:49:50.205292 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:50.205257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:50.205452 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:50.205322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:50.205452 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:50.205384    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 10:49:50.205452 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:50.205411    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 10:49:50.205452 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:50.205451    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm podName:17df435e-cf4f-4b0b-8731-6a4757e6f0db nodeName:}" failed. No retries permitted until 2026-09-14 10:49:52.205435719 +0000 UTC m=+52.186071205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p5tmq" (UID: "17df435e-cf4f-4b0b-8731-6a4757e6f0db") : configmap "kube-rbac-proxy" not found
Sep 14 10:49:50.205617 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:50.205466    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls podName:17df435e-cf4f-4b0b-8731-6a4757e6f0db nodeName:}" failed. No retries permitted until 2026-09-14 10:49:52.20546063 +0000 UTC m=+52.186096113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p5tmq" (UID: "17df435e-cf4f-4b0b-8731-6a4757e6f0db") : secret "insights-runtime-extractor-tls" not found
Sep 14 10:49:50.212611 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:50.212587    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:50.313552 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:50.313514    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:50.496137 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:50.496110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:50.598476 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:50.598447    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:50.646573 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:50.646543    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vfwxz_14abef7b-782a-46a1-9554-ef292563452d/dns-node-resolver/0.log"
Sep 14 10:49:50.940839 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:50.940766    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2" event={"ID":"dfab5228-0991-4a92-a5c8-c09ffa676ae4","Type":"ContainerStarted","Data":"946dc40823a09cf8c1656bb1a898d72e4454182945f9405a1132f0a264c141de"}
Sep 14 10:49:51.247438 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:51.247415    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8xmsc_3bfa1deb-57c8-400d-9176-6d688b7e54b0/node-ca/0.log"
Sep 14 10:49:51.818922 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:51.818886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:51.819271 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:51.818965    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:51.819271 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:51.819042    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:49:59.819025049 +0000 UTC m=+59.799660532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : configmap references non-existent config key: service-ca.crt
Sep 14 10:49:51.819271 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:51.819105    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:49:51.819271 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:51.819157    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:49:59.819145437 +0000 UTC m=+59.799780925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : secret "router-metrics-certs-default" not found
Sep 14 10:49:51.945380 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:51.945346    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2" event={"ID":"dfab5228-0991-4a92-a5c8-c09ffa676ae4","Type":"ContainerStarted","Data":"a50eaa6db7decdf5112e53d3b6938023f8e516dc4df85bd1d265c007fa6a6d5f"}
Sep 14 10:49:51.945572 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:51.945436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2" event={"ID":"dfab5228-0991-4a92-a5c8-c09ffa676ae4","Type":"ContainerStarted","Data":"297c698adb92550ce1acaa0ae36c877ae3b7c559c08f33ee0abc743ab8c0f396"}
Sep 14 10:49:51.961227 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:51.961177    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-qgtp2" podStartSLOduration=1.941768288 podStartE2EDuration="2.961163421s" totalImagesPullingTime="1.019395133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:51.960040839 +0000 UTC m=+51.940676357" watchObservedRunningTime="2026-09-14 10:49:51.961163421 +0000 UTC m=+51.941798925"
Sep 14 10:49:52.043410 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:52.043376    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:52.146893 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:52.146810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:52.221306 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:52.221277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:52.221413 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:52.221352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:52.221451 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:52.221431    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 10:49:52.221504 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:52.221493    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls podName:17df435e-cf4f-4b0b-8731-6a4757e6f0db nodeName:}" failed. No retries permitted until 2026-09-14 10:49:56.221474685 +0000 UTC m=+56.202110169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p5tmq" (UID: "17df435e-cf4f-4b0b-8731-6a4757e6f0db") : secret "insights-runtime-extractor-tls" not found
Sep 14 10:49:52.221556 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:52.221430    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 10:49:52.221591 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:52.221560    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm podName:17df435e-cf4f-4b0b-8731-6a4757e6f0db nodeName:}" failed. No retries permitted until 2026-09-14 10:49:56.221545242 +0000 UTC m=+56.202180725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p5tmq" (UID: "17df435e-cf4f-4b0b-8731-6a4757e6f0db") : configmap "kube-rbac-proxy" not found
Sep 14 10:49:52.244715 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:52.244690    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:52.246342 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:52.246324    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nspvt_bc4843e8-0d13-489e-9138-cf85eb6a4678/serve-healthcheck-canary/0.log"
Sep 14 10:49:53.350464 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:53.350430    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:56.240534 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:56.240498    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:56.253697 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:56.253671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:56.253818 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:56.253775    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 10:49:56.253857 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:56.253815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:49:56.253857 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:56.253827    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm podName:17df435e-cf4f-4b0b-8731-6a4757e6f0db nodeName:}" failed. No retries permitted until 2026-09-14 10:50:04.253813864 +0000 UTC m=+64.234449346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p5tmq" (UID: "17df435e-cf4f-4b0b-8731-6a4757e6f0db") : configmap "kube-rbac-proxy" not found
Sep 14 10:49:56.253930 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:56.253903    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 10:49:56.253963 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:56.253955    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls podName:17df435e-cf4f-4b0b-8731-6a4757e6f0db nodeName:}" failed. No retries permitted until 2026-09-14 10:50:04.25394113 +0000 UTC m=+64.234576618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p5tmq" (UID: "17df435e-cf4f-4b0b-8731-6a4757e6f0db") : secret "insights-runtime-extractor-tls" not found
Sep 14 10:49:56.344134 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:56.344108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:56.491886 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:56.491818    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:56.629060 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:56.629021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:57.166201 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:57.166170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:57.247334 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:57.247301    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:57.580695 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:57.580644    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:57.954814 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:57.954735    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:58.543585 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:58.543544    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:58.938616 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:58.938538    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:59.337663 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:59.337615    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:59.735502 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:59.735476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:49:59.878795 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:59.878767    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n99qp"
Sep 14 10:49:59.882611 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:59.882592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:59.882678 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:49:59.882666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:49:59.882749 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:59.882733    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:49:59.882807 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:59.882797    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:50:15.882778447 +0000 UTC m=+75.863413944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : secret "router-metrics-certs-default" not found
Sep 14 10:49:59.882849 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:49:59.882819    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle podName:6d9f801b-600f-42a8-9d5d-445a14046fee nodeName:}" failed. No retries permitted until 2026-09-14 10:50:15.882810836 +0000 UTC m=+75.863446332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle") pod "router-default-5c77589b76-877mb" (UID: "6d9f801b-600f-42a8-9d5d-445a14046fee") : configmap references non-existent config key: service-ca.crt
Sep 14 10:50:00.051521 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:00.051439    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:00.178305 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:00.178273    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:00.256556 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:00.256528    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:00.530813 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:00.530781    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:00.732694 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:00.732640    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:00.834126 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:00.834055    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:01.134011 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:01.133930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:01.590719 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:01.590688    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:01.733759 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:01.733727    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:02.034503 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:02.034471    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:02.204797 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:02.204768    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:02.526924 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:02.526889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:02.740822 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:02.740794    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:03.330318 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:03.330286    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:03.722899 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:03.722817    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:04.125870 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:04.125842    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:04.318414 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:04.318378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:50:04.318592 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:04.318462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:50:04.318592 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:50:04.318529    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 10:50:04.318592 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:50:04.318585    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls podName:17df435e-cf4f-4b0b-8731-6a4757e6f0db nodeName:}" failed. No retries permitted until 2026-09-14 10:50:20.318570193 +0000 UTC m=+80.299205677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p5tmq" (UID: "17df435e-cf4f-4b0b-8731-6a4757e6f0db") : secret "insights-runtime-extractor-tls" not found
Sep 14 10:50:04.318934 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:04.318918    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17df435e-cf4f-4b0b-8731-6a4757e6f0db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:50:04.327561 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:04.327529    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:04.934494 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:04.934459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:05.225409 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.225330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:50:05.225409 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.225380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:50:05.227602 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.227584    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/863a44cf-93fa-49b1-a3a5-4a6986517c3c-metrics-tls\") pod \"dns-default-bc6ks\" (UID: \"863a44cf-93fa-49b1-a3a5-4a6986517c3c\") " pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:50:05.227774 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.227756    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 10:50:05.237537 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.237512    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32bf6cd3-707a-4ad0-9294-9198e4a4765f-original-pull-secret\") pod \"global-pull-secret-syncer-zmdnx\" (UID: \"32bf6cd3-707a-4ad0-9294-9198e4a4765f\") " pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:50:05.278624 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.278598    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:05.325779 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.325744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7h8\" (UniqueName: \"kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8\") pod \"network-check-target-7j6cf\" (UID: \"f82376a7-f339-4946-b4ce-ef59eff7cf2b\") " pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:50:05.325939 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.325834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:50:05.327976 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.327955    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 10:50:05.328236 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.328216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg7h8\" (UniqueName: \"kubernetes.io/projected/f82376a7-f339-4946-b4ce-ef59eff7cf2b-kube-api-access-bg7h8\") pod \"network-check-target-7j6cf\" (UID: \"f82376a7-f339-4946-b4ce-ef59eff7cf2b\") " pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:50:05.338579 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.338559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08-metrics-certs\") pod \"network-metrics-daemon-mxgs8\" (UID: \"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08\") " pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:50:05.369449 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.369425    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bckh8\""
Sep 14 10:50:05.376100 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.376077    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fkf2p\""
Sep 14 10:50:05.377788 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.377775    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxgs8"
Sep 14 10:50:05.378821 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.378803    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:05.379630 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.379605    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmdnx"
Sep 14 10:50:05.384378 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.384353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:50:05.477253 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.477190    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qfwcj\""
Sep 14 10:50:05.485608 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.485578    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:50:05.537815 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.537532    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:05.671419 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.671388    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zmdnx"]
Sep 14 10:50:05.674544 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:50:05.674515    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bf6cd3_707a_4ad0_9294_9198e4a4765f.slice/crio-cd33cea6b77e007e18a0e14ed5727e641f0d6d76520c1df206348b697c5beee2 WatchSource:0}: Error finding container cd33cea6b77e007e18a0e14ed5727e641f0d6d76520c1df206348b697c5beee2: Status 404 returned error can't find the container with id cd33cea6b77e007e18a0e14ed5727e641f0d6d76520c1df206348b697c5beee2
Sep 14 10:50:05.677644 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.677619    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mxgs8"]
Sep 14 10:50:05.678880 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.678637    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7j6cf"]
Sep 14 10:50:05.762470 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.762441    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bc6ks"]
Sep 14 10:50:05.765564 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:50:05.765528    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863a44cf_93fa_49b1_a3a5_4a6986517c3c.slice/crio-f2f516efdf1ff247dc6577d3e393f402d56a14be1dce3a749da7ffcc7a67df7a WatchSource:0}: Error finding container f2f516efdf1ff247dc6577d3e393f402d56a14be1dce3a749da7ffcc7a67df7a: Status 404 returned error can't find the container with id f2f516efdf1ff247dc6577d3e393f402d56a14be1dce3a749da7ffcc7a67df7a
Sep 14 10:50:05.980955 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.980918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7j6cf" event={"ID":"f82376a7-f339-4946-b4ce-ef59eff7cf2b","Type":"ContainerStarted","Data":"66286c44208d815f5e6a5efaae1991290c83a4bdb6415bf91fd24003bc527b61"}
Sep 14 10:50:05.981396 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.980973    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7j6cf" event={"ID":"f82376a7-f339-4946-b4ce-ef59eff7cf2b","Type":"ContainerStarted","Data":"e3f9fee746def59e1c90af11bf570eeda307cb7088e8c6b9c7f471377bd44007"}
Sep 14 10:50:05.981396 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.980999    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:50:05.982156 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.982129    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxgs8" event={"ID":"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08","Type":"ContainerStarted","Data":"97a89c93a889597c0caf1a8bbdc123367c698b12f01617755a40f9c8aaca87c0"}
Sep 14 10:50:05.983411 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.983347    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zmdnx" event={"ID":"32bf6cd3-707a-4ad0-9294-9198e4a4765f","Type":"ContainerStarted","Data":"cd33cea6b77e007e18a0e14ed5727e641f0d6d76520c1df206348b697c5beee2"}
Sep 14 10:50:05.984459 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:05.984440    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bc6ks" event={"ID":"863a44cf-93fa-49b1-a3a5-4a6986517c3c","Type":"ContainerStarted","Data":"f2f516efdf1ff247dc6577d3e393f402d56a14be1dce3a749da7ffcc7a67df7a"}
Sep 14 10:50:06.000633 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:06.000587    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7j6cf" podStartSLOduration=66.000569609 podStartE2EDuration="1m6.000569609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:05.999584431 +0000 UTC m=+65.980219948" watchObservedRunningTime="2026-09-14 10:50:06.000569609 +0000 UTC m=+65.981205108"
Sep 14 10:50:06.130967 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:06.130930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:06.535464 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:06.535424    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:06.724152 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:06.724079    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:06.927240 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:06.927207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:06.991045 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:06.990996    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxgs8" event={"ID":"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08","Type":"ContainerStarted","Data":"3bff45a03ce1b69dba8d4ecdd4116e9a3cdb218fea310c60667f3718368158e0"}
Sep 14 10:50:07.652948 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:07.652915    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:07.763424 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:07.763395    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:07.973944 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:07.973912    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:07.997661 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:07.997616    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxgs8" event={"ID":"2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08","Type":"ContainerStarted","Data":"3115dc1d0a0bb17d9157e9ca49e1709cc8fc311f8249cc6129550929148dd6fd"}
Sep 14 10:50:07.999799 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:07.999769    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bc6ks" event={"ID":"863a44cf-93fa-49b1-a3a5-4a6986517c3c","Type":"ContainerStarted","Data":"54fa24faeee4e6cde69ecf7b2b47114a86202dea104380fae6900dc6a694acac"}
Sep 14 10:50:07.999928 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:07.999819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bc6ks" event={"ID":"863a44cf-93fa-49b1-a3a5-4a6986517c3c","Type":"ContainerStarted","Data":"72bc1a362e6ab12b59bee156a126ee81782be756f42622f64e3b66ca13a9ed60"}
Sep 14 10:50:07.999928 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:07.999922    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:50:08.015094 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:08.014492    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mxgs8" podStartSLOduration=66.842484158 podStartE2EDuration="1m8.014472059s" totalImagesPullingTime="1.171987901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:08.013058485 +0000 UTC m=+67.993693996" watchObservedRunningTime="2026-09-14 10:50:08.014472059 +0000 UTC m=+67.995107567"
Sep 14 10:50:08.029661 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:08.029614    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bc6ks" podStartSLOduration=33.282794236 podStartE2EDuration="35.029592973s" totalImagesPullingTime="1.746798737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:08.029562447 +0000 UTC m=+68.010197975" watchObservedRunningTime="2026-09-14 10:50:08.029592973 +0000 UTC m=+68.010228483"
Sep 14 10:50:08.040959 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:08.040930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:08.152354 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:08.152319    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:08.331797 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:08.331723    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:08.430857 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:08.430814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:08.746987 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:08.746950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:08.817415 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:08.817371    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:08.938912 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:08.938878    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:09.006705 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:09.006597    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:09.351372 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:09.351294    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:09.548030 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:09.547997    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:09.648717 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:09.648638    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:10.362075 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:10.362046    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:10.442840 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:10.442814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:11.012482 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:11.012451    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zmdnx" event={"ID":"32bf6cd3-707a-4ad0-9294-9198e4a4765f","Type":"ContainerStarted","Data":"9fc7350cf0ecde5ed649cd36a53cd5a5ee60d3eefe838227d040abb5242232cc"}
Sep 14 10:50:11.028944 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:11.028900    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zmdnx" podStartSLOduration=66.732593789 podStartE2EDuration="1m11.028864646s" totalImagesPullingTime="4.296270857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:11.028081592 +0000 UTC m=+71.008717096" watchObservedRunningTime="2026-09-14 10:50:11.028864646 +0000 UTC m=+71.009500155"
Sep 14 10:50:13.570407 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.570374    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"]
Sep 14 10:50:13.572759 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.572737    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.575626 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.575609    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 14 10:50:13.576026 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.576010    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 14 10:50:13.576123 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.576063    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 14 10:50:13.576123 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.576114    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 14 10:50:13.576368 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.576349    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 14 10:50:13.577750 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.577732    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 14 10:50:13.578414 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.578396    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 14 10:50:13.600867 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.600841    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"]
Sep 14 10:50:13.691375 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.691338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22hh8\" (UniqueName: \"kubernetes.io/projected/61da81fb-aa60-439e-8b4b-cd4bc361e401-kube-api-access-22hh8\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.691625 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.691423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-ca\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.691625 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.691446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-hub\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.691625 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.691518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.691625 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.691557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.691625 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.691607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/61da81fb-aa60-439e-8b4b-cd4bc361e401-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.715802 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.715766    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:13.792216 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.792181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-ca\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.792216 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.792215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-hub\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.792406 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.792288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.792406 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.792309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.792406 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.792339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/61da81fb-aa60-439e-8b4b-cd4bc361e401-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.792406 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.792389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22hh8\" (UniqueName: \"kubernetes.io/projected/61da81fb-aa60-439e-8b4b-cd4bc361e401-kube-api-access-22hh8\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.793144 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.793117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/61da81fb-aa60-439e-8b4b-cd4bc361e401-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.794398 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.794369    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:13.795017 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.794994    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-ca\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.795307 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.795284    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.795373 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.795340    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-hub\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.795373 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.795358    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61da81fb-aa60-439e-8b4b-cd4bc361e401-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.801992 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.801972    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22hh8\" (UniqueName: \"kubernetes.io/projected/61da81fb-aa60-439e-8b4b-cd4bc361e401-kube-api-access-22hh8\") pod \"cluster-proxy-proxy-agent-7d65f97d69-rl9c5\" (UID: \"61da81fb-aa60-439e-8b4b-cd4bc361e401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.891150 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.891062    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"
Sep 14 10:50:13.892581 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.892555    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:13.996590 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:13.996558    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:14.163311 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:14.163184    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5"]
Sep 14 10:50:14.165643 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:50:14.165604    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61da81fb_aa60_439e_8b4b_cd4bc361e401.slice/crio-e83dab76d958190d63d6facd23fbe42929e46e084f731bc56e670e5f50556a45 WatchSource:0}: Error finding container e83dab76d958190d63d6facd23fbe42929e46e084f731bc56e670e5f50556a45: Status 404 returned error can't find the container with id e83dab76d958190d63d6facd23fbe42929e46e084f731bc56e670e5f50556a45
Sep 14 10:50:15.025712 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:15.025677    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5" event={"ID":"61da81fb-aa60-439e-8b4b-cd4bc361e401","Type":"ContainerStarted","Data":"e83dab76d958190d63d6facd23fbe42929e46e084f731bc56e670e5f50556a45"}
Sep 14 10:50:15.908542 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:15.908270    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:50:15.908542 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:15.908356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:50:15.909017 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:15.908989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d9f801b-600f-42a8-9d5d-445a14046fee-service-ca-bundle\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:50:15.911129 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:15.911107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d9f801b-600f-42a8-9d5d-445a14046fee-metrics-certs\") pod \"router-default-5c77589b76-877mb\" (UID: \"6d9f801b-600f-42a8-9d5d-445a14046fee\") " pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:50:16.107993 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:16.107960    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b9s6k\""
Sep 14 10:50:16.116562 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:16.116366    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:50:16.613519 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:16.613484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:16.673916 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:16.673882    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:16.845670 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:16.845030    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c77589b76-877mb"]
Sep 14 10:50:17.838852 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:50:17.838820    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d9f801b_600f_42a8_9d5d_445a14046fee.slice/crio-9581ceb2881d7ee090d0d083ecdcdf0ab528d4faf96c45b0295bbc75a0e00869 WatchSource:0}: Error finding container 9581ceb2881d7ee090d0d083ecdcdf0ab528d4faf96c45b0295bbc75a0e00869: Status 404 returned error can't find the container with id 9581ceb2881d7ee090d0d083ecdcdf0ab528d4faf96c45b0295bbc75a0e00869
Sep 14 10:50:18.009243 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:18.009188    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bc6ks"
Sep 14 10:50:18.040542 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:18.040511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5" event={"ID":"61da81fb-aa60-439e-8b4b-cd4bc361e401","Type":"ContainerStarted","Data":"1689085a7682cb8692b97fedcf4a6bf6c6c5c7e3531cc33c8a61b23838fb6c5e"}
Sep 14 10:50:18.040735 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:18.040716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5" event={"ID":"61da81fb-aa60-439e-8b4b-cd4bc361e401","Type":"ContainerStarted","Data":"bfc1b63e42ec40db9622d6438bf15d46e78f1e9884671d192207f809da1789ff"}
Sep 14 10:50:18.042487 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:18.042406    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c77589b76-877mb" event={"ID":"6d9f801b-600f-42a8-9d5d-445a14046fee","Type":"ContainerStarted","Data":"40e5e754aeb88c192a6a80b63c11542cef7139861f2cbbe90b6a54c6b376c9d6"}
Sep 14 10:50:18.042487 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:18.042454    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c77589b76-877mb" event={"ID":"6d9f801b-600f-42a8-9d5d-445a14046fee","Type":"ContainerStarted","Data":"9581ceb2881d7ee090d0d083ecdcdf0ab528d4faf96c45b0295bbc75a0e00869"}
Sep 14 10:50:18.070925 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:18.070875    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5c77589b76-877mb" podStartSLOduration=35.070853183 podStartE2EDuration="35.070853183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:18.068963682 +0000 UTC m=+78.049599188" watchObservedRunningTime="2026-09-14 10:50:18.070853183 +0000 UTC m=+78.051488688"
Sep 14 10:50:18.116850 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:18.116778    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:50:18.119135 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:18.119112    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:50:19.047721 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:19.047686    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5" event={"ID":"61da81fb-aa60-439e-8b4b-cd4bc361e401","Type":"ContainerStarted","Data":"11186a0f73aeb742ef337bf8cfaac62366bff2d65f12b4cd2561530278b877cd"}
Sep 14 10:50:19.048104 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:19.047977    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:50:19.049114 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:19.049091    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c77589b76-877mb"
Sep 14 10:50:19.065158 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:19.065112    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d65f97d69-rl9c5" podStartSLOduration=2.348247473 podStartE2EDuration="6.065096914s" totalImagesPullingTime="3.716849441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:19.06419133 +0000 UTC m=+79.044826836" watchObservedRunningTime="2026-09-14 10:50:19.065096914 +0000 UTC m=+79.045732417"
Sep 14 10:50:19.280783 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:19.280753    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:19.377779 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:19.377713    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:19.463449 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:19.463417    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:19.786785 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:19.786755    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:20.346289 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:20.346245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:50:20.348512 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:20.348479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17df435e-cf4f-4b0b-8731-6a4757e6f0db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5tmq\" (UID: \"17df435e-cf4f-4b0b-8731-6a4757e6f0db\") " pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:50:20.566604 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:20.566572    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6n6bp\""
Sep 14 10:50:20.575251 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:20.575232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p5tmq"
Sep 14 10:50:20.842941 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:20.842909    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p5tmq"]
Sep 14 10:50:20.845439 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:50:20.845408    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17df435e_cf4f_4b0b_8731_6a4757e6f0db.slice/crio-30b2c461a9a73e3e7ba60759a94a203b9c295b74cdc25d849488da99697b29cc WatchSource:0}: Error finding container 30b2c461a9a73e3e7ba60759a94a203b9c295b74cdc25d849488da99697b29cc: Status 404 returned error can't find the container with id 30b2c461a9a73e3e7ba60759a94a203b9c295b74cdc25d849488da99697b29cc
Sep 14 10:50:21.059617 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:21.059585    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p5tmq" event={"ID":"17df435e-cf4f-4b0b-8731-6a4757e6f0db","Type":"ContainerStarted","Data":"11d6bef6d8574a7964afab32beb2b2d5cbaa08db199dce68e8c94eeabced6c69"}
Sep 14 10:50:21.059793 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:21.059639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p5tmq" event={"ID":"17df435e-cf4f-4b0b-8731-6a4757e6f0db","Type":"ContainerStarted","Data":"30b2c461a9a73e3e7ba60759a94a203b9c295b74cdc25d849488da99697b29cc"}
Sep 14 10:50:21.770319 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:21.770286    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:21.873799 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:21.873773    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:22.912150 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:22.912082    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:23.020858 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:23.020745    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:23.069941 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:23.069908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p5tmq" event={"ID":"17df435e-cf4f-4b0b-8731-6a4757e6f0db","Type":"ContainerStarted","Data":"36222ea44675a0061f375ba105596e4d23c0b5cc2c1f085d1c84edebd2e7ff17"}
Sep 14 10:50:24.075607 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:24.075577    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p5tmq" event={"ID":"17df435e-cf4f-4b0b-8731-6a4757e6f0db","Type":"ContainerStarted","Data":"ca356391d7e1cc49f30dac80116191a00f50eb0e8cd260a0b7497d80b2597a09"}
Sep 14 10:50:24.095821 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:24.095171    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p5tmq" podStartSLOduration=33.424297117 podStartE2EDuration="36.095150881s" totalImagesPullingTime="2.670853764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:49:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:24.09476889 +0000 UTC m=+84.075404387" watchObservedRunningTime="2026-09-14 10:50:24.095150881 +0000 UTC m=+84.075786387"
Sep 14 10:50:24.165539 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:24.165510    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:24.248586 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:24.248558    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:25.506192 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:25.506162    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:25.607090 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:25.607062    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:25.986818 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:25.986785    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:26.068841 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:26.068809    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:27.217881 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:27.217848    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:27.295676 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:27.295638    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:27.740336 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:27.740302    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:28.010678 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.010565    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:28.194101 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.194069    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:28.224212 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.224187    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"]
Sep 14 10:50:28.227644 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.227621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.233882 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.233858    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 14 10:50:28.233994 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.233972    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 14 10:50:28.234713 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.234696    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 14 10:50:28.234925 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.234913    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 14 10:50:28.255252 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.255231    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 14 10:50:28.255338 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.255231    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zfwkr\""
Sep 14 10:50:28.286063 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.286004    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"]
Sep 14 10:50:28.299316 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.299285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86d341e2-9862-43b8-86bf-3cde751558a1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.299425 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.299319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzd7l\" (UniqueName: \"kubernetes.io/projected/86d341e2-9862-43b8-86bf-3cde751558a1-kube-api-access-nzd7l\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.299425 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.299394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86d341e2-9862-43b8-86bf-3cde751558a1-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.299534 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.299439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/86d341e2-9862-43b8-86bf-3cde751558a1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.337642 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.337609    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-82vsv"]
Sep 14 10:50:28.340984 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.340969    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.350460 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.350442    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-86qr8\""
Sep 14 10:50:28.350541 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.350459    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 14 10:50:28.351433 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.351419    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 14 10:50:28.351691 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.351677    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 14 10:50:28.400312 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt445\" (UniqueName: \"kubernetes.io/projected/22de75a9-e790-4a0d-ba3b-60e0df51314a-kube-api-access-dt445\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.400462 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86d341e2-9862-43b8-86bf-3cde751558a1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.400462 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzd7l\" (UniqueName: \"kubernetes.io/projected/86d341e2-9862-43b8-86bf-3cde751558a1-kube-api-access-nzd7l\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.400462 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86d341e2-9862-43b8-86bf-3cde751558a1-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.400462 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/86d341e2-9862-43b8-86bf-3cde751558a1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.400462 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-tls\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.400755 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-textfile\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.400755 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22de75a9-e790-4a0d-ba3b-60e0df51314a-root\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.400755 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-accelerators-collector-config\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.400755 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22de75a9-e790-4a0d-ba3b-60e0df51314a-sys\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.400755 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22de75a9-e790-4a0d-ba3b-60e0df51314a-metrics-client-ca\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.400755 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.400755 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.400708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-wtmp\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.401162 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.401145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86d341e2-9862-43b8-86bf-3cde751558a1-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.402703 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.402682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86d341e2-9862-43b8-86bf-3cde751558a1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.402880 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.402865    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/86d341e2-9862-43b8-86bf-3cde751558a1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.417420 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.417402    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzd7l\" (UniqueName: \"kubernetes.io/projected/86d341e2-9862-43b8-86bf-3cde751558a1-kube-api-access-nzd7l\") pod \"openshift-state-metrics-67dcf8c979-29bg7\" (UID: \"86d341e2-9862-43b8-86bf-3cde751558a1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.454175 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.454152    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:28.502036 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt445\" (UniqueName: \"kubernetes.io/projected/22de75a9-e790-4a0d-ba3b-60e0df51314a-kube-api-access-dt445\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502146 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-tls\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502146 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-textfile\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502146 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22de75a9-e790-4a0d-ba3b-60e0df51314a-root\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502293 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-accelerators-collector-config\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502293 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22de75a9-e790-4a0d-ba3b-60e0df51314a-sys\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502293 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502230    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22de75a9-e790-4a0d-ba3b-60e0df51314a-root\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502293 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22de75a9-e790-4a0d-ba3b-60e0df51314a-metrics-client-ca\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502293 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502293 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502285    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22de75a9-e790-4a0d-ba3b-60e0df51314a-sys\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502528 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-wtmp\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502528 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502460    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-wtmp\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502528 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502471    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-textfile\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502793 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502776    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22de75a9-e790-4a0d-ba3b-60e0df51314a-metrics-client-ca\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.502846 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.502778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-accelerators-collector-config\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.504355 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.504333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-tls\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.504440 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.504356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22de75a9-e790-4a0d-ba3b-60e0df51314a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.514105 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.514082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt445\" (UniqueName: \"kubernetes.io/projected/22de75a9-e790-4a0d-ba3b-60e0df51314a-kube-api-access-dt445\") pod \"node-exporter-82vsv\" (UID: \"22de75a9-e790-4a0d-ba3b-60e0df51314a\") " pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.536278 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.536226    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"
Sep 14 10:50:28.585490 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.585457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:28.649911 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.649870    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-82vsv"
Sep 14 10:50:28.659780 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:50:28.659754    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22de75a9_e790_4a0d_ba3b_60e0df51314a.slice/crio-bd6f9e7f131fb8ca411b5294a903beb1a4a8d6f01859ba359fcffc167aec52da WatchSource:0}: Error finding container bd6f9e7f131fb8ca411b5294a903beb1a4a8d6f01859ba359fcffc167aec52da: Status 404 returned error can't find the container with id bd6f9e7f131fb8ca411b5294a903beb1a4a8d6f01859ba359fcffc167aec52da
Sep 14 10:50:28.811660 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.811571    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:28.826878 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:28.826852    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7"]
Sep 14 10:50:28.829703 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:50:28.829678    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d341e2_9862_43b8_86bf_3cde751558a1.slice/crio-63c0ecda0a14e0787112614d5ae7762d30361d51cabd1fe3bce62d6a0030858a WatchSource:0}: Error finding container 63c0ecda0a14e0787112614d5ae7762d30361d51cabd1fe3bce62d6a0030858a: Status 404 returned error can't find the container with id 63c0ecda0a14e0787112614d5ae7762d30361d51cabd1fe3bce62d6a0030858a
Sep 14 10:50:29.022089 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:29.022059    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:29.092355 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:29.092275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82vsv" event={"ID":"22de75a9-e790-4a0d-ba3b-60e0df51314a","Type":"ContainerStarted","Data":"bd6f9e7f131fb8ca411b5294a903beb1a4a8d6f01859ba359fcffc167aec52da"}
Sep 14 10:50:29.094066 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:29.094044    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7" event={"ID":"86d341e2-9862-43b8-86bf-3cde751558a1","Type":"ContainerStarted","Data":"bbb8ac4da34ce74e4a903e050db4b5b7e65e0278faeec8cc086f2a9998fe14a1"}
Sep 14 10:50:29.094169 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:29.094085    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7" event={"ID":"86d341e2-9862-43b8-86bf-3cde751558a1","Type":"ContainerStarted","Data":"2a6e393161b97d90215ba2226b66d8ec29030469fb0361a0945478b7efe9223f"}
Sep 14 10:50:29.094169 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:29.094106    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7" event={"ID":"86d341e2-9862-43b8-86bf-3cde751558a1","Type":"ContainerStarted","Data":"63c0ecda0a14e0787112614d5ae7762d30361d51cabd1fe3bce62d6a0030858a"}
Sep 14 10:50:29.310693 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:29.310640    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:29.559318 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:29.559289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:29.960973 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:29.960951    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:30.099822 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:30.099786    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7" event={"ID":"86d341e2-9862-43b8-86bf-3cde751558a1","Type":"ContainerStarted","Data":"46e6994a7d5ef724e732f42c8c830fd06e1b4db07e85452a8ed8838fd0ad45ff"}
Sep 14 10:50:30.101335 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:30.101309    2576 generic.go:356] "Generic (PLEG): container finished" podID="22de75a9-e790-4a0d-ba3b-60e0df51314a" containerID="2d879b35b9f11c056aeba5b28f478e0d4f5b5e6ae420a25e52b1bf9609061923" exitCode=0
Sep 14 10:50:30.101448 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:30.101366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82vsv" event={"ID":"22de75a9-e790-4a0d-ba3b-60e0df51314a","Type":"ContainerDied","Data":"2d879b35b9f11c056aeba5b28f478e0d4f5b5e6ae420a25e52b1bf9609061923"}
Sep 14 10:50:30.171901 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:30.171826    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-29bg7" podStartSLOduration=1.181407749 podStartE2EDuration="2.171807322s" totalImagesPullingTime="990.399573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:30.171447329 +0000 UTC m=+90.152082835" watchObservedRunningTime="2026-09-14 10:50:30.171807322 +0000 UTC m=+90.152442828"
Sep 14 10:50:31.111102 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:31.111068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82vsv" event={"ID":"22de75a9-e790-4a0d-ba3b-60e0df51314a","Type":"ContainerStarted","Data":"18d283eafd46f579457708a68ee84351a4392dd02e1a225d92a9c9ee06ec93cb"}
Sep 14 10:50:31.111555 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:31.111149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82vsv" event={"ID":"22de75a9-e790-4a0d-ba3b-60e0df51314a","Type":"ContainerStarted","Data":"052a651f024b6c8cec42576147aeba6a001eb6ac19f8b88a10cba5ac8da1c92b"}
Sep 14 10:50:31.183537 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:31.183490    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-82vsv" podStartSLOduration=1.8567188780000001 podStartE2EDuration="3.183474827s" totalImagesPullingTime="1.262137977s" totalInitContainerRuntime="64.617972ms" isStatefulPod=true podCreationTimestamp="2026-09-14 10:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:31.180181501 +0000 UTC m=+91.160817006" watchObservedRunningTime="2026-09-14 10:50:31.183474827 +0000 UTC m=+91.164110332"
Sep 14 10:50:31.811400 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:31.811369    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:31.992775 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:31.992747    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:32.215419 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:32.215317    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:32.760157 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:32.760115    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:33.078476 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:33.078395    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:33.338612 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:33.338523    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:33.678639 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:33.678568    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:35.704892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:35.704858    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:35.816553 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:35.816525    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:36.993762 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:36.993732    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7j6cf"
Sep 14 10:50:37.660210 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:37.660176    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:37.752637 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:37.752605    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:38.047838 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:38.047808    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:38.628736 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:38.628701    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:45.702189 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:45.702158    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:45.801569 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:45.801536    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:47.659810 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:47.659779    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:49.213508 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:49.213465    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:49.310438 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:49.310410    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:55.563093 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:55.563061    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:55.665203 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:55.665171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:50:59.899370 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:50:59.899332    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:00.028053 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:00.028020    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:00.215104 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:00.215020    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b03ca59-a7b8-462d-9754-65461f16518e" containerID="5ef1c0bb757de4aaf4eed7b9688263d10fd5a78065423f4df67f6cf0ee38f459" exitCode=0
Sep 14 10:51:00.215104 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:00.215056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd" event={"ID":"2b03ca59-a7b8-462d-9754-65461f16518e","Type":"ContainerDied","Data":"5ef1c0bb757de4aaf4eed7b9688263d10fd5a78065423f4df67f6cf0ee38f459"}
Sep 14 10:51:00.215431 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:00.215412    2576 scope.go:117] "RemoveContainer" containerID="5ef1c0bb757de4aaf4eed7b9688263d10fd5a78065423f4df67f6cf0ee38f459"
Sep 14 10:51:01.220157 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:01.220120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-tr7kd" event={"ID":"2b03ca59-a7b8-462d-9754-65461f16518e","Type":"ContainerStarted","Data":"e525fadec35b5d291570d58a2cf86f049e210dd477da6dc908094fde90c6eea3"}
Sep 14 10:51:01.655200 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:01.655169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:01.771322 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:01.771287    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:16.194413 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:16.194383    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:16.642736 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:16.642702    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:16.758448 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:16.758407    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:19.843319 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:19.843286    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:20.091855 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:20.091820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:48.235851 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:48.235812    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:48.840029 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:48.839980    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:56.932593 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:56.932516    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:51:56.989554 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:51:56.989523    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:52:08.059317 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:52:08.059273    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:52:08.128849 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:52:08.128819    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:52:08.202401 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:52:08.202379    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:52:57.708357 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:52:57.708316    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:03.596550 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:03.596516    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:03.672545 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:03.672511    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:07.775537 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:07.775488    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:07.873863 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:07.873834    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:07.943706 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:07.943675    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:08.689667 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:08.689618    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:08.789438 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:08.789402    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:11.250898 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:11.250870    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:15.475593 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:15.475556    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:15.577397 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:15.577368    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:18.355613 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:18.355577    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:18.457483 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:18.457454    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:31.614482 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:31.614403    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:53:31.714262 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:53:31.714228    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:00.434628 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:00.434602    2576 kubelet.go:1648] "Image garbage collection succeeded"
Sep 14 10:54:16.118313 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:16.118280    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:18.836750 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:18.836718    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:30.677799 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:30.677764    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:30.778161 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:30.778097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:39.776028 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:39.775991    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:39.975024 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:39.974996    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:44.270676 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:44.270637    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:44.405861 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:44.405828    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:45.744424 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:45.744390    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:45.990692 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:45.990664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:46.165219 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:46.165140    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:46.368595 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:46.368565    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:48.153784 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:48.153755    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:48.449756 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:48.449678    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:54:55.953361 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:54:55.953280    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:00.457669 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.457622    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wlz7w"]
Sep 14 10:55:00.460567 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.460553    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wlz7w"
Sep 14 10:55:00.466767 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.466750    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-scvn6\""
Sep 14 10:55:00.474150 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.474133    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 14 10:55:00.481183 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.481166    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 14 10:55:00.540382 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.540350    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wlz7w"]
Sep 14 10:55:00.611271 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.611243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8qpf\" (UniqueName: \"kubernetes.io/projected/aac05a39-b659-4214-b152-c577b1cb5f89-kube-api-access-f8qpf\") pod \"cert-manager-55b4d954d5-wlz7w\" (UID: \"aac05a39-b659-4214-b152-c577b1cb5f89\") " pod="cert-manager/cert-manager-55b4d954d5-wlz7w"
Sep 14 10:55:00.611411 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.611289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aac05a39-b659-4214-b152-c577b1cb5f89-bound-sa-token\") pod \"cert-manager-55b4d954d5-wlz7w\" (UID: \"aac05a39-b659-4214-b152-c577b1cb5f89\") " pod="cert-manager/cert-manager-55b4d954d5-wlz7w"
Sep 14 10:55:00.712280 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.712201    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8qpf\" (UniqueName: \"kubernetes.io/projected/aac05a39-b659-4214-b152-c577b1cb5f89-kube-api-access-f8qpf\") pod \"cert-manager-55b4d954d5-wlz7w\" (UID: \"aac05a39-b659-4214-b152-c577b1cb5f89\") " pod="cert-manager/cert-manager-55b4d954d5-wlz7w"
Sep 14 10:55:00.712280 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.712244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aac05a39-b659-4214-b152-c577b1cb5f89-bound-sa-token\") pod \"cert-manager-55b4d954d5-wlz7w\" (UID: \"aac05a39-b659-4214-b152-c577b1cb5f89\") " pod="cert-manager/cert-manager-55b4d954d5-wlz7w"
Sep 14 10:55:00.730007 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.729984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aac05a39-b659-4214-b152-c577b1cb5f89-bound-sa-token\") pod \"cert-manager-55b4d954d5-wlz7w\" (UID: \"aac05a39-b659-4214-b152-c577b1cb5f89\") " pod="cert-manager/cert-manager-55b4d954d5-wlz7w"
Sep 14 10:55:00.731954 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.731937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8qpf\" (UniqueName: \"kubernetes.io/projected/aac05a39-b659-4214-b152-c577b1cb5f89-kube-api-access-f8qpf\") pod \"cert-manager-55b4d954d5-wlz7w\" (UID: \"aac05a39-b659-4214-b152-c577b1cb5f89\") " pod="cert-manager/cert-manager-55b4d954d5-wlz7w"
Sep 14 10:55:00.768317 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:00.768294    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wlz7w"
Sep 14 10:55:01.047284 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:01.047246    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wlz7w"]
Sep 14 10:55:01.050955 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:55:01.050930    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaac05a39_b659_4214_b152_c577b1cb5f89.slice/crio-cac2ddf4f4f5d4217ff722c287a23f3adfc2f0e4cdb7cb4cc014ecbd617b64ba WatchSource:0}: Error finding container cac2ddf4f4f5d4217ff722c287a23f3adfc2f0e4cdb7cb4cc014ecbd617b64ba: Status 404 returned error can't find the container with id cac2ddf4f4f5d4217ff722c287a23f3adfc2f0e4cdb7cb4cc014ecbd617b64ba
Sep 14 10:55:01.053185 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:01.053168    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:55:02.023556 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:02.023516    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wlz7w" event={"ID":"aac05a39-b659-4214-b152-c577b1cb5f89","Type":"ContainerStarted","Data":"cac2ddf4f4f5d4217ff722c287a23f3adfc2f0e4cdb7cb4cc014ecbd617b64ba"}
Sep 14 10:55:04.032665 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:04.032625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wlz7w" event={"ID":"aac05a39-b659-4214-b152-c577b1cb5f89","Type":"ContainerStarted","Data":"811610bfb658b9cbabf6e5f64677dd0af283310427d57da193d4d5d2a08e6b6d"}
Sep 14 10:55:04.058550 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:04.058493    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wlz7w" podStartSLOduration=1.2490656 podStartE2EDuration="4.058475886s" totalImagesPullingTime="2.809410286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:55:04.056817609 +0000 UTC m=+364.037453114" watchObservedRunningTime="2026-09-14 10:55:04.058475886 +0000 UTC m=+364.039111390"
Sep 14 10:55:17.315222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:17.315188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:17.454272 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:17.454226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:22.226504 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:22.226473    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:22.336900 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:22.336852    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:22.443188 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:22.443155    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:23.850919 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:23.850886    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:23.993388 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:23.993356    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:24.236850 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:24.236824    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:24.427423 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:24.427371    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:24.554506 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:24.554421    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:34.960788 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:34.960750    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:35.129393 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:35.129361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:36.174951 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:36.174918    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:36.300969 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:36.300937    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:36.692585 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:36.692547    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:37.028545 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.028514    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:37.685690 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.685635    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:37.843927 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.843895    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"]
Sep 14 10:55:37.847125 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.847110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.849668 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.849633    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 14 10:55:37.849892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.849879    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rs8sp\""
Sep 14 10:55:37.850111 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.850096    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 14 10:55:37.850781 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.850763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 14 10:55:37.853944 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.853670    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:37.856790 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.856775    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 14 10:55:37.879911 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.879887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/618b3422-5e84-4d75-a43b-0ebca9152fba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.879999 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.879921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/618b3422-5e84-4d75-a43b-0ebca9152fba-tmp\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.879999 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.879959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/618b3422-5e84-4d75-a43b-0ebca9152fba-webhook-cert\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.879999 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.879985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdqrm\" (UniqueName: \"kubernetes.io/projected/618b3422-5e84-4d75-a43b-0ebca9152fba-kube-api-access-zdqrm\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.880118 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.880015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/618b3422-5e84-4d75-a43b-0ebca9152fba-manifests\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.883719 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.883699    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"]
Sep 14 10:55:37.981048 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.981024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/618b3422-5e84-4d75-a43b-0ebca9152fba-webhook-cert\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.981193 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.981052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdqrm\" (UniqueName: \"kubernetes.io/projected/618b3422-5e84-4d75-a43b-0ebca9152fba-kube-api-access-zdqrm\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.981193 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.981094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/618b3422-5e84-4d75-a43b-0ebca9152fba-manifests\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.981193 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.981128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/618b3422-5e84-4d75-a43b-0ebca9152fba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.981193 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.981163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/618b3422-5e84-4d75-a43b-0ebca9152fba-tmp\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.981671 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.981633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/618b3422-5e84-4d75-a43b-0ebca9152fba-manifests\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.983422 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.983401    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/618b3422-5e84-4d75-a43b-0ebca9152fba-tmp\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.983522 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.983457    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/618b3422-5e84-4d75-a43b-0ebca9152fba-webhook-cert\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:37.983664 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:37.983627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/618b3422-5e84-4d75-a43b-0ebca9152fba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:38.001417 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:38.001392    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdqrm\" (UniqueName: \"kubernetes.io/projected/618b3422-5e84-4d75-a43b-0ebca9152fba-kube-api-access-zdqrm\") pod \"opendatahub-operator-controller-manager-f6d976668-prjcm\" (UID: \"618b3422-5e84-4d75-a43b-0ebca9152fba\") " pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:38.068114 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:38.068089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:38.156946 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:38.156907    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:38.186239 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:38.186214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:38.461017 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:38.460948    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:38.484132 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:38.484111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"]
Sep 14 10:55:38.485960 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:55:38.485939    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618b3422_5e84_4d75_a43b_0ebca9152fba.slice/crio-bc344133b44c66edf3cf458874f68743e466480478915bf3f3660860c927ccac WatchSource:0}: Error finding container bc344133b44c66edf3cf458874f68743e466480478915bf3f3660860c927ccac: Status 404 returned error can't find the container with id bc344133b44c66edf3cf458874f68743e466480478915bf3f3660860c927ccac
Sep 14 10:55:38.626351 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:38.626320    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:38.779504 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:38.779474    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:38.947169 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:38.947140    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:39.153877 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:39.153799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm" event={"ID":"618b3422-5e84-4d75-a43b-0ebca9152fba","Type":"ContainerStarted","Data":"bc344133b44c66edf3cf458874f68743e466480478915bf3f3660860c927ccac"}
Sep 14 10:55:42.167461 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:42.167425    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm" event={"ID":"618b3422-5e84-4d75-a43b-0ebca9152fba","Type":"ContainerStarted","Data":"ff6d3a2f0698418149fa581cb8bafe6f1e857912c6925c92c452f08d8d9eb00e"}
Sep 14 10:55:43.172307 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:43.172273    2576 generic.go:356] "Generic (PLEG): container finished" podID="618b3422-5e84-4d75-a43b-0ebca9152fba" containerID="ff6d3a2f0698418149fa581cb8bafe6f1e857912c6925c92c452f08d8d9eb00e" exitCode=0
Sep 14 10:55:43.172714 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:43.172348    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm" event={"ID":"618b3422-5e84-4d75-a43b-0ebca9152fba","Type":"ContainerDied","Data":"ff6d3a2f0698418149fa581cb8bafe6f1e857912c6925c92c452f08d8d9eb00e"}
Sep 14 10:55:44.178041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:44.178003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm" event={"ID":"618b3422-5e84-4d75-a43b-0ebca9152fba","Type":"ContainerStarted","Data":"20287f13b06ae881a138674e20e8c11a6816d8a421821a215ceee6ba33d8cb1a"}
Sep 14 10:55:44.178511 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:44.178125    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:44.252284 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:44.252223    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm" podStartSLOduration=2.729134222 podStartE2EDuration="7.252202121s" totalImagesPullingTime="3.492693753s" totalInitContainerRuntime="1.030374146s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:55:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:55:44.250103667 +0000 UTC m=+404.230739172" watchObservedRunningTime="2026-09-14 10:55:44.252202121 +0000 UTC m=+404.232837628"
Sep 14 10:55:55.184931 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:55.184901    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f6d976668-prjcm"
Sep 14 10:55:57.952355 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:57.952318    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:58.211381 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:58.211303    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:58.827955 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:58.827922    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:58.859440 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:58.859411    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"]
Sep 14 10:55:58.864238 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:58.864220    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"
Sep 14 10:55:58.869061 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:58.869039    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 14 10:55:58.869341 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:58.869322    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-66wvz\""
Sep 14 10:55:58.869983 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:58.869965    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 14 10:55:58.894740 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:58.894717    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"]
Sep 14 10:55:58.934236 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:58.934204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0016e46a-a640-498f-9a78-1c89d1624d90-tls-certs\") pod \"kube-auth-proxy-848c99f856-pl4cb\" (UID: \"0016e46a-a640-498f-9a78-1c89d1624d90\") " pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"
Sep 14 10:55:58.934378 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:58.934241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0016e46a-a640-498f-9a78-1c89d1624d90-tmp\") pod \"kube-auth-proxy-848c99f856-pl4cb\" (UID: \"0016e46a-a640-498f-9a78-1c89d1624d90\") " pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"
Sep 14 10:55:58.934378 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:58.934361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hg2w\" (UniqueName: \"kubernetes.io/projected/0016e46a-a640-498f-9a78-1c89d1624d90-kube-api-access-9hg2w\") pod \"kube-auth-proxy-848c99f856-pl4cb\" (UID: \"0016e46a-a640-498f-9a78-1c89d1624d90\") " pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"
Sep 14 10:55:59.035293 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:59.035255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0016e46a-a640-498f-9a78-1c89d1624d90-tls-certs\") pod \"kube-auth-proxy-848c99f856-pl4cb\" (UID: \"0016e46a-a640-498f-9a78-1c89d1624d90\") " pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"
Sep 14 10:55:59.035293 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:59.035291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0016e46a-a640-498f-9a78-1c89d1624d90-tmp\") pod \"kube-auth-proxy-848c99f856-pl4cb\" (UID: \"0016e46a-a640-498f-9a78-1c89d1624d90\") " pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"
Sep 14 10:55:59.035807 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:59.035369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hg2w\" (UniqueName: \"kubernetes.io/projected/0016e46a-a640-498f-9a78-1c89d1624d90-kube-api-access-9hg2w\") pod \"kube-auth-proxy-848c99f856-pl4cb\" (UID: \"0016e46a-a640-498f-9a78-1c89d1624d90\") " pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"
Sep 14 10:55:59.037602 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:59.037575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0016e46a-a640-498f-9a78-1c89d1624d90-tmp\") pod \"kube-auth-proxy-848c99f856-pl4cb\" (UID: \"0016e46a-a640-498f-9a78-1c89d1624d90\") " pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"
Sep 14 10:55:59.037724 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:59.037697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0016e46a-a640-498f-9a78-1c89d1624d90-tls-certs\") pod \"kube-auth-proxy-848c99f856-pl4cb\" (UID: \"0016e46a-a640-498f-9a78-1c89d1624d90\") " pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"
Sep 14 10:55:59.062332 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:59.062313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hg2w\" (UniqueName: \"kubernetes.io/projected/0016e46a-a640-498f-9a78-1c89d1624d90-kube-api-access-9hg2w\") pod \"kube-auth-proxy-848c99f856-pl4cb\" (UID: \"0016e46a-a640-498f-9a78-1c89d1624d90\") " pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"
Sep 14 10:55:59.146546 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:59.146485    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:55:59.174498 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:59.174468    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"
Sep 14 10:55:59.453153 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:55:59.453124    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-848c99f856-pl4cb"]
Sep 14 10:55:59.455467 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:55:59.455437    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0016e46a_a640_498f_9a78_1c89d1624d90.slice/crio-567c77cc3222d4138ace7117027f427f33756bf9953b6d4ea2264f905c8014d7 WatchSource:0}: Error finding container 567c77cc3222d4138ace7117027f427f33756bf9953b6d4ea2264f905c8014d7: Status 404 returned error can't find the container with id 567c77cc3222d4138ace7117027f427f33756bf9953b6d4ea2264f905c8014d7
Sep 14 10:56:00.236157 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:00.236071    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb" event={"ID":"0016e46a-a640-498f-9a78-1c89d1624d90","Type":"ContainerStarted","Data":"567c77cc3222d4138ace7117027f427f33756bf9953b6d4ea2264f905c8014d7"}
Sep 14 10:56:01.535420 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.535387    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:01.539845 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.539819    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"]
Sep 14 10:56:01.544522 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.544502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.552391 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.552373    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 14 10:56:01.552510 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.552441    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 14 10:56:01.552510 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.552488    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 14 10:56:01.553141 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.553119    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 14 10:56:01.553223 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.553154    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7dhq6\""
Sep 14 10:56:01.573271 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.573240    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"]
Sep 14 10:56:01.654066 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.654025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.654066 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.654068    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8da0d03b-8693-4683-b3ae-2a0fa6483307-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.654302 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.654229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.654354 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.654305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.654399 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.654350    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.654399 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.654384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l67nt\" (UniqueName: \"kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-kube-api-access-l67nt\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.654501 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.654479    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.661805 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.661769    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:01.755712 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.755677    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.755892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.755721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.755892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.755749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l67nt\" (UniqueName: \"kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-kube-api-access-l67nt\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.755892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.755794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.755892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.755832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.755892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.755854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8da0d03b-8693-4683-b3ae-2a0fa6483307-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.755892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.755887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.756611 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.756559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.758851 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.758827    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.758973 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.758830    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.758973 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.758885    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8da0d03b-8693-4683-b3ae-2a0fa6483307-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.758973 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.758958    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.766771 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.766715    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.768795 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.768770    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l67nt\" (UniqueName: \"kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-kube-api-access-l67nt\") pod \"istiod-openshift-gateway-7b7995d5cd-n8rc5\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:01.853995 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:01.853898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:02.244062 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:02.244036    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 14 10:56:02.469831 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:02.469757    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"]
Sep 14 10:56:02.476981 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:56:02.476953    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da0d03b_8693_4683_b3ae_2a0fa6483307.slice/crio-26c3f8256bbe4d7717643ce5783c446d72dcb72ba3fa0f0ac44a83855a167217 WatchSource:0}: Error finding container 26c3f8256bbe4d7717643ce5783c446d72dcb72ba3fa0f0ac44a83855a167217: Status 404 returned error can't find the container with id 26c3f8256bbe4d7717643ce5783c446d72dcb72ba3fa0f0ac44a83855a167217
Sep 14 10:56:03.249435 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:03.249392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb" event={"ID":"0016e46a-a640-498f-9a78-1c89d1624d90","Type":"ContainerStarted","Data":"485cfb0f87d80bc14452d5263f02fe15c1aed56d3752884586bd271999530331"}
Sep 14 10:56:03.251056 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:03.251027    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5" event={"ID":"8da0d03b-8693-4683-b3ae-2a0fa6483307","Type":"ContainerStarted","Data":"26c3f8256bbe4d7717643ce5783c446d72dcb72ba3fa0f0ac44a83855a167217"}
Sep 14 10:56:03.268227 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:03.268169    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-848c99f856-pl4cb" podStartSLOduration=2.485159302 podStartE2EDuration="5.268150975s" totalImagesPullingTime="2.782991673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:56:03.267388273 +0000 UTC m=+423.248023779" watchObservedRunningTime="2026-09-14 10:56:03.268150975 +0000 UTC m=+423.248786480"
Sep 14 10:56:03.407132 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:03.407058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:04.787572 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:04.787535    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 10:56:04.787824 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:04.787606    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 10:56:05.262853 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:05.262820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5" event={"ID":"8da0d03b-8693-4683-b3ae-2a0fa6483307","Type":"ContainerStarted","Data":"97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac"}
Sep 14 10:56:05.263042 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:05.262975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:05.264881 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:05.264848    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-n8rc5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 10:56:05.264974 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:05.264915    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5" podUID="8da0d03b-8693-4683-b3ae-2a0fa6483307" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 10:56:05.295263 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:05.295216    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5" podStartSLOduration=1.9875103969999999 podStartE2EDuration="4.295200774s" totalImagesPullingTime="2.307690377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:56:05.294054173 +0000 UTC m=+425.274689678" watchObservedRunningTime="2026-09-14 10:56:05.295200774 +0000 UTC m=+425.275836278"
Sep 14 10:56:05.505638 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:05.505594    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:05.607141 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:05.607051    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:06.267513 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:06.267480    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:06.320520 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:06.320492    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:06.442023 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:06.441993    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:06.585056 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:06.584952    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:09.038574 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:09.038541    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:09.127590 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:09.127560    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:09.256084 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:09.256053    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:09.427158 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:09.427075    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:09.705252 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:09.705156    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:09.824397 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:09.824361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:17.643839 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.643805    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"]
Sep 14 10:56:17.648547 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.648526    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.689274 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.689244    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"]
Sep 14 10:56:17.782251 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.782217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.782251 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.782252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61962eb0-8148-421e-92d1-dd63e2c7d0ff-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.782458 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.782272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.782458 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.782295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj6kp\" (UniqueName: \"kubernetes.io/projected/61962eb0-8148-421e-92d1-dd63e2c7d0ff-kube-api-access-dj6kp\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.782458 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.782381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61962eb0-8148-421e-92d1-dd63e2c7d0ff-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.782458 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.782417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.782458 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.782456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.883764 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.883729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.883764 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.883767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61962eb0-8148-421e-92d1-dd63e2c7d0ff-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.884069 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.883786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.884069 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.883810    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj6kp\" (UniqueName: \"kubernetes.io/projected/61962eb0-8148-421e-92d1-dd63e2c7d0ff-kube-api-access-dj6kp\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.884069 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.883842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61962eb0-8148-421e-92d1-dd63e2c7d0ff-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.884069 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.883872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.884069 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.883942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.884622 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.884595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.886192 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.886167    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61962eb0-8148-421e-92d1-dd63e2c7d0ff-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.886413 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.886393    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.886413 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.886402    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.886523 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.886492    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61962eb0-8148-421e-92d1-dd63e2c7d0ff-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.920996 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.920922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61962eb0-8148-421e-92d1-dd63e2c7d0ff-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:17.967605 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:17.967576    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj6kp\" (UniqueName: \"kubernetes.io/projected/61962eb0-8148-421e-92d1-dd63e2c7d0ff-kube-api-access-dj6kp\") pod \"istiod-openshift-gateway-5677ccb49b-cr4vl\" (UID: \"61962eb0-8148-421e-92d1-dd63e2c7d0ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:18.257540 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:18.257505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:18.559714 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:56:18.559685    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61962eb0_8148_421e_92d1_dd63e2c7d0ff.slice/crio-6596244954da901c8d98880983ec16214cbf8d139ef0b7e08d8eecce2fd71069 WatchSource:0}: Error finding container 6596244954da901c8d98880983ec16214cbf8d139ef0b7e08d8eecce2fd71069: Status 404 returned error can't find the container with id 6596244954da901c8d98880983ec16214cbf8d139ef0b7e08d8eecce2fd71069
Sep 14 10:56:18.559860 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:18.559821    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"]
Sep 14 10:56:18.562580 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:18.562550    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 10:56:18.562677 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:18.562608    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 10:56:19.320243 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:19.320210    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl" event={"ID":"61962eb0-8148-421e-92d1-dd63e2c7d0ff","Type":"ContainerStarted","Data":"9105221dd9c2053868172becb596053ab495c41729879e4b072673c8b6edac1a"}
Sep 14 10:56:19.320640 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:19.320262    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl" event={"ID":"61962eb0-8148-421e-92d1-dd63e2c7d0ff","Type":"ContainerStarted","Data":"6596244954da901c8d98880983ec16214cbf8d139ef0b7e08d8eecce2fd71069"}
Sep 14 10:56:19.320640 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:19.320415    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:19.322140 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:19.322119    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-cr4vl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 10:56:19.322193 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:19.322163    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl" podUID="61962eb0-8148-421e-92d1-dd63e2c7d0ff" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 10:56:20.324970 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.324942    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl"
Sep 14 10:56:20.389969 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.389921    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl" podStartSLOduration=3.389905063 podStartE2EDuration="3.389905063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:56:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:56:19.60247732 +0000 UTC m=+439.583112825" watchObservedRunningTime="2026-09-14 10:56:20.389905063 +0000 UTC m=+440.370540568"
Sep 14 10:56:20.456675 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.456626    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"]
Sep 14 10:56:20.456892 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.456868    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5" podUID="8da0d03b-8693-4683-b3ae-2a0fa6483307" containerName="discovery" containerID="cri-o://97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac" gracePeriod=30
Sep 14 10:56:20.703980 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.703956    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:20.809325 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.809294    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-ca-configmap\") pod \"8da0d03b-8693-4683-b3ae-2a0fa6483307\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") "
Sep 14 10:56:20.809484 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.809356    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-kubeconfig\") pod \"8da0d03b-8693-4683-b3ae-2a0fa6483307\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") "
Sep 14 10:56:20.809484 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.809387    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-token\") pod \"8da0d03b-8693-4683-b3ae-2a0fa6483307\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") "
Sep 14 10:56:20.809484 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.809440    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-dns-cert\") pod \"8da0d03b-8693-4683-b3ae-2a0fa6483307\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") "
Sep 14 10:56:20.809484 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.809468    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l67nt\" (UniqueName: \"kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-kube-api-access-l67nt\") pod \"8da0d03b-8693-4683-b3ae-2a0fa6483307\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") "
Sep 14 10:56:20.809719 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.809498    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-cacerts\") pod \"8da0d03b-8693-4683-b3ae-2a0fa6483307\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") "
Sep 14 10:56:20.809719 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.809531    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8da0d03b-8693-4683-b3ae-2a0fa6483307-local-certs\") pod \"8da0d03b-8693-4683-b3ae-2a0fa6483307\" (UID: \"8da0d03b-8693-4683-b3ae-2a0fa6483307\") "
Sep 14 10:56:20.809821 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.809749    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "8da0d03b-8693-4683-b3ae-2a0fa6483307" (UID: "8da0d03b-8693-4683-b3ae-2a0fa6483307"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:56:20.811623 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.811594    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "8da0d03b-8693-4683-b3ae-2a0fa6483307" (UID: "8da0d03b-8693-4683-b3ae-2a0fa6483307"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:56:20.811623 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.811614    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "8da0d03b-8693-4683-b3ae-2a0fa6483307" (UID: "8da0d03b-8693-4683-b3ae-2a0fa6483307"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:56:20.814514 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.814489    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-cacerts" (OuterVolumeSpecName: "cacerts") pod "8da0d03b-8693-4683-b3ae-2a0fa6483307" (UID: "8da0d03b-8693-4683-b3ae-2a0fa6483307"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:56:20.814628 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.814524    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8da0d03b-8693-4683-b3ae-2a0fa6483307-local-certs" (OuterVolumeSpecName: "local-certs") pod "8da0d03b-8693-4683-b3ae-2a0fa6483307" (UID: "8da0d03b-8693-4683-b3ae-2a0fa6483307"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:56:20.814979 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.814955    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-token" (OuterVolumeSpecName: "istio-token") pod "8da0d03b-8693-4683-b3ae-2a0fa6483307" (UID: "8da0d03b-8693-4683-b3ae-2a0fa6483307"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:56:20.815060 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.814962    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-kube-api-access-l67nt" (OuterVolumeSpecName: "kube-api-access-l67nt") pod "8da0d03b-8693-4683-b3ae-2a0fa6483307" (UID: "8da0d03b-8693-4683-b3ae-2a0fa6483307"). InnerVolumeSpecName "kube-api-access-l67nt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:56:20.910546 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.910475    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-ca-configmap\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:56:20.910546 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.910503    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-kubeconfig\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:56:20.910546 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.910512    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:56:20.910546 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.910520    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-istio-csr-dns-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:56:20.910546 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.910528    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l67nt\" (UniqueName: \"kubernetes.io/projected/8da0d03b-8693-4683-b3ae-2a0fa6483307-kube-api-access-l67nt\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:56:20.910546 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.910536    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8da0d03b-8693-4683-b3ae-2a0fa6483307-cacerts\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:56:20.910546 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:20.910544    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8da0d03b-8693-4683-b3ae-2a0fa6483307-local-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:56:21.333922 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:21.333889    2576 generic.go:356] "Generic (PLEG): container finished" podID="8da0d03b-8693-4683-b3ae-2a0fa6483307" containerID="97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac" exitCode=0
Sep 14 10:56:21.334425 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:21.333959    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"
Sep 14 10:56:21.334425 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:21.333981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5" event={"ID":"8da0d03b-8693-4683-b3ae-2a0fa6483307","Type":"ContainerDied","Data":"97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac"}
Sep 14 10:56:21.334425 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:21.334053    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5" event={"ID":"8da0d03b-8693-4683-b3ae-2a0fa6483307","Type":"ContainerDied","Data":"26c3f8256bbe4d7717643ce5783c446d72dcb72ba3fa0f0ac44a83855a167217"}
Sep 14 10:56:21.334425 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:21.334074    2576 scope.go:117] "RemoveContainer" containerID="97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac"
Sep 14 10:56:21.343162 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:21.343146    2576 scope.go:117] "RemoveContainer" containerID="97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac"
Sep 14 10:56:21.343411 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:56:21.343391    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac\": container with ID starting with 97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac not found: ID does not exist" containerID="97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac"
Sep 14 10:56:21.343492 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:21.343418    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac"} err="failed to get container status \"97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac\": rpc error: code = NotFound desc = could not find container \"97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac\": container with ID starting with 97bcb8c4b2ad117177ab8e4b187eebf8b7e79c0699bd3cf51a25dbd34a34cdac not found: ID does not exist"
Sep 14 10:56:21.379839 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:21.379809    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"]
Sep 14 10:56:21.412991 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:21.412956    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5"]
Sep 14 10:56:22.558917 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:22.558883    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8da0d03b-8693-4683-b3ae-2a0fa6483307" path="/var/lib/kubelet/pods/8da0d03b-8693-4683-b3ae-2a0fa6483307/volumes"
Sep 14 10:56:26.736221 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:26.736136    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:27.001590 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.001522    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-78g92"]
Sep 14 10:56:27.001821 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.001808    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da0d03b-8693-4683-b3ae-2a0fa6483307" containerName="discovery"
Sep 14 10:56:27.001870 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.001823    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da0d03b-8693-4683-b3ae-2a0fa6483307" containerName="discovery"
Sep 14 10:56:27.001906 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.001877    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da0d03b-8693-4683-b3ae-2a0fa6483307" containerName="discovery"
Sep 14 10:56:27.004666 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.004638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92"
Sep 14 10:56:27.010681 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:56:27.010635    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-controller-manager-dockercfg-gsf2s\" is forbidden: User \"system:node:ip-10-0-142-201.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-201.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gsf2s\"" type="*v1.Secret"
Sep 14 10:56:27.010681 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:56:27.010662    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-142-201.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-201.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" type="*v1.Secret"
Sep 14 10:56:27.029554 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.029528    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-78g92"]
Sep 14 10:56:27.034393 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.034373    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:27.034863 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.034833    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"]
Sep 14 10:56:27.037690 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.037673    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"
Sep 14 10:56:27.040914 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.040898    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 14 10:56:27.041328 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.041314    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-87tdr\""
Sep 14 10:56:27.159438 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.159409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8x5g\" (UniqueName: \"kubernetes.io/projected/3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b-kube-api-access-q8x5g\") pod \"llmisvc-controller-manager-777c6bd7d5-vvfzx\" (UID: \"3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"
Sep 14 10:56:27.159566 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.159457    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vvfzx\" (UID: \"3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"
Sep 14 10:56:27.159566 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.159478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2c2p\" (UniqueName: \"kubernetes.io/projected/d1f93ddc-dd8e-4e72-a814-9e25c19c4fee-kube-api-access-b2c2p\") pod \"kserve-controller-manager-d6f4b65b8-78g92\" (UID: \"d1f93ddc-dd8e-4e72-a814-9e25c19c4fee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92"
Sep 14 10:56:27.159566 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.159543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1f93ddc-dd8e-4e72-a814-9e25c19c4fee-cert\") pod \"kserve-controller-manager-d6f4b65b8-78g92\" (UID: \"d1f93ddc-dd8e-4e72-a814-9e25c19c4fee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92"
Sep 14 10:56:27.225384 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.225356    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"]
Sep 14 10:56:27.260579 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.260518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vvfzx\" (UID: \"3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"
Sep 14 10:56:27.260579 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.260545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2c2p\" (UniqueName: \"kubernetes.io/projected/d1f93ddc-dd8e-4e72-a814-9e25c19c4fee-kube-api-access-b2c2p\") pod \"kserve-controller-manager-d6f4b65b8-78g92\" (UID: \"d1f93ddc-dd8e-4e72-a814-9e25c19c4fee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92"
Sep 14 10:56:27.260579 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.260570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1f93ddc-dd8e-4e72-a814-9e25c19c4fee-cert\") pod \"kserve-controller-manager-d6f4b65b8-78g92\" (UID: \"d1f93ddc-dd8e-4e72-a814-9e25c19c4fee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92"
Sep 14 10:56:27.260778 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.260616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8x5g\" (UniqueName: \"kubernetes.io/projected/3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b-kube-api-access-q8x5g\") pod \"llmisvc-controller-manager-777c6bd7d5-vvfzx\" (UID: \"3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"
Sep 14 10:56:27.261232 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:56:27.260984    2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 14 10:56:27.261347 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:56:27.261333    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b-cert podName:3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b nodeName:}" failed. No retries permitted until 2026-09-14 10:56:27.76131105 +0000 UTC m=+447.741946535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b-cert") pod "llmisvc-controller-manager-777c6bd7d5-vvfzx" (UID: "3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b") : secret "llmisvc-webhook-server-cert" not found
Sep 14 10:56:27.297818 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.297790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2c2p\" (UniqueName: \"kubernetes.io/projected/d1f93ddc-dd8e-4e72-a814-9e25c19c4fee-kube-api-access-b2c2p\") pod \"kserve-controller-manager-d6f4b65b8-78g92\" (UID: \"d1f93ddc-dd8e-4e72-a814-9e25c19c4fee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92"
Sep 14 10:56:27.301214 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.301188    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8x5g\" (UniqueName: \"kubernetes.io/projected/3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b-kube-api-access-q8x5g\") pod \"llmisvc-controller-manager-777c6bd7d5-vvfzx\" (UID: \"3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"
Sep 14 10:56:27.415999 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.415968    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:27.654302 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.654223    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:56:27.765878 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.765847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vvfzx\" (UID: \"3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"
Sep 14 10:56:27.768252 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.768232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vvfzx\" (UID: \"3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"
Sep 14 10:56:27.946195 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:27.946107    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"
Sep 14 10:56:28.179828 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:28.179799    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gsf2s\""
Sep 14 10:56:28.261998 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:56:28.261973    2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: failed to sync secret cache: timed out waiting for the condition
Sep 14 10:56:28.262135 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:56:28.262044    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1f93ddc-dd8e-4e72-a814-9e25c19c4fee-cert podName:d1f93ddc-dd8e-4e72-a814-9e25c19c4fee nodeName:}" failed. No retries permitted until 2026-09-14 10:56:28.762027838 +0000 UTC m=+448.742663325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d1f93ddc-dd8e-4e72-a814-9e25c19c4fee-cert") pod "kserve-controller-manager-d6f4b65b8-78g92" (UID: "d1f93ddc-dd8e-4e72-a814-9e25c19c4fee") : failed to sync secret cache: timed out waiting for the condition
Sep 14 10:56:28.359214 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:28.359184    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 14 10:56:28.427111 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:28.427083    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"]
Sep 14 10:56:28.431552 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:56:28.431526    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3897ecbc_c6ff_4ed7_bad7_15dbd3e0778b.slice/crio-adbb4fae6d4295b7767521dffbc611664c011927ad9dd007e077a23ffa2d09ee WatchSource:0}: Error finding container adbb4fae6d4295b7767521dffbc611664c011927ad9dd007e077a23ffa2d09ee: Status 404 returned error can't find the container with id adbb4fae6d4295b7767521dffbc611664c011927ad9dd007e077a23ffa2d09ee
Sep 14 10:56:28.775418 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:28.775386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1f93ddc-dd8e-4e72-a814-9e25c19c4fee-cert\") pod \"kserve-controller-manager-d6f4b65b8-78g92\" (UID: \"d1f93ddc-dd8e-4e72-a814-9e25c19c4fee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92"
Sep 14 10:56:28.777687 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:28.777668    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1f93ddc-dd8e-4e72-a814-9e25c19c4fee-cert\") pod \"kserve-controller-manager-d6f4b65b8-78g92\" (UID: \"d1f93ddc-dd8e-4e72-a814-9e25c19c4fee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92"
Sep 14 10:56:28.814745 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:28.814721    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92"
Sep 14 10:56:29.124280 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:29.124206    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-78g92"]
Sep 14 10:56:29.154016 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:56:29.153987    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f93ddc_dd8e_4e72_a814_9e25c19c4fee.slice/crio-5f33eb17109a4a88ab2e0dd530780ebb2b6f502c3baad1f8d2f6d9464182fac8 WatchSource:0}: Error finding container 5f33eb17109a4a88ab2e0dd530780ebb2b6f502c3baad1f8d2f6d9464182fac8: Status 404 returned error can't find the container with id 5f33eb17109a4a88ab2e0dd530780ebb2b6f502c3baad1f8d2f6d9464182fac8
Sep 14 10:56:29.367565 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:29.367531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92" event={"ID":"d1f93ddc-dd8e-4e72-a814-9e25c19c4fee","Type":"ContainerStarted","Data":"5f33eb17109a4a88ab2e0dd530780ebb2b6f502c3baad1f8d2f6d9464182fac8"}
Sep 14 10:56:29.368813 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:29.368782    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx" event={"ID":"3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b","Type":"ContainerStarted","Data":"adbb4fae6d4295b7767521dffbc611664c011927ad9dd007e077a23ffa2d09ee"}
Sep 14 10:56:32.384827 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:32.384791    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92" event={"ID":"d1f93ddc-dd8e-4e72-a814-9e25c19c4fee","Type":"ContainerStarted","Data":"f85f96b2608206c66f9c6a93649fdb830a7b943f9858170ef0636b4c838de1c6"}
Sep 14 10:56:32.387046 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:32.385349    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92"
Sep 14 10:56:32.391593 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:32.391567    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx" event={"ID":"3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b","Type":"ContainerStarted","Data":"621f201aedc844dddbdfc2998347d660b92bc1c2c8023e9586162ca0309e8551"}
Sep 14 10:56:32.391735 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:32.391691    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"
Sep 14 10:56:32.451825 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:32.451771    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92" podStartSLOduration=3.982192849 podStartE2EDuration="6.451755625s" totalImagesPullingTime="2.469562776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:56:32.450851533 +0000 UTC m=+452.431487037" watchObservedRunningTime="2026-09-14 10:56:32.451755625 +0000 UTC m=+452.432391129"
Sep 14 10:56:32.556955 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:56:32.556904    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx" podStartSLOduration=3.366405329 podStartE2EDuration="6.556887743s" totalImagesPullingTime="3.190482414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:56:32.549066183 +0000 UTC m=+452.529701684" watchObservedRunningTime="2026-09-14 10:56:32.556887743 +0000 UTC m=+452.537523247"
Sep 14 10:57:03.397769 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:03.397735    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvfzx"
Sep 14 10:57:03.401194 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:03.401170    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-78g92"
Sep 14 10:57:09.887934 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:09.887898    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:10.102456 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:10.102422    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:37.993708 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:37.993671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:40.440895 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:40.440863    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:40.814220 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:40.814190    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:42.845724 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:42.845689    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sddzr"]
Sep 14 10:57:42.852773 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:42.852744    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-sddzr"
Sep 14 10:57:42.858369 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:42.858343    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 14 10:57:42.858369 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:42.858356    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 14 10:57:42.858893 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:42.858871    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rlzm6\""
Sep 14 10:57:42.859157 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:42.859119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57blr\" (UniqueName: \"kubernetes.io/projected/e01163d9-fb22-410a-afe7-1aeb94e81fe8-kube-api-access-57blr\") pod \"authorino-operator-76b478bd78-sddzr\" (UID: \"e01163d9-fb22-410a-afe7-1aeb94e81fe8\") " pod="kuadrant-system/authorino-operator-76b478bd78-sddzr"
Sep 14 10:57:42.959923 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:42.959894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57blr\" (UniqueName: \"kubernetes.io/projected/e01163d9-fb22-410a-afe7-1aeb94e81fe8-kube-api-access-57blr\") pod \"authorino-operator-76b478bd78-sddzr\" (UID: \"e01163d9-fb22-410a-afe7-1aeb94e81fe8\") " pod="kuadrant-system/authorino-operator-76b478bd78-sddzr"
Sep 14 10:57:42.980745 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:42.980718    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sddzr"]
Sep 14 10:57:42.983395 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:42.983368    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57blr\" (UniqueName: \"kubernetes.io/projected/e01163d9-fb22-410a-afe7-1aeb94e81fe8-kube-api-access-57blr\") pod \"authorino-operator-76b478bd78-sddzr\" (UID: \"e01163d9-fb22-410a-afe7-1aeb94e81fe8\") " pod="kuadrant-system/authorino-operator-76b478bd78-sddzr"
Sep 14 10:57:43.162734 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:43.162630    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-sddzr"
Sep 14 10:57:43.195761 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:43.195720    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:43.358598 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:43.358569    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:43.441181 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:43.441158    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sddzr"]
Sep 14 10:57:43.443686 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:57:43.443662    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01163d9_fb22_410a_afe7_1aeb94e81fe8.slice/crio-ab0fb8d1040793e19f072e9a2c3cf691b4a28a244b1a93448f2d86f3227511d4 WatchSource:0}: Error finding container ab0fb8d1040793e19f072e9a2c3cf691b4a28a244b1a93448f2d86f3227511d4: Status 404 returned error can't find the container with id ab0fb8d1040793e19f072e9a2c3cf691b4a28a244b1a93448f2d86f3227511d4
Sep 14 10:57:43.663091 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:43.663056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-sddzr" event={"ID":"e01163d9-fb22-410a-afe7-1aeb94e81fe8","Type":"ContainerStarted","Data":"ab0fb8d1040793e19f072e9a2c3cf691b4a28a244b1a93448f2d86f3227511d4"}
Sep 14 10:57:44.690266 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:44.690234    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:45.496408 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:45.496375    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:45.615060 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:45.615028    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:46.223224 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:46.223147    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:46.678495 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:46.678456    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-sddzr" event={"ID":"e01163d9-fb22-410a-afe7-1aeb94e81fe8","Type":"ContainerStarted","Data":"470efbda92dc466749baad7ed2998c7409f108b06d142e35bfdb92c51394f3a3"}
Sep 14 10:57:46.678698 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:46.678534    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-sddzr"
Sep 14 10:57:46.712397 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:46.712370    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:46.961017 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:46.960936    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:47.177245 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:47.177217    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:52.055260 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:52.055230    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:52.210352 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:52.210317    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:54.572331 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:54.572251    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:55.806223 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:55.806191    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:55.915164 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:55.915136    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:56.223419 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:56.223332    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:56.399993 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:56.399957    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:57.684281 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:57.684249    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-sddzr"
Sep 14 10:57:57.714178 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:57.714121    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-sddzr" podStartSLOduration=13.387572314 podStartE2EDuration="15.714105574s" totalImagesPullingTime="2.32653326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:57:46.743171519 +0000 UTC m=+526.723807024" watchObservedRunningTime="2026-09-14 10:57:57.714105574 +0000 UTC m=+537.694741079"
Sep 14 10:57:57.947039 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:57.946961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:58.467021 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:58.466988    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:59.230354 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:59.230322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:57:59.365506 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:57:59.365479    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:00.228333 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:00.228294    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:00.430418 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:00.430391    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:04.147283 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:04.147246    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:04.653984 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:04.653952    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:04.775423 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:04.775394    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:04.901893 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:04.901863    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:07.764702 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:07.764638    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:07.902617 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:07.902587    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:08.635180 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.635141    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"]
Sep 14 10:58:08.641907 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.641881    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:08.644638 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.644619    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bh4bq\""
Sep 14 10:58:08.663895 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.663870    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"]
Sep 14 10:58:08.693614 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.693578    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:08.763572 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.763545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq54g\" (UniqueName: \"kubernetes.io/projected/753fff3c-b968-401e-bc13-3397565041bf-kube-api-access-gq54g\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-hhx7v\" (UID: \"753fff3c-b968-401e-bc13-3397565041bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:08.763746 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.763581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/753fff3c-b968-401e-bc13-3397565041bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-hhx7v\" (UID: \"753fff3c-b968-401e-bc13-3397565041bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:08.864606 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.864571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq54g\" (UniqueName: \"kubernetes.io/projected/753fff3c-b968-401e-bc13-3397565041bf-kube-api-access-gq54g\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-hhx7v\" (UID: \"753fff3c-b968-401e-bc13-3397565041bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:08.864606 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.864615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/753fff3c-b968-401e-bc13-3397565041bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-hhx7v\" (UID: \"753fff3c-b968-401e-bc13-3397565041bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:08.865041 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.864946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/753fff3c-b968-401e-bc13-3397565041bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-hhx7v\" (UID: \"753fff3c-b968-401e-bc13-3397565041bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:08.880240 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.880209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq54g\" (UniqueName: \"kubernetes.io/projected/753fff3c-b968-401e-bc13-3397565041bf-kube-api-access-gq54g\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-hhx7v\" (UID: \"753fff3c-b968-401e-bc13-3397565041bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:08.951400 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:08.951320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:09.004502 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.004413    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"]
Sep 14 10:58:09.013616 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.013564    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"]
Sep 14 10:58:09.036821 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.036794    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"]
Sep 14 10:58:09.041767 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.041745    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:09.061318 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.061284    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"]
Sep 14 10:58:09.167600 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.167564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw9l6\" (UniqueName: \"kubernetes.io/projected/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-kube-api-access-zw9l6\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-zhfbs\" (UID: \"d4e79785-1ff4-4b2a-8585-ccbcc05e8101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:09.167803 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.167612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-zhfbs\" (UID: \"d4e79785-1ff4-4b2a-8585-ccbcc05e8101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:09.268298 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.268269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-zhfbs\" (UID: \"d4e79785-1ff4-4b2a-8585-ccbcc05e8101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:09.268446 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.268341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw9l6\" (UniqueName: \"kubernetes.io/projected/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-kube-api-access-zw9l6\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-zhfbs\" (UID: \"d4e79785-1ff4-4b2a-8585-ccbcc05e8101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:09.268717 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.268700    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-zhfbs\" (UID: \"d4e79785-1ff4-4b2a-8585-ccbcc05e8101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:09.279679 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.279642    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw9l6\" (UniqueName: \"kubernetes.io/projected/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-kube-api-access-zw9l6\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-zhfbs\" (UID: \"d4e79785-1ff4-4b2a-8585-ccbcc05e8101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:09.330468 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:58:09.330434    2576 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 14 10:58:09.330468 ip-10-0-142-201 kubenswrapper[2576]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-hhx7v_kuadrant-system_753fff3c-b968-401e-bc13-3397565041bf_0(2ceda152ca5caa7b21666eae60429468857ba29f745499f68fe7c8328722eb91): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-hhx7v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"2ceda152ca5caa7b21666eae60429468857ba29f745499f68fe7c8328722eb91" Netns:"/var/run/netns/8c97b9e3-11fa-4dcc-bcac-9d005363c45f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-hhx7v;K8S_POD_INFRA_CONTAINER_ID=2ceda152ca5caa7b21666eae60429468857ba29f745499f68fe7c8328722eb91;K8S_POD_UID=753fff3c-b968-401e-bc13-3397565041bf" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v/753fff3c-b968-401e-bc13-3397565041bf:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v 2ceda152ca5caa7b21666eae60429468857ba29f745499f68fe7c8328722eb91 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:17 [10.134.0.23/23]
Sep 14 10:58:09.330468 ip-10-0-142-201 kubenswrapper[2576]:         '
Sep 14 10:58:09.330468 ip-10-0-142-201 kubenswrapper[2576]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 14 10:58:09.330468 ip-10-0-142-201 kubenswrapper[2576]:  >
Sep 14 10:58:09.330668 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:58:09.330496    2576 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 14 10:58:09.330668 ip-10-0-142-201 kubenswrapper[2576]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-hhx7v_kuadrant-system_753fff3c-b968-401e-bc13-3397565041bf_0(2ceda152ca5caa7b21666eae60429468857ba29f745499f68fe7c8328722eb91): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-hhx7v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"2ceda152ca5caa7b21666eae60429468857ba29f745499f68fe7c8328722eb91" Netns:"/var/run/netns/8c97b9e3-11fa-4dcc-bcac-9d005363c45f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-hhx7v;K8S_POD_INFRA_CONTAINER_ID=2ceda152ca5caa7b21666eae60429468857ba29f745499f68fe7c8328722eb91;K8S_POD_UID=753fff3c-b968-401e-bc13-3397565041bf" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v/753fff3c-b968-401e-bc13-3397565041bf:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v 2ceda152ca5caa7b21666eae60429468857ba29f745499f68fe7c8328722eb91 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:17 [10.134.0.23/23]
Sep 14 10:58:09.330668 ip-10-0-142-201 kubenswrapper[2576]:         '
Sep 14 10:58:09.330668 ip-10-0-142-201 kubenswrapper[2576]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 14 10:58:09.330668 ip-10-0-142-201 kubenswrapper[2576]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:09.355899 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.355875    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:09.637323 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.637298    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"]
Sep 14 10:58:09.639904 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:58:09.639875    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e79785_1ff4_4b2a_8585_ccbcc05e8101.slice/crio-0c7595ffecb3d81be8e12ef5a8f518be307dccf827b1378f2790fa3a5fe58017 WatchSource:0}: Error finding container 0c7595ffecb3d81be8e12ef5a8f518be307dccf827b1378f2790fa3a5fe58017: Status 404 returned error can't find the container with id 0c7595ffecb3d81be8e12ef5a8f518be307dccf827b1378f2790fa3a5fe58017
Sep 14 10:58:09.776101 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.776072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs" event={"ID":"d4e79785-1ff4-4b2a-8585-ccbcc05e8101","Type":"ContainerStarted","Data":"0c7595ffecb3d81be8e12ef5a8f518be307dccf827b1378f2790fa3a5fe58017"}
Sep 14 10:58:09.776101 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.776094    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:09.778328 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:58:09.778301    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-hhx7v\" is forbidden: User \"system:node:ip-10-0-142-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-201.ec2.internal' and this object" podUID="753fff3c-b968-401e-bc13-3397565041bf" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:09.784987 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.784969    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:09.787044 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:58:09.787022    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-hhx7v\" is forbidden: User \"system:node:ip-10-0-142-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-201.ec2.internal' and this object" podUID="753fff3c-b968-401e-bc13-3397565041bf" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:09.873623 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.873593    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/753fff3c-b968-401e-bc13-3397565041bf-extensions-socket-volume\") pod \"753fff3c-b968-401e-bc13-3397565041bf\" (UID: \"753fff3c-b968-401e-bc13-3397565041bf\") "
Sep 14 10:58:09.874045 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.873636    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq54g\" (UniqueName: \"kubernetes.io/projected/753fff3c-b968-401e-bc13-3397565041bf-kube-api-access-gq54g\") pod \"753fff3c-b968-401e-bc13-3397565041bf\" (UID: \"753fff3c-b968-401e-bc13-3397565041bf\") "
Sep 14 10:58:09.874045 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.873862    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/753fff3c-b968-401e-bc13-3397565041bf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "753fff3c-b968-401e-bc13-3397565041bf" (UID: "753fff3c-b968-401e-bc13-3397565041bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:58:09.874045 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.873930    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/753fff3c-b968-401e-bc13-3397565041bf-extensions-socket-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:58:09.875736 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.875718    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753fff3c-b968-401e-bc13-3397565041bf-kube-api-access-gq54g" (OuterVolumeSpecName: "kube-api-access-gq54g") pod "753fff3c-b968-401e-bc13-3397565041bf" (UID: "753fff3c-b968-401e-bc13-3397565041bf"). InnerVolumeSpecName "kube-api-access-gq54g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:58:09.974321 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:09.974247    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq54g\" (UniqueName: \"kubernetes.io/projected/753fff3c-b968-401e-bc13-3397565041bf-kube-api-access-gq54g\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:58:10.561004 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:58:10.560959    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-hhx7v\" is forbidden: User \"system:node:ip-10-0-142-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-201.ec2.internal' and this object" podUID="753fff3c-b968-401e-bc13-3397565041bf" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:10.562434 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:10.562400    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="753fff3c-b968-401e-bc13-3397565041bf" path="/var/lib/kubelet/pods/753fff3c-b968-401e-bc13-3397565041bf/volumes"
Sep 14 10:58:10.781324 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:10.781295    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:10.786119 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:58:10.786083    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-hhx7v\" is forbidden: User \"system:node:ip-10-0-142-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-201.ec2.internal' and this object" podUID="753fff3c-b968-401e-bc13-3397565041bf" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-hhx7v"
Sep 14 10:58:11.517356 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:11.517316    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:11.679685 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:11.679620    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:13.798185 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:13.798149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs" event={"ID":"d4e79785-1ff4-4b2a-8585-ccbcc05e8101","Type":"ContainerStarted","Data":"6a286f96cf28f91588753db7b70f719f48de8f711a3cc3094817af12e9d894ec"}
Sep 14 10:58:13.798581 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:13.798301    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:14.937856 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:14.937821    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:15.038718 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:15.038684    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:15.165351 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:15.165316    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:15.273478 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:15.273449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:17.933957 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:17.933930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:18.035183 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:18.035143    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:24.429077 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:24.429037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:24.526461 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:24.526427    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:24.617209 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:24.617175    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:24.805330 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:24.805300    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:24.827665 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:24.827601    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs" podStartSLOduration=12.398690254 podStartE2EDuration="15.827581729s" totalImagesPullingTime="3.428891475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:58:13.823489004 +0000 UTC m=+553.804124510" watchObservedRunningTime="2026-09-14 10:58:24.827581729 +0000 UTC m=+564.808217236"
Sep 14 10:58:37.720981 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:37.720943    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"]
Sep 14 10:58:37.721376 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:37.721136    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs" podUID="d4e79785-1ff4-4b2a-8585-ccbcc05e8101" containerName="manager" containerID="cri-o://6a286f96cf28f91588753db7b70f719f48de8f711a3cc3094817af12e9d894ec" gracePeriod=10
Sep 14 10:58:37.896269 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:37.896181    2576 generic.go:356] "Generic (PLEG): container finished" podID="d4e79785-1ff4-4b2a-8585-ccbcc05e8101" containerID="6a286f96cf28f91588753db7b70f719f48de8f711a3cc3094817af12e9d894ec" exitCode=0
Sep 14 10:58:37.896415 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:37.896278    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs" event={"ID":"d4e79785-1ff4-4b2a-8585-ccbcc05e8101","Type":"ContainerDied","Data":"6a286f96cf28f91588753db7b70f719f48de8f711a3cc3094817af12e9d894ec"}
Sep 14 10:58:37.957622 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:37.957600    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:38.108883 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:38.108845    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-extensions-socket-volume\") pod \"d4e79785-1ff4-4b2a-8585-ccbcc05e8101\" (UID: \"d4e79785-1ff4-4b2a-8585-ccbcc05e8101\") "
Sep 14 10:58:38.109068 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:38.108889    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw9l6\" (UniqueName: \"kubernetes.io/projected/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-kube-api-access-zw9l6\") pod \"d4e79785-1ff4-4b2a-8585-ccbcc05e8101\" (UID: \"d4e79785-1ff4-4b2a-8585-ccbcc05e8101\") "
Sep 14 10:58:38.109372 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:38.109338    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d4e79785-1ff4-4b2a-8585-ccbcc05e8101" (UID: "d4e79785-1ff4-4b2a-8585-ccbcc05e8101"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:58:38.111106 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:38.111079    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-kube-api-access-zw9l6" (OuterVolumeSpecName: "kube-api-access-zw9l6") pod "d4e79785-1ff4-4b2a-8585-ccbcc05e8101" (UID: "d4e79785-1ff4-4b2a-8585-ccbcc05e8101"). InnerVolumeSpecName "kube-api-access-zw9l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:58:38.210324 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:38.210279    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-extensions-socket-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:58:38.210324 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:38.210319    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw9l6\" (UniqueName: \"kubernetes.io/projected/d4e79785-1ff4-4b2a-8585-ccbcc05e8101-kube-api-access-zw9l6\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:58:38.901831 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:38.901751    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"
Sep 14 10:58:38.901831 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:38.901780    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs" event={"ID":"d4e79785-1ff4-4b2a-8585-ccbcc05e8101","Type":"ContainerDied","Data":"0c7595ffecb3d81be8e12ef5a8f518be307dccf827b1378f2790fa3a5fe58017"}
Sep 14 10:58:38.902355 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:38.901851    2576 scope.go:117] "RemoveContainer" containerID="6a286f96cf28f91588753db7b70f719f48de8f711a3cc3094817af12e9d894ec"
Sep 14 10:58:38.921700 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:38.921676    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"]
Sep 14 10:58:38.927408 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:38.927386    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-zhfbs"]
Sep 14 10:58:40.562337 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:40.562306    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4e79785-1ff4-4b2a-8585-ccbcc05e8101" path="/var/lib/kubelet/pods/d4e79785-1ff4-4b2a-8585-ccbcc05e8101/volumes"
Sep 14 10:58:41.335151 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.335124    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"]
Sep 14 10:58:41.335426 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.335412    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e79785-1ff4-4b2a-8585-ccbcc05e8101" containerName="manager"
Sep 14 10:58:41.335426 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.335425    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e79785-1ff4-4b2a-8585-ccbcc05e8101" containerName="manager"
Sep 14 10:58:41.335523 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.335482    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e79785-1ff4-4b2a-8585-ccbcc05e8101" containerName="manager"
Sep 14 10:58:41.339728 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.339710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.342721 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.342695    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6bk2t\""
Sep 14 10:58:41.434752 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.434675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tszfk\" (UniqueName: \"kubernetes.io/projected/48062ff1-770b-4639-a806-4c17831a46cf-kube-api-access-tszfk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.434752 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.434721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.434752 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.434737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48062ff1-770b-4639-a806-4c17831a46cf-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.434752 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.434753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.435054 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.434767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48062ff1-770b-4639-a806-4c17831a46cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.435054 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.434859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48062ff1-770b-4639-a806-4c17831a46cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.435054 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.434912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.435054 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.434940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.435054 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.434966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.446813 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.446788    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"]
Sep 14 10:58:41.535606 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.535573    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48062ff1-770b-4639-a806-4c17831a46cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.535790 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.535620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.535790 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.535639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.535790 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.535687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.535790 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.535734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tszfk\" (UniqueName: \"kubernetes.io/projected/48062ff1-770b-4639-a806-4c17831a46cf-kube-api-access-tszfk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.535966 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.535873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.535966 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.535912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48062ff1-770b-4639-a806-4c17831a46cf-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.535966 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.535942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.536115 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.535966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48062ff1-770b-4639-a806-4c17831a46cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.536240 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.536178    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.536385 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.536283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.536385 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.536292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.536385 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.536377    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.536644 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.536624    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48062ff1-770b-4639-a806-4c17831a46cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.538293 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.538275    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48062ff1-770b-4639-a806-4c17831a46cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.538377 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.538290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48062ff1-770b-4639-a806-4c17831a46cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.564002 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.563972    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tszfk\" (UniqueName: \"kubernetes.io/projected/48062ff1-770b-4639-a806-4c17831a46cf-kube-api-access-tszfk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.566807 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.566785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48062ff1-770b-4639-a806-4c17831a46cf-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-82wsv\" (UID: \"48062ff1-770b-4639-a806-4c17831a46cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.575643 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.575622    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:41.648748 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.648714    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:41.764323 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.764294    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:41.926486 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:41.926462    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"]
Sep 14 10:58:41.928738 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:58:41.928708    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48062ff1_770b_4639_a806_4c17831a46cf.slice/crio-528606fa13f2c272922730a6769958a90a8497f5c43d9e61493d0222a6e7c818 WatchSource:0}: Error finding container 528606fa13f2c272922730a6769958a90a8497f5c43d9e61493d0222a6e7c818: Status 404 returned error can't find the container with id 528606fa13f2c272922730a6769958a90a8497f5c43d9e61493d0222a6e7c818
Sep 14 10:58:42.922521 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:42.922484    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv" event={"ID":"48062ff1-770b-4639-a806-4c17831a46cf","Type":"ContainerStarted","Data":"528606fa13f2c272922730a6769958a90a8497f5c43d9e61493d0222a6e7c818"}
Sep 14 10:58:44.655562 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:44.655522    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 10:58:44.655932 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:44.655612    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 10:58:44.655932 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:44.655685    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 10:58:44.934947 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:44.934862    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv" event={"ID":"48062ff1-770b-4639-a806-4c17831a46cf","Type":"ContainerStarted","Data":"bd982e9e3b1a3178b6fb1b38a7e5c9ae4079768932207d178554477ea42ba9bb"}
Sep 14 10:58:44.956491 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:44.956442    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv" podStartSLOduration=1.23177054 podStartE2EDuration="3.956425983s" totalImagesPullingTime="2.724655443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:58:44.955367977 +0000 UTC m=+584.936003481" watchObservedRunningTime="2026-09-14 10:58:44.956425983 +0000 UTC m=+584.937061488"
Sep 14 10:58:45.649294 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:45.649264    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:45.653828 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:45.653806    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:45.939507 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:45.939432    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:45.940296 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:45.940277    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 10:58:53.136493 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:53.136456    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:53.390060 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:53.389984    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:56.464874 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:56.464840    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:57.631258 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:57.631224    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:57.762905 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:57.762872    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:57.857666 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:57.857627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:58.467738 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:58.467708    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rxzbt"]
Sep 14 10:58:58.470804 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:58.470784    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt"
Sep 14 10:58:58.473176 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:58.473155    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wvnh6\""
Sep 14 10:58:58.479134 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:58.479113    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rxzbt"]
Sep 14 10:58:58.498832 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:58.498801    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:58.567518 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:58.567490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9jds\" (UniqueName: \"kubernetes.io/projected/62f4650a-7a47-4c01-833d-45f426240fd3-kube-api-access-h9jds\") pod \"authorino-7bcfd8f9cd-rxzbt\" (UID: \"62f4650a-7a47-4c01-833d-45f426240fd3\") " pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt"
Sep 14 10:58:58.600175 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:58.600139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:58:58.668195 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:58.668168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9jds\" (UniqueName: \"kubernetes.io/projected/62f4650a-7a47-4c01-833d-45f426240fd3-kube-api-access-h9jds\") pod \"authorino-7bcfd8f9cd-rxzbt\" (UID: \"62f4650a-7a47-4c01-833d-45f426240fd3\") " pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt"
Sep 14 10:58:58.687071 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:58.687039    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9jds\" (UniqueName: \"kubernetes.io/projected/62f4650a-7a47-4c01-833d-45f426240fd3-kube-api-access-h9jds\") pod \"authorino-7bcfd8f9cd-rxzbt\" (UID: \"62f4650a-7a47-4c01-833d-45f426240fd3\") " pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt"
Sep 14 10:58:58.780241 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:58.780217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt"
Sep 14 10:58:59.049310 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:58:59.049290    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rxzbt"]
Sep 14 10:58:59.051338 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:58:59.051308    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62f4650a_7a47_4c01_833d_45f426240fd3.slice/crio-41f6316b50221114b02c2cd3b84a47e2195b5f9e1747dc1636705f08dc62a611 WatchSource:0}: Error finding container 41f6316b50221114b02c2cd3b84a47e2195b5f9e1747dc1636705f08dc62a611: Status 404 returned error can't find the container with id 41f6316b50221114b02c2cd3b84a47e2195b5f9e1747dc1636705f08dc62a611
Sep 14 10:59:00.002117 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:00.002083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt" event={"ID":"62f4650a-7a47-4c01-833d-45f426240fd3","Type":"ContainerStarted","Data":"41f6316b50221114b02c2cd3b84a47e2195b5f9e1747dc1636705f08dc62a611"}
Sep 14 10:59:02.011788 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:02.011752    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt" event={"ID":"62f4650a-7a47-4c01-833d-45f426240fd3","Type":"ContainerStarted","Data":"3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd"}
Sep 14 10:59:02.029636 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:02.029586    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt" podStartSLOduration=2.090578292 podStartE2EDuration="4.02957201s" totalImagesPullingTime="1.938993718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:59:02.02780706 +0000 UTC m=+602.008442576" watchObservedRunningTime="2026-09-14 10:59:02.02957201 +0000 UTC m=+602.010207512"
Sep 14 10:59:02.608903 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:02.608862    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rxzbt"]
Sep 14 10:59:04.020933 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:04.020878    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt" podUID="62f4650a-7a47-4c01-833d-45f426240fd3" containerName="authorino" containerID="cri-o://3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd" gracePeriod=30
Sep 14 10:59:04.261695 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:04.261672    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt"
Sep 14 10:59:04.308671 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:04.308563    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9jds\" (UniqueName: \"kubernetes.io/projected/62f4650a-7a47-4c01-833d-45f426240fd3-kube-api-access-h9jds\") pod \"62f4650a-7a47-4c01-833d-45f426240fd3\" (UID: \"62f4650a-7a47-4c01-833d-45f426240fd3\") "
Sep 14 10:59:04.310615 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:04.310588    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62f4650a-7a47-4c01-833d-45f426240fd3-kube-api-access-h9jds" (OuterVolumeSpecName: "kube-api-access-h9jds") pod "62f4650a-7a47-4c01-833d-45f426240fd3" (UID: "62f4650a-7a47-4c01-833d-45f426240fd3"). InnerVolumeSpecName "kube-api-access-h9jds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:59:04.409540 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:04.409512    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9jds\" (UniqueName: \"kubernetes.io/projected/62f4650a-7a47-4c01-833d-45f426240fd3-kube-api-access-h9jds\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:59:05.025790 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:05.025754    2576 generic.go:356] "Generic (PLEG): container finished" podID="62f4650a-7a47-4c01-833d-45f426240fd3" containerID="3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd" exitCode=0
Sep 14 10:59:05.025790 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:05.025794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt" event={"ID":"62f4650a-7a47-4c01-833d-45f426240fd3","Type":"ContainerDied","Data":"3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd"}
Sep 14 10:59:05.026291 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:05.025796    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt"
Sep 14 10:59:05.026291 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:05.025841    2576 scope.go:117] "RemoveContainer" containerID="3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd"
Sep 14 10:59:05.026291 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:05.025826    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rxzbt" event={"ID":"62f4650a-7a47-4c01-833d-45f426240fd3","Type":"ContainerDied","Data":"41f6316b50221114b02c2cd3b84a47e2195b5f9e1747dc1636705f08dc62a611"}
Sep 14 10:59:05.033931 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:05.033913    2576 scope.go:117] "RemoveContainer" containerID="3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd"
Sep 14 10:59:05.034209 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:59:05.034188    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd\": container with ID starting with 3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd not found: ID does not exist" containerID="3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd"
Sep 14 10:59:05.034248 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:05.034218    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd"} err="failed to get container status \"3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd\": rpc error: code = NotFound desc = could not find container \"3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd\": container with ID starting with 3a4d9d54bcb940709bb4fcaf773aa8fc6ba16ccf6c3f783833e46f33dde38ebd not found: ID does not exist"
Sep 14 10:59:05.041568 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:05.041545    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rxzbt"]
Sep 14 10:59:05.045494 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:05.045469    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rxzbt"]
Sep 14 10:59:06.558910 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:06.558879    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62f4650a-7a47-4c01-833d-45f426240fd3" path="/var/lib/kubelet/pods/62f4650a-7a47-4c01-833d-45f426240fd3/volumes"
Sep 14 10:59:17.405554 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:17.405505    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:17.500474 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:17.500440    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:17.929054 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:17.929022    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:26.989445 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:26.989367    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:28.475359 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:28.475322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:33.555079 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.555044    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:33.591541 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.591515    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-697f579975-sn5fh"]
Sep 14 10:59:33.592166 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.592142    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f4650a-7a47-4c01-833d-45f426240fd3" containerName="authorino"
Sep 14 10:59:33.592334 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.592310    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f4650a-7a47-4c01-833d-45f426240fd3" containerName="authorino"
Sep 14 10:59:33.592464 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.592452    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="62f4650a-7a47-4c01-833d-45f426240fd3" containerName="authorino"
Sep 14 10:59:33.596451 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.596422    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:33.599305 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.599280    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 14 10:59:33.599580 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.599561    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 14 10:59:33.599866 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.599842    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 14 10:59:33.600150 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.600134    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lv5gj\""
Sep 14 10:59:33.611862 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.611837    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-697f579975-sn5fh"]
Sep 14 10:59:33.668216 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.668188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:33.733268 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.733240    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:33.750352 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.750326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-metrics-certs\") pod \"maas-controller-697f579975-sn5fh\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") " pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:33.750476 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.750360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert\") pod \"maas-controller-697f579975-sn5fh\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") " pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:33.750476 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.750459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvcmb\" (UniqueName: \"kubernetes.io/projected/84c3d3d1-0819-4b4f-b724-3efacb2b018b-kube-api-access-jvcmb\") pod \"maas-controller-697f579975-sn5fh\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") " pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:33.789986 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.789956    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-785cb4f769-2th6n"]
Sep 14 10:59:33.794096 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.794078    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:33.806091 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.806033    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785cb4f769-2th6n"]
Sep 14 10:59:33.811933 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.811914    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:33.851520 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.851496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvcmb\" (UniqueName: \"kubernetes.io/projected/84c3d3d1-0819-4b4f-b724-3efacb2b018b-kube-api-access-jvcmb\") pod \"maas-controller-697f579975-sn5fh\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") " pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:33.851628 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.851533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-metrics-certs\") pod \"maas-controller-697f579975-sn5fh\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") " pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:33.851812 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.851781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert\") pod \"maas-controller-697f579975-sn5fh\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") " pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:33.851880 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:59:33.851870    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 14 10:59:33.851944 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:59:33.851933    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert podName:84c3d3d1-0819-4b4f-b724-3efacb2b018b nodeName:}" failed. No retries permitted until 2026-09-14 10:59:34.351917226 +0000 UTC m=+634.332552712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert") pod "maas-controller-697f579975-sn5fh" (UID: "84c3d3d1-0819-4b4f-b724-3efacb2b018b") : secret "maas-controller-webhook-cert" not found
Sep 14 10:59:33.854102 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.854080    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-metrics-certs\") pod \"maas-controller-697f579975-sn5fh\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") " pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:33.859920 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.859902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvcmb\" (UniqueName: \"kubernetes.io/projected/84c3d3d1-0819-4b4f-b724-3efacb2b018b-kube-api-access-jvcmb\") pod \"maas-controller-697f579975-sn5fh\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") " pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:33.952402 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.952370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-webhook-cert\") pod \"maas-controller-785cb4f769-2th6n\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") " pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:33.952402 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.952401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-metrics-certs\") pod \"maas-controller-785cb4f769-2th6n\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") " pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:33.952592 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:33.952427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwr4h\" (UniqueName: \"kubernetes.io/projected/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-kube-api-access-bwr4h\") pod \"maas-controller-785cb4f769-2th6n\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") " pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:34.053244 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:34.053207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-webhook-cert\") pod \"maas-controller-785cb4f769-2th6n\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") " pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:34.053244 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:34.053242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-metrics-certs\") pod \"maas-controller-785cb4f769-2th6n\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") " pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:34.053455 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:34.053269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwr4h\" (UniqueName: \"kubernetes.io/projected/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-kube-api-access-bwr4h\") pod \"maas-controller-785cb4f769-2th6n\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") " pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:34.053455 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:59:34.053364    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 14 10:59:34.053455 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:59:34.053451    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-webhook-cert podName:fd91e556-008b-4c2e-bf8f-1dc99e23c7b8 nodeName:}" failed. No retries permitted until 2026-09-14 10:59:34.553431547 +0000 UTC m=+634.534067033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-webhook-cert") pod "maas-controller-785cb4f769-2th6n" (UID: "fd91e556-008b-4c2e-bf8f-1dc99e23c7b8") : secret "maas-controller-webhook-cert" not found
Sep 14 10:59:34.055716 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:34.055697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-metrics-certs\") pod \"maas-controller-785cb4f769-2th6n\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") " pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:34.072003 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:34.071945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwr4h\" (UniqueName: \"kubernetes.io/projected/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-kube-api-access-bwr4h\") pod \"maas-controller-785cb4f769-2th6n\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") " pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:34.355446 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:34.355370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert\") pod \"maas-controller-697f579975-sn5fh\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") " pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:34.355579 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:59:34.355515    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 14 10:59:34.355618 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:59:34.355582    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert podName:84c3d3d1-0819-4b4f-b724-3efacb2b018b nodeName:}" failed. No retries permitted until 2026-09-14 10:59:35.355565055 +0000 UTC m=+635.336200542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert") pod "maas-controller-697f579975-sn5fh" (UID: "84c3d3d1-0819-4b4f-b724-3efacb2b018b") : secret "maas-controller-webhook-cert" not found
Sep 14 10:59:34.556416 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:34.556386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-webhook-cert\") pod \"maas-controller-785cb4f769-2th6n\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") " pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:34.558761 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:34.558734    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-webhook-cert\") pod \"maas-controller-785cb4f769-2th6n\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") " pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:34.567320 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:34.567296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:34.703858 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:34.703776    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:34.975222 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:34.975182    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785cb4f769-2th6n"]
Sep 14 10:59:34.977323 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:59:34.977294    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd91e556_008b_4c2e_bf8f_1dc99e23c7b8.slice/crio-ce034a4672ed14999ef2b39e3b7f28f3500e78b65db4a0ab7323096b6b9e6de6 WatchSource:0}: Error finding container ce034a4672ed14999ef2b39e3b7f28f3500e78b65db4a0ab7323096b6b9e6de6: Status 404 returned error can't find the container with id ce034a4672ed14999ef2b39e3b7f28f3500e78b65db4a0ab7323096b6b9e6de6
Sep 14 10:59:35.147028 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:35.146997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785cb4f769-2th6n" event={"ID":"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8","Type":"ContainerStarted","Data":"ce034a4672ed14999ef2b39e3b7f28f3500e78b65db4a0ab7323096b6b9e6de6"}
Sep 14 10:59:35.364022 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:35.363988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert\") pod \"maas-controller-697f579975-sn5fh\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") " pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:35.366386 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:35.366368    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert\") pod \"maas-controller-697f579975-sn5fh\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") " pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:35.408160 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:35.408131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:35.687725 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:35.687696    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-697f579975-sn5fh"]
Sep 14 10:59:35.689750 ip-10-0-142-201 kubenswrapper[2576]: W0914 10:59:35.689724    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c3d3d1_0819_4b4f_b724_3efacb2b018b.slice/crio-596588d3694c89b932a00839010ee2c5f8ac0253a0abbf4845a5f97dc0dcbd45 WatchSource:0}: Error finding container 596588d3694c89b932a00839010ee2c5f8ac0253a0abbf4845a5f97dc0dcbd45: Status 404 returned error can't find the container with id 596588d3694c89b932a00839010ee2c5f8ac0253a0abbf4845a5f97dc0dcbd45
Sep 14 10:59:36.155028 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:36.154956    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-697f579975-sn5fh" event={"ID":"84c3d3d1-0819-4b4f-b724-3efacb2b018b","Type":"ContainerStarted","Data":"596588d3694c89b932a00839010ee2c5f8ac0253a0abbf4845a5f97dc0dcbd45"}
Sep 14 10:59:37.898438 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:37.898395    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:37.993186 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:37.993159    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:38.165385 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:38.165350    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785cb4f769-2th6n" event={"ID":"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8","Type":"ContainerStarted","Data":"b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f"}
Sep 14 10:59:38.165573 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:38.165413    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:38.166837 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:38.166812    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-697f579975-sn5fh" event={"ID":"84c3d3d1-0819-4b4f-b724-3efacb2b018b","Type":"ContainerStarted","Data":"f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046"}
Sep 14 10:59:38.166991 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:38.166933    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:38.186077 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:38.186030    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-785cb4f769-2th6n" podStartSLOduration=2.467695657 podStartE2EDuration="5.186015661s" totalImagesPullingTime="2.718320004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:59:38.183797706 +0000 UTC m=+638.164433210" watchObservedRunningTime="2026-09-14 10:59:38.186015661 +0000 UTC m=+638.166651165"
Sep 14 10:59:38.210205 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:38.210158    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-697f579975-sn5fh" podStartSLOduration=3.214080144 podStartE2EDuration="5.210142266s" totalImagesPullingTime="1.996062122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:59:38.207881377 +0000 UTC m=+638.188517094" watchObservedRunningTime="2026-09-14 10:59:38.210142266 +0000 UTC m=+638.190777771"
Sep 14 10:59:47.640825 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:47.640789    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 10:59:49.172817 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.172791    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:49.173174 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.172852    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 10:59:49.246334 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.246299    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-697f579975-sn5fh"]
Sep 14 10:59:49.246607 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.246578    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-697f579975-sn5fh" podUID="84c3d3d1-0819-4b4f-b724-3efacb2b018b" containerName="manager" containerID="cri-o://f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046" gracePeriod=30
Sep 14 10:59:49.489705 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.489680    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:49.578810 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.578781    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert\") pod \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") "
Sep 14 10:59:49.578957 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.578823    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvcmb\" (UniqueName: \"kubernetes.io/projected/84c3d3d1-0819-4b4f-b724-3efacb2b018b-kube-api-access-jvcmb\") pod \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") "
Sep 14 10:59:49.578957 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.578857    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-metrics-certs\") pod \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\" (UID: \"84c3d3d1-0819-4b4f-b724-3efacb2b018b\") "
Sep 14 10:59:49.580965 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.580926    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "84c3d3d1-0819-4b4f-b724-3efacb2b018b" (UID: "84c3d3d1-0819-4b4f-b724-3efacb2b018b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:59:49.580965 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.580926    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c3d3d1-0819-4b4f-b724-3efacb2b018b-kube-api-access-jvcmb" (OuterVolumeSpecName: "kube-api-access-jvcmb") pod "84c3d3d1-0819-4b4f-b724-3efacb2b018b" (UID: "84c3d3d1-0819-4b4f-b724-3efacb2b018b"). InnerVolumeSpecName "kube-api-access-jvcmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:59:49.581125 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.581000    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "84c3d3d1-0819-4b4f-b724-3efacb2b018b" (UID: "84c3d3d1-0819-4b4f-b724-3efacb2b018b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:59:49.679530 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.679492    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-webhook-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:59:49.679530 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.679524    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvcmb\" (UniqueName: \"kubernetes.io/projected/84c3d3d1-0819-4b4f-b724-3efacb2b018b-kube-api-access-jvcmb\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:59:49.679530 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:49.679538    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c3d3d1-0819-4b4f-b724-3efacb2b018b-metrics-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 10:59:50.218919 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:50.218888    2576 generic.go:356] "Generic (PLEG): container finished" podID="84c3d3d1-0819-4b4f-b724-3efacb2b018b" containerID="f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046" exitCode=0
Sep 14 10:59:50.219342 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:50.218932    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-697f579975-sn5fh"
Sep 14 10:59:50.219342 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:50.218981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-697f579975-sn5fh" event={"ID":"84c3d3d1-0819-4b4f-b724-3efacb2b018b","Type":"ContainerDied","Data":"f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046"}
Sep 14 10:59:50.219342 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:50.219041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-697f579975-sn5fh" event={"ID":"84c3d3d1-0819-4b4f-b724-3efacb2b018b","Type":"ContainerDied","Data":"596588d3694c89b932a00839010ee2c5f8ac0253a0abbf4845a5f97dc0dcbd45"}
Sep 14 10:59:50.219342 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:50.219077    2576 scope.go:117] "RemoveContainer" containerID="f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046"
Sep 14 10:59:50.227450 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:50.227436    2576 scope.go:117] "RemoveContainer" containerID="f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046"
Sep 14 10:59:50.227756 ip-10-0-142-201 kubenswrapper[2576]: E0914 10:59:50.227739    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046\": container with ID starting with f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046 not found: ID does not exist" containerID="f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046"
Sep 14 10:59:50.227813 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:50.227764    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046"} err="failed to get container status \"f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046\": rpc error: code = NotFound desc = could not find container \"f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046\": container with ID starting with f70d2c3a8d11136217155976de888f80d8aaaa4c606be4c4c87f55314f6f7046 not found: ID does not exist"
Sep 14 10:59:50.240128 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:50.240110    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-697f579975-sn5fh"]
Sep 14 10:59:50.244177 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:50.244155    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-697f579975-sn5fh"]
Sep 14 10:59:50.559991 ip-10-0-142-201 kubenswrapper[2576]: I0914 10:59:50.559962    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84c3d3d1-0819-4b4f-b724-3efacb2b018b" path="/var/lib/kubelet/pods/84c3d3d1-0819-4b4f-b724-3efacb2b018b/volumes"
Sep 14 11:00:09.471639 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:09.471606    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:09.562566 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:09.562536    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:10.973500 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:10.973467    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:11.101309 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.101274    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:11.214657 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.214627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:11.241009 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.240986    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"]
Sep 14 11:00:11.241284 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.241273    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c3d3d1-0819-4b4f-b724-3efacb2b018b" containerName="manager"
Sep 14 11:00:11.241326 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.241287    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c3d3d1-0819-4b4f-b724-3efacb2b018b" containerName="manager"
Sep 14 11:00:11.241362 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.241354    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="84c3d3d1-0819-4b4f-b724-3efacb2b018b" containerName="manager"
Sep 14 11:00:11.249152 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.249129    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.252074 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.252058    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 11:00:11.252147 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.252118    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 14 11:00:11.252934 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.252916    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 14 11:00:11.252988 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.252927    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ksb7s\""
Sep 14 11:00:11.253173 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.253161    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 14 11:00:11.262118 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.262099    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"]
Sep 14 11:00:11.320952 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.320917    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:11.324005 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.323983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-maas-api-tls\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.324083 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.324014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3d036d8-7f93-468b-a873-a830cb285a07-openshift-service-ca\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.324140 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.324121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlnn8\" (UniqueName: \"kubernetes.io/projected/c3d036d8-7f93-468b-a873-a830cb285a07-kube-api-access-qlnn8\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.324193 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.324181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-metrics-certs\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.424503 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.424466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-metrics-certs\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.424503 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.424510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-maas-api-tls\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.424788 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.424557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3d036d8-7f93-468b-a873-a830cb285a07-openshift-service-ca\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.424788 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.424642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlnn8\" (UniqueName: \"kubernetes.io/projected/c3d036d8-7f93-468b-a873-a830cb285a07-kube-api-access-qlnn8\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.425208 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.425185    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3d036d8-7f93-468b-a873-a830cb285a07-openshift-service-ca\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.427008 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.426987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-maas-api-tls\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.427094 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.427036    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-metrics-certs\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.435347 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.435325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlnn8\" (UniqueName: \"kubernetes.io/projected/c3d036d8-7f93-468b-a873-a830cb285a07-kube-api-access-qlnn8\") pod \"maas-api-67455dc876-xx7qt\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") " pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.559029 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.558955    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:11.839031 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:00:11.838994    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d036d8_7f93_468b_a873_a830cb285a07.slice/crio-24d50632449ecaf649b75ba3307bddbfae31792f33152f1c0f66cdd5d71899ac WatchSource:0}: Error finding container 24d50632449ecaf649b75ba3307bddbfae31792f33152f1c0f66cdd5d71899ac: Status 404 returned error can't find the container with id 24d50632449ecaf649b75ba3307bddbfae31792f33152f1c0f66cdd5d71899ac
Sep 14 11:00:11.839949 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.839926    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"]
Sep 14 11:00:11.842892 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.842868    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 11:00:11.883569 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.883545    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:11.987269 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:11.987234    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:12.197995 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.197921    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"]
Sep 14 11:00:12.202991 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.202967    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"
Sep 14 11:00:12.205556 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.205536    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 14 11:00:12.205905 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.205890    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tj27z\""
Sep 14 11:00:12.229337 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.229309    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"]
Sep 14 11:00:12.230935 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.230913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c0c7a81-3670-439a-947d-4135b8c3d634-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-sqxlk\" (UID: \"0c0c7a81-3670-439a-947d-4135b8c3d634\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"
Sep 14 11:00:12.231040 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.230939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-484d5\" (UniqueName: \"kubernetes.io/projected/0c0c7a81-3670-439a-947d-4135b8c3d634-kube-api-access-484d5\") pod \"payload-processing-5b54b7fbb7-sqxlk\" (UID: \"0c0c7a81-3670-439a-947d-4135b8c3d634\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"
Sep 14 11:00:12.310954 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.310920    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt" event={"ID":"c3d036d8-7f93-468b-a873-a830cb285a07","Type":"ContainerStarted","Data":"24d50632449ecaf649b75ba3307bddbfae31792f33152f1c0f66cdd5d71899ac"}
Sep 14 11:00:12.331491 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.331460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c0c7a81-3670-439a-947d-4135b8c3d634-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-sqxlk\" (UID: \"0c0c7a81-3670-439a-947d-4135b8c3d634\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"
Sep 14 11:00:12.331617 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.331495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-484d5\" (UniqueName: \"kubernetes.io/projected/0c0c7a81-3670-439a-947d-4135b8c3d634-kube-api-access-484d5\") pod \"payload-processing-5b54b7fbb7-sqxlk\" (UID: \"0c0c7a81-3670-439a-947d-4135b8c3d634\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"
Sep 14 11:00:12.332129 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.332108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c0c7a81-3670-439a-947d-4135b8c3d634-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-sqxlk\" (UID: \"0c0c7a81-3670-439a-947d-4135b8c3d634\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"
Sep 14 11:00:12.367365 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.367341    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-484d5\" (UniqueName: \"kubernetes.io/projected/0c0c7a81-3670-439a-947d-4135b8c3d634-kube-api-access-484d5\") pod \"payload-processing-5b54b7fbb7-sqxlk\" (UID: \"0c0c7a81-3670-439a-947d-4135b8c3d634\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"
Sep 14 11:00:12.514400 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.514371    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"
Sep 14 11:00:12.806217 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:12.805840    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"]
Sep 14 11:00:12.808436 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:00:12.808405    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0c7a81_3670_439a_947d_4135b8c3d634.slice/crio-d7cfb22a8233aa352fd9934cde1d6e1e63b1ac6b92c344c1305f982ba4148988 WatchSource:0}: Error finding container d7cfb22a8233aa352fd9934cde1d6e1e63b1ac6b92c344c1305f982ba4148988: Status 404 returned error can't find the container with id d7cfb22a8233aa352fd9934cde1d6e1e63b1ac6b92c344c1305f982ba4148988
Sep 14 11:00:13.316968 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:13.316935    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk" event={"ID":"0c0c7a81-3670-439a-947d-4135b8c3d634","Type":"ContainerStarted","Data":"d7cfb22a8233aa352fd9934cde1d6e1e63b1ac6b92c344c1305f982ba4148988"}
Sep 14 11:00:15.328119 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:15.328071    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk" event={"ID":"0c0c7a81-3670-439a-947d-4135b8c3d634","Type":"ContainerStarted","Data":"c6f62efd64d7a6a612676d5844f63d97099a986a192e49469f34a376589cd511"}
Sep 14 11:00:15.328574 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:15.328188    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"
Sep 14 11:00:15.329814 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:15.329788    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt" event={"ID":"c3d036d8-7f93-468b-a873-a830cb285a07","Type":"ContainerStarted","Data":"c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044"}
Sep 14 11:00:15.329946 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:15.329916    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:15.353541 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:15.353487    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk" podStartSLOduration=1.000254375 podStartE2EDuration="3.353470968s" totalImagesPullingTime="2.353216593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:00:15.352082054 +0000 UTC m=+675.332717558" watchObservedRunningTime="2026-09-14 11:00:15.353470968 +0000 UTC m=+675.334106473"
Sep 14 11:00:15.374996 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:15.374949    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt" podStartSLOduration=1.97404119 podStartE2EDuration="4.3749323s" totalImagesPullingTime="2.40089111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:00:15.373161714 +0000 UTC m=+675.353797219" watchObservedRunningTime="2026-09-14 11:00:15.3749323 +0000 UTC m=+675.355567809"
Sep 14 11:00:15.736410 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:15.736380    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:16.924745 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:16.924705    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:21.340622 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:21.340592    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:00:22.363406 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:22.363377    2576 generic.go:356] "Generic (PLEG): container finished" podID="48062ff1-770b-4639-a806-4c17831a46cf" containerID="bd982e9e3b1a3178b6fb1b38a7e5c9ae4079768932207d178554477ea42ba9bb" exitCode=0
Sep 14 11:00:22.363840 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:22.363419    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv" event={"ID":"48062ff1-770b-4639-a806-4c17831a46cf","Type":"ContainerDied","Data":"bd982e9e3b1a3178b6fb1b38a7e5c9ae4079768932207d178554477ea42ba9bb"}
Sep 14 11:00:22.363840 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:22.363790    2576 scope.go:117] "RemoveContainer" containerID="bd982e9e3b1a3178b6fb1b38a7e5c9ae4079768932207d178554477ea42ba9bb"
Sep 14 11:00:22.364982 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:22.364941    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:00:22.365097 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:22.365046    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:00:22.365144 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:22.365101    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:00:22.811237 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:22.811207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:22.915289 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:22.915259    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:23.370272 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:23.370238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv" event={"ID":"48062ff1-770b-4639-a806-4c17831a46cf","Type":"ContainerStarted","Data":"63db98538224023aa545fb7d90db82a173c3cc5a6f119c90b1b6294129efe6f2"}
Sep 14 11:00:23.649704 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:23.649599    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 11:00:23.649858 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:23.649752    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-82wsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 14 11:00:23.649858 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:23.649806    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv" podUID="48062ff1-770b-4639-a806-4c17831a46cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 14 11:00:24.649981 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:24.649951    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-82wsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 14 11:00:24.650376 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:24.649998    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv" podUID="48062ff1-770b-4639-a806-4c17831a46cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 14 11:00:25.649244 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:25.649205    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-82wsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 14 11:00:25.649435 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:25.649260    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv" podUID="48062ff1-770b-4639-a806-4c17831a46cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 14 11:00:26.337496 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:26.337468    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-sqxlk"
Sep 14 11:00:26.649548 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:26.649464    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-82wsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 14 11:00:26.649548 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:26.649521    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv" podUID="48062ff1-770b-4639-a806-4c17831a46cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 14 11:00:27.649475 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:27.649444    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-82wsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 14 11:00:27.649910 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:27.649764    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv" podUID="48062ff1-770b-4639-a806-4c17831a46cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 14 11:00:28.455502 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.455468    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"]
Sep 14 11:00:28.458621 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.458599    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.461045 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.461022    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7mlsq\""
Sep 14 11:00:28.461174 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.461059    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 14 11:00:28.461760 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.461739    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 14 11:00:28.461978 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.461960    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 14 11:00:28.468799 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.468779    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"]
Sep 14 11:00:28.486916 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.486891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:28.571055 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.571024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.571205 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.571089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.571205 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.571132    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.571205 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.571148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.571205 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.571172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.571403 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.571205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmrx8\" (UniqueName: \"kubernetes.io/projected/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-kube-api-access-qmrx8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.653471 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.653443    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 11:00:28.653909 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.653733    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 11:00:28.654392 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.654373    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv"
Sep 14 11:00:28.672108 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.672088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.672208 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.672117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.672208 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.672134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.672208 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.672155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.672366 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.672298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmrx8\" (UniqueName: \"kubernetes.io/projected/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-kube-api-access-qmrx8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.672421 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.672365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.672585 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.672564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.672682 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.672618    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.672754 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.672719    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.674356 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.674333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.674822 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.674806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.682974 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.682955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmrx8\" (UniqueName: \"kubernetes.io/projected/94c5ee8e-de33-45f7-9fc9-2f6e07c7d455-kube-api-access-qmrx8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs\" (UID: \"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:28.769790 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:28.769757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:29.047630 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:29.047607    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"]
Sep 14 11:00:29.049485 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:00:29.049458    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c5ee8e_de33_45f7_9fc9_2f6e07c7d455.slice/crio-f50f51b6ecb1e1569802fed0b3abb7082c7aca7d72e94453fa63a736940a3ad8 WatchSource:0}: Error finding container f50f51b6ecb1e1569802fed0b3abb7082c7aca7d72e94453fa63a736940a3ad8: Status 404 returned error can't find the container with id f50f51b6ecb1e1569802fed0b3abb7082c7aca7d72e94453fa63a736940a3ad8
Sep 14 11:00:29.417588 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:29.417507    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs" event={"ID":"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455","Type":"ContainerStarted","Data":"f50f51b6ecb1e1569802fed0b3abb7082c7aca7d72e94453fa63a736940a3ad8"}
Sep 14 11:00:30.423456 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:30.423422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs" event={"ID":"94c5ee8e-de33-45f7-9fc9-2f6e07c7d455","Type":"ContainerStarted","Data":"bb64263a5c248080db3b3f1f0b444cf4c2bfc8b78838d2a76d90443e16679080"}
Sep 14 11:00:30.442630 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:30.442558    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs" podStartSLOduration=1.188284611 podStartE2EDuration="2.442539502s" totalImagesPullingTime="1.254254891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:00:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:00:30.441907165 +0000 UTC m=+690.422542671" watchObservedRunningTime="2026-09-14 11:00:30.442539502 +0000 UTC m=+690.423175007"
Sep 14 11:00:33.880322 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:33.880287    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:00:38.770129 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:38.770089    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:38.770528 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:38.770168    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:38.782722 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:38.782697    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:00:39.471788 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:00:39.471760    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs"
Sep 14 11:01:08.254505 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.254474    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"]
Sep 14 11:01:08.257861 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.257842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.260531 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.260516    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 14 11:01:08.273137 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.273111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"]
Sep 14 11:01:08.296408 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.296385    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:01:08.307508 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.307487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.307613 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.307520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.307613 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.307540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.307613 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.307568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.307779 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.307615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rwsx\" (UniqueName: \"kubernetes.io/projected/c82c23e6-4fc5-4e20-a232-751f10102828-kube-api-access-8rwsx\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.307779 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.307684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c82c23e6-4fc5-4e20-a232-751f10102828-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.408202 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.408172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c82c23e6-4fc5-4e20-a232-751f10102828-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.408398 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.408280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.408398 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.408313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.408398 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.408342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.408398 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.408394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.408633 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.408423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rwsx\" (UniqueName: \"kubernetes.io/projected/c82c23e6-4fc5-4e20-a232-751f10102828-kube-api-access-8rwsx\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.408865 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.408838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.409066 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.408896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.409284 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.409261    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.411126 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.411096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c82c23e6-4fc5-4e20-a232-751f10102828-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.411585 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.411564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c82c23e6-4fc5-4e20-a232-751f10102828-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.416892 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.416874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rwsx\" (UniqueName: \"kubernetes.io/projected/c82c23e6-4fc5-4e20-a232-751f10102828-kube-api-access-8rwsx\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69\" (UID: \"c82c23e6-4fc5-4e20-a232-751f10102828\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.567271 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.567192    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:08.840904 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:08.840880    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"]
Sep 14 11:01:08.843425 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:01:08.843399    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82c23e6_4fc5_4e20_a232_751f10102828.slice/crio-4e94da6fe9dc3517719a911efd728181fcba8d34a58b1f79c6d807618c53842a WatchSource:0}: Error finding container 4e94da6fe9dc3517719a911efd728181fcba8d34a58b1f79c6d807618c53842a: Status 404 returned error can't find the container with id 4e94da6fe9dc3517719a911efd728181fcba8d34a58b1f79c6d807618c53842a
Sep 14 11:01:09.591463 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:09.591422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69" event={"ID":"c82c23e6-4fc5-4e20-a232-751f10102828","Type":"ContainerStarted","Data":"d84fc4d30c87fbfed7544f52219bae9c5ea7e95c9b949b512eee73549fb7b9a5"}
Sep 14 11:01:09.591973 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:09.591496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69" event={"ID":"c82c23e6-4fc5-4e20-a232-751f10102828","Type":"ContainerStarted","Data":"4e94da6fe9dc3517719a911efd728181fcba8d34a58b1f79c6d807618c53842a"}
Sep 14 11:01:09.616296 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:09.616245    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69" podStartSLOduration=1.419864004 podStartE2EDuration="1.616229612s" totalImagesPullingTime="196.365608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:01:09.614426746 +0000 UTC m=+729.595062252" watchObservedRunningTime="2026-09-14 11:01:09.616229612 +0000 UTC m=+729.596865117"
Sep 14 11:01:12.773596 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:12.773560    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:01:18.568256 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:18.568228    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:18.568707 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:18.568301    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:18.580972 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:18.580947    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:18.641744 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:18.641718    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69"
Sep 14 11:01:20.793963 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:20.793932    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:01:34.344189 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.344152    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"]
Sep 14 11:01:34.347718 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.347697    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.350311 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.350291    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 14 11:01:34.359873 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.359854    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"]
Sep 14 11:01:34.428883 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.428846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcw8c\" (UniqueName: \"kubernetes.io/projected/5bd55f8d-edd9-4045-aad9-1d00b62743ac-kube-api-access-pcw8c\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.429045 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.428905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd55f8d-edd9-4045-aad9-1d00b62743ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.429045 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.428953    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.429125 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.429074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.429125 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.429106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.429188 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.429168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.530240 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.530207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.530417 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.530252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcw8c\" (UniqueName: \"kubernetes.io/projected/5bd55f8d-edd9-4045-aad9-1d00b62743ac-kube-api-access-pcw8c\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.530417 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.530371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd55f8d-edd9-4045-aad9-1d00b62743ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.530530 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.530421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.530530 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.530478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.530530 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.530496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.530725 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.530704    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.530882 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.530864    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.530938 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.530864    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.532796 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.532772    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bd55f8d-edd9-4045-aad9-1d00b62743ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.532997 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.532976    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd55f8d-edd9-4045-aad9-1d00b62743ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.550288 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.550267    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcw8c\" (UniqueName: \"kubernetes.io/projected/5bd55f8d-edd9-4045-aad9-1d00b62743ac-kube-api-access-pcw8c\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dmncv\" (UID: \"5bd55f8d-edd9-4045-aad9-1d00b62743ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.565986 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.565960    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:01:34.657891 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.657805    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:34.932035 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:34.932004    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"]
Sep 14 11:01:34.934594 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:01:34.934571    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd55f8d_edd9_4045_aad9_1d00b62743ac.slice/crio-3d237acdd0d022e7d67ed93a4f64b6c84fe5a42edc72b08959d751d13970a17d WatchSource:0}: Error finding container 3d237acdd0d022e7d67ed93a4f64b6c84fe5a42edc72b08959d751d13970a17d: Status 404 returned error can't find the container with id 3d237acdd0d022e7d67ed93a4f64b6c84fe5a42edc72b08959d751d13970a17d
Sep 14 11:01:35.711034 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:35.710999    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv" event={"ID":"5bd55f8d-edd9-4045-aad9-1d00b62743ac","Type":"ContainerStarted","Data":"42af2644081ea6f48ecfa76f76231a109d1b507999834b3515e0ad3330e26912"}
Sep 14 11:01:35.711414 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:35.711051    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv" event={"ID":"5bd55f8d-edd9-4045-aad9-1d00b62743ac","Type":"ContainerStarted","Data":"3d237acdd0d022e7d67ed93a4f64b6c84fe5a42edc72b08959d751d13970a17d"}
Sep 14 11:01:35.733542 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:35.733492    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv" podStartSLOduration=1.550410006 podStartE2EDuration="1.733477327s" totalImagesPullingTime="183.067321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:01:35.732023165 +0000 UTC m=+755.712658670" watchObservedRunningTime="2026-09-14 11:01:35.733477327 +0000 UTC m=+755.714112847"
Sep 14 11:01:39.510343 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:39.510313    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:01:44.658449 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:44.658410    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:44.658868 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:44.658470    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:44.670785 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:44.670756    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:01:44.761323 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:01:44.761293    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dmncv"
Sep 14 11:03:19.171235 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.171205    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6df64bcf75-5m2cg"]
Sep 14 11:03:19.174812 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.174796    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df64bcf75-5m2cg"
Sep 14 11:03:19.180792 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.180768    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 14 11:03:19.180927 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.180814    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wvnh6\""
Sep 14 11:03:19.188013 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.187992    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6df64bcf75-5m2cg"]
Sep 14 11:03:19.198214 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.198188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btqrg\" (UniqueName: \"kubernetes.io/projected/f759d0a8-d3cf-408b-b4b7-9aae02466530-kube-api-access-btqrg\") pod \"authorino-6df64bcf75-5m2cg\" (UID: \"f759d0a8-d3cf-408b-b4b7-9aae02466530\") " pod="kuadrant-system/authorino-6df64bcf75-5m2cg"
Sep 14 11:03:19.198319 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.198264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f759d0a8-d3cf-408b-b4b7-9aae02466530-tls-cert\") pod \"authorino-6df64bcf75-5m2cg\" (UID: \"f759d0a8-d3cf-408b-b4b7-9aae02466530\") " pod="kuadrant-system/authorino-6df64bcf75-5m2cg"
Sep 14 11:03:19.299714 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.299673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f759d0a8-d3cf-408b-b4b7-9aae02466530-tls-cert\") pod \"authorino-6df64bcf75-5m2cg\" (UID: \"f759d0a8-d3cf-408b-b4b7-9aae02466530\") " pod="kuadrant-system/authorino-6df64bcf75-5m2cg"
Sep 14 11:03:19.299900 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.299787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btqrg\" (UniqueName: \"kubernetes.io/projected/f759d0a8-d3cf-408b-b4b7-9aae02466530-kube-api-access-btqrg\") pod \"authorino-6df64bcf75-5m2cg\" (UID: \"f759d0a8-d3cf-408b-b4b7-9aae02466530\") " pod="kuadrant-system/authorino-6df64bcf75-5m2cg"
Sep 14 11:03:19.302108 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.302085    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f759d0a8-d3cf-408b-b4b7-9aae02466530-tls-cert\") pod \"authorino-6df64bcf75-5m2cg\" (UID: \"f759d0a8-d3cf-408b-b4b7-9aae02466530\") " pod="kuadrant-system/authorino-6df64bcf75-5m2cg"
Sep 14 11:03:19.309471 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.309444    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btqrg\" (UniqueName: \"kubernetes.io/projected/f759d0a8-d3cf-408b-b4b7-9aae02466530-kube-api-access-btqrg\") pod \"authorino-6df64bcf75-5m2cg\" (UID: \"f759d0a8-d3cf-408b-b4b7-9aae02466530\") " pod="kuadrant-system/authorino-6df64bcf75-5m2cg"
Sep 14 11:03:19.483617 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.483590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df64bcf75-5m2cg"
Sep 14 11:03:19.755034 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:19.755009    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6df64bcf75-5m2cg"]
Sep 14 11:03:19.757604 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:03:19.757574    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf759d0a8_d3cf_408b_b4b7_9aae02466530.slice/crio-81a5e6edec5c939750eeffcfd2475f3d87b20310ef6522635c2ca6e8b8ed542b WatchSource:0}: Error finding container 81a5e6edec5c939750eeffcfd2475f3d87b20310ef6522635c2ca6e8b8ed542b: Status 404 returned error can't find the container with id 81a5e6edec5c939750eeffcfd2475f3d87b20310ef6522635c2ca6e8b8ed542b
Sep 14 11:03:20.170586 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:20.170491    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6df64bcf75-5m2cg" event={"ID":"f759d0a8-d3cf-408b-b4b7-9aae02466530","Type":"ContainerStarted","Data":"81a5e6edec5c939750eeffcfd2475f3d87b20310ef6522635c2ca6e8b8ed542b"}
Sep 14 11:03:21.178333 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:21.178285    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6df64bcf75-5m2cg" event={"ID":"f759d0a8-d3cf-408b-b4b7-9aae02466530","Type":"ContainerStarted","Data":"107d7e4927b2205450eb1def2f69b3d1a51a5b59f35f71bcc8ab85914484a0eb"}
Sep 14 11:03:21.195398 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:21.195333    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6df64bcf75-5m2cg" podStartSLOduration=1.526257793 podStartE2EDuration="2.195313048s" totalImagesPullingTime="669.055255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:03:21.194713082 +0000 UTC m=+861.175348588" watchObservedRunningTime="2026-09-14 11:03:21.195313048 +0000 UTC m=+861.175948556"
Sep 14 11:03:21.821695 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:21.821615    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:21.916204 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:21.916147    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:23.081236 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:23.081206    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:23.220029 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:23.219996    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:38.560950 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:38.560903    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:38.918040 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:38.917919    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:39.184596 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.184493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:39.290686 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.290390    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"]
Sep 14 11:03:39.297775 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.296761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.299007 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.298977    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:39.301018 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.300996    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-04195c-openshift-default-dockercfg-vrjrd\""
Sep 14 11:03:39.308867 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.308846    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"]
Sep 14 11:03:39.376626 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.376585    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-certs\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.376935 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.376914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c91f8d98-14ce-40eb-b193-7033d7da7c71-istiod-ca-cert\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.377079 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.377056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-podinfo\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.377208 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.377100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-data\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.377208 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.377127    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-token\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.377326 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.377227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-socket\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.377326 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.377299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-credential-socket\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.377429 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.377331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-envoy\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.377429 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.377358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fllp\" (UniqueName: \"kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-kube-api-access-9fllp\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.386382 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.386354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:39.478127 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c91f8d98-14ce-40eb-b193-7033d7da7c71-istiod-ca-cert\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478127 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-podinfo\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478127 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-data\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478387 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-token\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478387 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-socket\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478387 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-credential-socket\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478387 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-envoy\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478387 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fllp\" (UniqueName: \"kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-kube-api-access-9fllp\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478387 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-certs\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478721 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478565    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-data\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478803 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478772    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-credential-socket\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478863 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478795    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-certs\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478918 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478891    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c91f8d98-14ce-40eb-b193-7033d7da7c71-istiod-ca-cert\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.478918 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.478902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-socket\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.480894 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.480863    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-envoy\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.481093 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.481074    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-podinfo\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.495431 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.495409    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fllp\" (UniqueName: \"kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-kube-api-access-9fllp\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.495687 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.495667    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-token\") pod \"e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") " pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.497449 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.497431    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:39.609239 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.609205    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:39.902720 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.902688    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"]
Sep 14 11:03:39.906267 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:03:39.906235    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91f8d98_14ce_40eb_b193_7033d7da7c71.slice/crio-485bfa065e922a48e299919b0c1359bb31cc49be405e14eb81f5ade11f8230e5 WatchSource:0}: Error finding container 485bfa065e922a48e299919b0c1359bb31cc49be405e14eb81f5ade11f8230e5: Status 404 returned error can't find the container with id 485bfa065e922a48e299919b0c1359bb31cc49be405e14eb81f5ade11f8230e5
Sep 14 11:03:39.908872 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.908838    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:03:39.908956 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.908906    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:03:39.908956 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:39.908941    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:03:40.265690 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:40.265643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" event={"ID":"c91f8d98-14ce-40eb-b193-7033d7da7c71","Type":"ContainerStarted","Data":"b68a71211dba5771906644024f68bd2c6e8dd579cab55df5cd2a8d3aef9e20ad"}
Sep 14 11:03:40.265839 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:40.265707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" event={"ID":"c91f8d98-14ce-40eb-b193-7033d7da7c71","Type":"ContainerStarted","Data":"485bfa065e922a48e299919b0c1359bb31cc49be405e14eb81f5ade11f8230e5"}
Sep 14 11:03:40.290439 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:40.290385    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" podStartSLOduration=1.290363765 podStartE2EDuration="1.290363765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:03:40.289531232 +0000 UTC m=+880.270166759" watchObservedRunningTime="2026-09-14 11:03:40.290363765 +0000 UTC m=+880.270999270"
Sep 14 11:03:40.609868 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:40.609782    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:40.614635 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:40.614610    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:40.630827 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:40.630795    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:40.724329 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:40.724293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:41.270721 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:41.270685    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:41.271579 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:41.271561    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:03:42.333870 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:42.333837    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:42.524115 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:42.524082    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:42.713583 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:42.713489    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:43.611094 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.611055    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"]
Sep 14 11:03:43.615807 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.615770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.620532 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.620503    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-4ebf73-serving-cert\""
Sep 14 11:03:43.631721 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.631678    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"]
Sep 14 11:03:43.675830 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.675730    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:43.716523 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.716473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lccvc\" (UniqueName: \"kubernetes.io/projected/92436e7f-e068-4751-b85b-1a9a4044d849-kube-api-access-lccvc\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.716766 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.716529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-metrics-certs\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.716766 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.716644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-maas-api-tls\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.716766 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.716724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92436e7f-e068-4751-b85b-1a9a4044d849-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.773093 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.773061    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:43.817365 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.817328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92436e7f-e068-4751-b85b-1a9a4044d849-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.817584 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.817404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lccvc\" (UniqueName: \"kubernetes.io/projected/92436e7f-e068-4751-b85b-1a9a4044d849-kube-api-access-lccvc\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.817584 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.817444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-metrics-certs\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.817584 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.817554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-maas-api-tls\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.817807 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:03:43.817734    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-serving-cert: secret "maas-api-e2e-worker-w4-4ebf73-serving-cert" not found
Sep 14 11:03:43.817874 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:03:43.817811    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-maas-api-tls podName:92436e7f-e068-4751-b85b-1a9a4044d849 nodeName:}" failed. No retries permitted until 2026-09-14 11:03:44.317789436 +0000 UTC m=+884.298424939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-maas-api-tls") pod "maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf" (UID: "92436e7f-e068-4751-b85b-1a9a4044d849") : secret "maas-api-e2e-worker-w4-4ebf73-serving-cert" not found
Sep 14 11:03:43.818276 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.818251    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92436e7f-e068-4751-b85b-1a9a4044d849-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.820757 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.820731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-metrics-certs\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.833310 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.833279    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lccvc\" (UniqueName: \"kubernetes.io/projected/92436e7f-e068-4751-b85b-1a9a4044d849-kube-api-access-lccvc\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:43.978351 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:43.978250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:44.323886 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:44.323849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-maas-api-tls\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:44.326711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:44.326682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-maas-api-tls\") pod \"maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:44.383629 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:44.383594    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:44.482389 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:44.482342    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:44.533274 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:44.533242    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:44.815341 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:44.815316    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"]
Sep 14 11:03:44.817377 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:03:44.817353    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92436e7f_e068_4751_b85b_1a9a4044d849.slice/crio-da8ee405888d57b77fb1dd526a3b88438c4d3a7c0add4d0cc11baf453cdd7263 WatchSource:0}: Error finding container da8ee405888d57b77fb1dd526a3b88438c4d3a7c0add4d0cc11baf453cdd7263: Status 404 returned error can't find the container with id da8ee405888d57b77fb1dd526a3b88438c4d3a7c0add4d0cc11baf453cdd7263
Sep 14 11:03:45.024635 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.024605    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"]
Sep 14 11:03:45.029481 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.029454    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.031968 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.031937    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-7984b1-serving-cert\""
Sep 14 11:03:45.048077 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.048051    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"]
Sep 14 11:03:45.084269 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.084236    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:45.132386 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.132349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.132386 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.132390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg2dt\" (UniqueName: \"kubernetes.io/projected/4ba4c739-59b6-4336-852f-1f491aa23fb4-kube-api-access-xg2dt\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.132633 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.132423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba4c739-59b6-4336-852f-1f491aa23fb4-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.132633 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.132517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-metrics-certs\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.176986 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.176944    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:45.233672 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.233609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.233849 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.233685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg2dt\" (UniqueName: \"kubernetes.io/projected/4ba4c739-59b6-4336-852f-1f491aa23fb4-kube-api-access-xg2dt\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.233849 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.233724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba4c739-59b6-4336-852f-1f491aa23fb4-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.233849 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.233759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-metrics-certs\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.234450 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.234428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba4c739-59b6-4336-852f-1f491aa23fb4-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.236074 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.236055    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-metrics-certs\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.236166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.236108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.250268 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.250242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg2dt\" (UniqueName: \"kubernetes.io/projected/4ba4c739-59b6-4336-852f-1f491aa23fb4-kube-api-access-xg2dt\") pod \"maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.289960 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.289874    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf" event={"ID":"92436e7f-e068-4751-b85b-1a9a4044d849","Type":"ContainerStarted","Data":"da8ee405888d57b77fb1dd526a3b88438c4d3a7c0add4d0cc11baf453cdd7263"}
Sep 14 11:03:45.298911 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.298882    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:45.340311 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.340285    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:45.619624 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.619400    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"]
Sep 14 11:03:45.622068 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:03:45.622043    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba4c739_59b6_4336_852f_1f491aa23fb4.slice/crio-ad2af5256a1b520be6f504e1cee5515d683cb49f4c0077aec0c56653ba3a335e WatchSource:0}: Error finding container ad2af5256a1b520be6f504e1cee5515d683cb49f4c0077aec0c56653ba3a335e: Status 404 returned error can't find the container with id ad2af5256a1b520be6f504e1cee5515d683cb49f4c0077aec0c56653ba3a335e
Sep 14 11:03:45.833410 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.833380    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:45.944956 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:45.944873    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:46.300799 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:46.300763    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf" event={"ID":"92436e7f-e068-4751-b85b-1a9a4044d849","Type":"ContainerStarted","Data":"a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279"}
Sep 14 11:03:46.301006 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:46.300988    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:46.301955 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:46.301933    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw" event={"ID":"4ba4c739-59b6-4336-852f-1f491aa23fb4","Type":"ContainerStarted","Data":"ad2af5256a1b520be6f504e1cee5515d683cb49f4c0077aec0c56653ba3a335e"}
Sep 14 11:03:46.340067 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:46.340021    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf" podStartSLOduration=2.839661732 podStartE2EDuration="3.340004989s" totalImagesPullingTime="500.343257ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:03:46.337472803 +0000 UTC m=+886.318108312" watchObservedRunningTime="2026-09-14 11:03:46.340004989 +0000 UTC m=+886.320640494"
Sep 14 11:03:46.397891 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:46.397861    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:46.496870 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:46.496836    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:46.679593 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:46.679488    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:46.777444 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:46.777407    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:47.057283 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:47.057255    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:47.229931 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:47.229889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:47.308572 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:47.308483    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw" event={"ID":"4ba4c739-59b6-4336-852f-1f491aa23fb4","Type":"ContainerStarted","Data":"4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586"}
Sep 14 11:03:47.308751 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:47.308590    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:47.339780 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:47.339734    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw" podStartSLOduration=1.596731438 podStartE2EDuration="2.339718457s" totalImagesPullingTime="742.987019ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:03:47.337996687 +0000 UTC m=+887.318632196" watchObservedRunningTime="2026-09-14 11:03:47.339718457 +0000 UTC m=+887.320354010"
Sep 14 11:03:47.511255 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:47.511221    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:47.786578 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:47.786546    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:48.078414 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:48.078338    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:48.261009 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:48.260977    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:48.358414 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:48.358334    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:49.183339 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:49.183305    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:49.673408 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:49.673361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:49.781879 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:49.781846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:49.905082 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:49.905045    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:50.247355 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:50.247321    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:50.413007 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:50.412976    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:50.553035 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:50.552944    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:50.749568 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:50.749531    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:51.640675 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.640610    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"]
Sep 14 11:03:51.646381 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.646353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:51.648553 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.648517    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-b275d0-serving-cert\""
Sep 14 11:03:51.667687 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.667642    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"]
Sep 14 11:03:51.708423 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.708298    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:51.797622 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.797541    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:51.799111 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.799075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a75c705-5a38-45f9-b954-1176167329bc-openshift-service-ca\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:51.799596 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.799567    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-maas-api-tls\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:51.799766 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.799746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knb4p\" (UniqueName: \"kubernetes.io/projected/1a75c705-5a38-45f9-b954-1176167329bc-kube-api-access-knb4p\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:51.799953 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.799938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-metrics-certs\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:51.902032 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.901183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a75c705-5a38-45f9-b954-1176167329bc-openshift-service-ca\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:51.902032 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.901299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-maas-api-tls\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:51.902032 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.901333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knb4p\" (UniqueName: \"kubernetes.io/projected/1a75c705-5a38-45f9-b954-1176167329bc-kube-api-access-knb4p\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:51.902032 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.901396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-metrics-certs\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:51.903538 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.903168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a75c705-5a38-45f9-b954-1176167329bc-openshift-service-ca\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:51.903829 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:03:51.903810    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-serving-cert: secret "maas-api-e2e-autores-b275d0-serving-cert" not found
Sep 14 11:03:51.904274 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:03:51.904259    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-maas-api-tls podName:1a75c705-5a38-45f9-b954-1176167329bc nodeName:}" failed. No retries permitted until 2026-09-14 11:03:52.403997574 +0000 UTC m=+892.384633063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-maas-api-tls") pod "maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw" (UID: "1a75c705-5a38-45f9-b954-1176167329bc") : secret "maas-api-e2e-autores-b275d0-serving-cert" not found
Sep 14 11:03:51.907678 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.904678    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-metrics-certs\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:51.925383 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:51.925327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knb4p\" (UniqueName: \"kubernetes.io/projected/1a75c705-5a38-45f9-b954-1176167329bc-kube-api-access-knb4p\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:52.034912 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:52.034815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:52.315024 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:52.314987    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:03:52.406490 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:52.406457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-maas-api-tls\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:52.409791 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:52.409760    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-maas-api-tls\") pod \"maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:52.622087 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:52.622002    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:52.623803 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:52.623785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:52.898795 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:52.898167    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:52.981034 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:52.980978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"]
Sep 14 11:03:53.000619 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:03:53.000587    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a75c705_5a38_45f9_b954_1176167329bc.slice/crio-c83bec79de377cfcfc38260805a5fa0a7b5a7eb818782de7b1956e897b217789 WatchSource:0}: Error finding container c83bec79de377cfcfc38260805a5fa0a7b5a7eb818782de7b1956e897b217789: Status 404 returned error can't find the container with id c83bec79de377cfcfc38260805a5fa0a7b5a7eb818782de7b1956e897b217789
Sep 14 11:03:53.196762 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.196526    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:53.310336 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.310300    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"]
Sep 14 11:03:53.314932 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.314905    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:03:53.317892 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.317868    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-b275d0-dockercfg-l8xk7\""
Sep 14 11:03:53.318031 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.317982    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-b275d0\""
Sep 14 11:03:53.318924 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.318902    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:03:53.329309 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.329284    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"]
Sep 14 11:03:53.337117 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.337093    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:53.339255 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.339235    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw" event={"ID":"1a75c705-5a38-45f9-b954-1176167329bc","Type":"ContainerStarted","Data":"c83bec79de377cfcfc38260805a5fa0a7b5a7eb818782de7b1956e897b217789"}
Sep 14 11:03:53.419196 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.418603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-plugins-config-volume\") pod \"payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc\" (UID: \"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8\") " pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:03:53.419196 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.418729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q8zl\" (UniqueName: \"kubernetes.io/projected/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-kube-api-access-4q8zl\") pod \"payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc\" (UID: \"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8\") " pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:03:53.519914 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.519885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-plugins-config-volume\") pod \"payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc\" (UID: \"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8\") " pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:03:53.519914 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.519927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q8zl\" (UniqueName: \"kubernetes.io/projected/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-kube-api-access-4q8zl\") pod \"payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc\" (UID: \"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8\") " pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:03:53.520893 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.520870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-plugins-config-volume\") pod \"payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc\" (UID: \"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8\") " pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:03:53.536015 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.535951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q8zl\" (UniqueName: \"kubernetes.io/projected/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-kube-api-access-4q8zl\") pod \"payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc\" (UID: \"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8\") " pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:03:53.627265 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.627232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:03:53.991325 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:53.991258    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"]
Sep 14 11:03:54.015912 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:54.015884    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:54.345442 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:54.345340    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc" event={"ID":"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8","Type":"ContainerStarted","Data":"1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553"}
Sep 14 11:03:54.345442 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:54.345391    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc" event={"ID":"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8","Type":"ContainerStarted","Data":"e63463292d62ba8ec7e1ebfb388e1cc3d38ba52f2c810ee09535751f7b1e4fdf"}
Sep 14 11:03:54.345442 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:54.345442    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:03:54.346927 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:54.346906    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw" event={"ID":"1a75c705-5a38-45f9-b954-1176167329bc","Type":"ContainerStarted","Data":"a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631"}
Sep 14 11:03:54.347080 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:54.347066    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:03:54.368937 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:54.368887    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc" podStartSLOduration=1.3688711900000001 podStartE2EDuration="1.36887119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:03:54.366216567 +0000 UTC m=+894.346852073" watchObservedRunningTime="2026-09-14 11:03:54.36887119 +0000 UTC m=+894.349506694"
Sep 14 11:03:55.206426 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:55.206384    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:56.098998 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:56.098960    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:57.062225 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.062190    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:57.268043 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.267951    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw" podStartSLOduration=5.8255095820000005 podStartE2EDuration="6.267924761s" totalImagesPullingTime="442.415179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:03:54.397804286 +0000 UTC m=+894.378439798" watchObservedRunningTime="2026-09-14 11:03:57.267924761 +0000 UTC m=+897.248560266"
Sep 14 11:03:57.268355 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.268338    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"]
Sep 14 11:03:57.272030 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.272006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.276264 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.276214    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6706857a-serving-cert\""
Sep 14 11:03:57.288012 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.287986    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"]
Sep 14 11:03:57.354864 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.354825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-metrics-certs\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.354864 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.354867    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19721f14-e832-408c-99b6-271c4da74ef6-openshift-service-ca\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.355100 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.354926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-maas-api-tls\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.355100 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.354966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7x6d\" (UniqueName: \"kubernetes.io/projected/19721f14-e832-408c-99b6-271c4da74ef6-kube-api-access-j7x6d\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.365975 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.365950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:57.455750 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.455713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-maas-api-tls\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.455750 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.455763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7x6d\" (UniqueName: \"kubernetes.io/projected/19721f14-e832-408c-99b6-271c4da74ef6-kube-api-access-j7x6d\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.455994 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.455837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-metrics-certs\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.455994 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.455883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19721f14-e832-408c-99b6-271c4da74ef6-openshift-service-ca\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.455994 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:03:57.455884    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-serving-cert: secret "maas-api-e2e-ait-6706857a-serving-cert" not found
Sep 14 11:03:57.456134 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:03:57.456025    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-maas-api-tls podName:19721f14-e832-408c-99b6-271c4da74ef6 nodeName:}" failed. No retries permitted until 2026-09-14 11:03:57.956003836 +0000 UTC m=+897.936639321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-maas-api-tls") pod "maas-api-e2e-ait-6706857a-69cb864695-5lvn4" (UID: "19721f14-e832-408c-99b6-271c4da74ef6") : secret "maas-api-e2e-ait-6706857a-serving-cert" not found
Sep 14 11:03:57.456640 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.456618    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19721f14-e832-408c-99b6-271c4da74ef6-openshift-service-ca\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.458422 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.458391    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-metrics-certs\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.472800 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.472778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7x6d\" (UniqueName: \"kubernetes.io/projected/19721f14-e832-408c-99b6-271c4da74ef6-kube-api-access-j7x6d\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.538367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.538281    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:57.694908 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.694874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:57.921013 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.920923    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:57.960760 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.960713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-maas-api-tls\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:57.963693 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:57.963641    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-maas-api-tls\") pod \"maas-api-e2e-ait-6706857a-69cb864695-5lvn4\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:58.110689 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:58.110636    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:58.188056 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:58.187974    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:58.500110 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:58.500076    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"]
Sep 14 11:03:58.503353 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:03:58.503325    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19721f14_e832_408c_99b6_271c4da74ef6.slice/crio-180086584d160c88b7a115b2c7612c7ff4081ca697cce3a2950323e5683bd4bd WatchSource:0}: Error finding container 180086584d160c88b7a115b2c7612c7ff4081ca697cce3a2950323e5683bd4bd: Status 404 returned error can't find the container with id 180086584d160c88b7a115b2c7612c7ff4081ca697cce3a2950323e5683bd4bd
Sep 14 11:03:58.689584 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:58.689547    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:58.817267 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:58.817239    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:03:59.376797 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:59.376757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4" event={"ID":"19721f14-e832-408c-99b6-271c4da74ef6","Type":"ContainerStarted","Data":"d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29"}
Sep 14 11:03:59.377204 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:59.376820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4" event={"ID":"19721f14-e832-408c-99b6-271c4da74ef6","Type":"ContainerStarted","Data":"180086584d160c88b7a115b2c7612c7ff4081ca697cce3a2950323e5683bd4bd"}
Sep 14 11:03:59.377204 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:59.376903    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:03:59.404855 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:59.404784    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4" podStartSLOduration=2.105845287 podStartE2EDuration="2.40476789s" totalImagesPullingTime="298.922603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:03:59.404008581 +0000 UTC m=+899.384644088" watchObservedRunningTime="2026-09-14 11:03:59.40476789 +0000 UTC m=+899.385403394"
Sep 14 11:03:59.525909 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:03:59.525871    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:00.358594 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:00.358519    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:04:00.383244 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:00.383211    2576 generic.go:356] "Generic (PLEG): container finished" podID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerID="b68a71211dba5771906644024f68bd2c6e8dd579cab55df5cd2a8d3aef9e20ad" exitCode=0
Sep 14 11:04:00.383719 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:00.383311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" event={"ID":"c91f8d98-14ce-40eb-b193-7033d7da7c71","Type":"ContainerDied","Data":"b68a71211dba5771906644024f68bd2c6e8dd579cab55df5cd2a8d3aef9e20ad"}
Sep 14 11:04:00.383859 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:00.383771    2576 scope.go:117] "RemoveContainer" containerID="b68a71211dba5771906644024f68bd2c6e8dd579cab55df5cd2a8d3aef9e20ad"
Sep 14 11:04:00.385115 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:00.385080    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:04:00.385252 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:00.385187    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:04:00.385252 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:00.385242    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:04:00.497058 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:00.497020    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:00.693823 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:00.693598    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:01.396090 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:01.396048    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" event={"ID":"c91f8d98-14ce-40eb-b193-7033d7da7c71","Type":"ContainerStarted","Data":"61ec361f91b0d761b05bb0e7068d3dd0ab8a9ce0c87a38e3260a9277017582e9"}
Sep 14 11:04:01.609669 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:01.609611    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:04:01.609852 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:01.609827    2576 patch_prober.go:28] interesting pod/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 14 11:04:01.609931 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:01.609888    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 14 11:04:02.236862 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:02.236826    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:02.609620 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:02.609538    2576 patch_prober.go:28] interesting pod/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 14 11:04:02.609620 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:02.609588    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 14 11:04:03.014099 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:03.014071    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:03.191702 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:03.191610    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:03.610480 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:03.610441    2576 patch_prober.go:28] interesting pod/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 14 11:04:03.610906 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:03.610494    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 14 11:04:03.884273 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:03.884169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:04.324506 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:04.324476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:04.609800 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:04.609715    2576 patch_prober.go:28] interesting pod/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 14 11:04:04.609800 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:04.609779    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 14 11:04:05.082584 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:05.082549    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:05.189553 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:05.189492    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:05.355521 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:05.355441    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:04:05.395094 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:05.395046    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:04:05.610188 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:05.610090    2576 patch_prober.go:28] interesting pod/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 14 11:04:05.610188 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:05.610153    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 14 11:04:06.415741 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:06.415701    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:06.639217 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:06.639186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:06.680779 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:06.680690    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:04:06.681092 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:06.681066    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:04:06.682362 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:06.682342    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:04:06.733939 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:06.733889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:07.543546 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:07.543511    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:08.495564 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:08.495529    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:09.493474 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:09.493432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:10.272179 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:10.272148    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:11.206263 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:11.206222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:11.308180 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:11.308146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:11.665701 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:11.665642    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:11.889277 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:11.889243    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:11.993582 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:11.993543    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:12.292218 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:12.292101    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:13.175297 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:13.175259    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:14.156512 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:14.156476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:15.100710 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:15.100676    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:16.220401 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:16.220370    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:17.173291 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:17.173254    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:18.028519 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:18.028488    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:18.836303 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:18.836264    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:18.955114 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:18.955079    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:19.614044 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:19.614010    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:22.771257 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:22.771226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:22.877554 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:22.877525    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:23.063155 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:23.063063    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:29.105842 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:29.105811    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:31.305142 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:31.305102    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:32.292669 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:32.292622    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:33.696488 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:33.696458    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"]
Sep 14 11:04:33.696975 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:33.696743    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4" podUID="19721f14-e832-408c-99b6-271c4da74ef6" containerName="maas-api" containerID="cri-o://d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29" gracePeriod=30
Sep 14 11:04:33.960568 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:33.960508    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:04:34.111249 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.111212    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19721f14-e832-408c-99b6-271c4da74ef6-openshift-service-ca\") pod \"19721f14-e832-408c-99b6-271c4da74ef6\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") "
Sep 14 11:04:34.111495 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.111470    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-metrics-certs\") pod \"19721f14-e832-408c-99b6-271c4da74ef6\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") "
Sep 14 11:04:34.111622 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.111552    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-maas-api-tls\") pod \"19721f14-e832-408c-99b6-271c4da74ef6\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") "
Sep 14 11:04:34.111622 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.111598    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7x6d\" (UniqueName: \"kubernetes.io/projected/19721f14-e832-408c-99b6-271c4da74ef6-kube-api-access-j7x6d\") pod \"19721f14-e832-408c-99b6-271c4da74ef6\" (UID: \"19721f14-e832-408c-99b6-271c4da74ef6\") "
Sep 14 11:04:34.111738 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.111633    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19721f14-e832-408c-99b6-271c4da74ef6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "19721f14-e832-408c-99b6-271c4da74ef6" (UID: "19721f14-e832-408c-99b6-271c4da74ef6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:04:34.111937 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.111911    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19721f14-e832-408c-99b6-271c4da74ef6-openshift-service-ca\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:04:34.115802 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.115734    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "19721f14-e832-408c-99b6-271c4da74ef6" (UID: "19721f14-e832-408c-99b6-271c4da74ef6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:04:34.115802 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.115735    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19721f14-e832-408c-99b6-271c4da74ef6-kube-api-access-j7x6d" (OuterVolumeSpecName: "kube-api-access-j7x6d") pod "19721f14-e832-408c-99b6-271c4da74ef6" (UID: "19721f14-e832-408c-99b6-271c4da74ef6"). InnerVolumeSpecName "kube-api-access-j7x6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:04:34.116040 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.115868    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "19721f14-e832-408c-99b6-271c4da74ef6" (UID: "19721f14-e832-408c-99b6-271c4da74ef6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:04:34.213088 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.212999    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-metrics-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:04:34.213088 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.213028    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19721f14-e832-408c-99b6-271c4da74ef6-maas-api-tls\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:04:34.213088 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.213041    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7x6d\" (UniqueName: \"kubernetes.io/projected/19721f14-e832-408c-99b6-271c4da74ef6-kube-api-access-j7x6d\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:04:34.563265 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.563230    2576 generic.go:356] "Generic (PLEG): container finished" podID="19721f14-e832-408c-99b6-271c4da74ef6" containerID="d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29" exitCode=0
Sep 14 11:04:34.563441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.563289    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"
Sep 14 11:04:34.563441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.563322    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4" event={"ID":"19721f14-e832-408c-99b6-271c4da74ef6","Type":"ContainerDied","Data":"d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29"}
Sep 14 11:04:34.563441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.563372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4" event={"ID":"19721f14-e832-408c-99b6-271c4da74ef6","Type":"ContainerDied","Data":"180086584d160c88b7a115b2c7612c7ff4081ca697cce3a2950323e5683bd4bd"}
Sep 14 11:04:34.563441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.563398    2576 scope.go:117] "RemoveContainer" containerID="d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29"
Sep 14 11:04:34.573784 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.573758    2576 scope.go:117] "RemoveContainer" containerID="d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29"
Sep 14 11:04:34.574088 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:04:34.574068    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29\": container with ID starting with d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29 not found: ID does not exist" containerID="d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29"
Sep 14 11:04:34.574156 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.574096    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29"} err="failed to get container status \"d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29\": rpc error: code = NotFound desc = could not find container \"d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29\": container with ID starting with d6704e97e25fbd3f2f5a514ee3fa3075d7b597edf77a7018c326092f9666cc29 not found: ID does not exist"
Sep 14 11:04:34.590507 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.590480    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"]
Sep 14 11:04:34.595683 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.595480    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6706857a-69cb864695-5lvn4"]
Sep 14 11:04:34.608741 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.608706    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:34.684698 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.684644    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:34.807267 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.807229    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:34.974153 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:34.974047    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:35.256557 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.256524    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"]
Sep 14 11:04:35.257176 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.257156    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19721f14-e832-408c-99b6-271c4da74ef6" containerName="maas-api"
Sep 14 11:04:35.257233 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.257180    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19721f14-e832-408c-99b6-271c4da74ef6" containerName="maas-api"
Sep 14 11:04:35.257305 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.257294    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="19721f14-e832-408c-99b6-271c4da74ef6" containerName="maas-api"
Sep 14 11:04:35.262055 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.262034    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.265071 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.265051    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-73290f4b-gw-openshift-default-dockercfg-qccqf\""
Sep 14 11:04:35.271811 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.271786    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"]
Sep 14 11:04:35.295887 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.295854    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:35.398510 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.398477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:35.425785 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.425739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-credential-socket\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.425947 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.425805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-envoy\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.425947 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.425838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-data\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.425947 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.425856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-certs\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.425947 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.425901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhkkb\" (UniqueName: \"kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-kube-api-access-rhkkb\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.425947 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.425921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-token\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.426116 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.425965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-podinfo\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.426116 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.425986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-socket\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.426116 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.426031    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4afe9100-eeef-42c4-b066-af291b2fbbd9-istiod-ca-cert\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527125 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-credential-socket\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527125 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527086    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-envoy\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527125 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-data\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527125 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-certs\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhkkb\" (UniqueName: \"kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-kube-api-access-rhkkb\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-token\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527243    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-podinfo\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527270    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-socket\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4afe9100-eeef-42c4-b066-af291b2fbbd9-istiod-ca-cert\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527733 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-credential-socket\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527733 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-certs\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527844 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527792    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-data\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527897 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527851    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-socket\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.527991 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.527974    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4afe9100-eeef-42c4-b066-af291b2fbbd9-istiod-ca-cert\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.529335 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.529319    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-envoy\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.529699 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.529666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-podinfo\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.536332 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.536308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-token\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.536448 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.536362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhkkb\" (UniqueName: \"kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-kube-api-access-rhkkb\") pod \"e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") " pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.573911 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.573882    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:35.752522 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.752487    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:35.856524 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.856500    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"]
Sep 14 11:04:35.858024 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:04:35.857996    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4afe9100_eeef_42c4_b066_af291b2fbbd9.slice/crio-89e0e7f14d2d79b8fc0d8ee731d8657a1aaba1f949577c80c8088dd27896211c WatchSource:0}: Error finding container 89e0e7f14d2d79b8fc0d8ee731d8657a1aaba1f949577c80c8088dd27896211c: Status 404 returned error can't find the container with id 89e0e7f14d2d79b8fc0d8ee731d8657a1aaba1f949577c80c8088dd27896211c
Sep 14 11:04:35.860726 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.860687    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:04:35.860828 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.860777    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:04:35.860890 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:35.860824    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:04:36.218615 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:36.218522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:36.561089 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:36.561059    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19721f14-e832-408c-99b6-271c4da74ef6" path="/var/lib/kubelet/pods/19721f14-e832-408c-99b6-271c4da74ef6/volumes"
Sep 14 11:04:36.576050 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:36.576020    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" event={"ID":"4afe9100-eeef-42c4-b066-af291b2fbbd9","Type":"ContainerStarted","Data":"93c980722be688ee6d0de27793a14819a1d4c7d36616d40c855b7e207fdc8c9b"}
Sep 14 11:04:36.576198 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:36.576069    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" event={"ID":"4afe9100-eeef-42c4-b066-af291b2fbbd9","Type":"ContainerStarted","Data":"89e0e7f14d2d79b8fc0d8ee731d8657a1aaba1f949577c80c8088dd27896211c"}
Sep 14 11:04:36.618740 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:36.618681    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" podStartSLOduration=1.618634241 podStartE2EDuration="1.618634241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:04:36.611578239 +0000 UTC m=+936.592213744" watchObservedRunningTime="2026-09-14 11:04:36.618634241 +0000 UTC m=+936.599269746"
Sep 14 11:04:36.753775 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:36.753741    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:37.439798 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:37.439766    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:37.574619 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:37.574586    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:37.579993 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:37.579968    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:37.581003 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:37.580981    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:37.581777 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:37.581761    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:04:37.604795 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:37.604767    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:37.700171 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:37.700089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:38.161087 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:38.161058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:38.245801 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:38.245770    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:38.772449 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:38.772416    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:39.479673 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:39.479624    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:40.383517 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:40.383483    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:41.247796 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:41.247760    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:41.428268 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:41.428181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:41.516846 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:41.516812    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:41.841436 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:41.841401    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:41.945904 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:41.945873    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:42.031172 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.031139    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"]
Sep 14 11:04:42.034467 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.034451    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:04:42.036952 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.036931    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-73290f4b-dockercfg-z4pm7\""
Sep 14 11:04:42.037242 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.037225    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-73290f4b\""
Sep 14 11:04:42.045775 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.045753    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"]
Sep 14 11:04:42.191978 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.191877    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dfeb2fc-4030-4599-9628-bea6ed39934a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc\" (UID: \"0dfeb2fc-4030-4599-9628-bea6ed39934a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:04:42.191978 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.191922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shhgl\" (UniqueName: \"kubernetes.io/projected/0dfeb2fc-4030-4599-9628-bea6ed39934a-kube-api-access-shhgl\") pod \"payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc\" (UID: \"0dfeb2fc-4030-4599-9628-bea6ed39934a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:04:42.292593 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.292558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dfeb2fc-4030-4599-9628-bea6ed39934a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc\" (UID: \"0dfeb2fc-4030-4599-9628-bea6ed39934a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:04:42.292782 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.292602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shhgl\" (UniqueName: \"kubernetes.io/projected/0dfeb2fc-4030-4599-9628-bea6ed39934a-kube-api-access-shhgl\") pod \"payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc\" (UID: \"0dfeb2fc-4030-4599-9628-bea6ed39934a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:04:42.293302 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.293276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dfeb2fc-4030-4599-9628-bea6ed39934a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc\" (UID: \"0dfeb2fc-4030-4599-9628-bea6ed39934a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:04:42.300591 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.300560    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shhgl\" (UniqueName: \"kubernetes.io/projected/0dfeb2fc-4030-4599-9628-bea6ed39934a-kube-api-access-shhgl\") pod \"payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc\" (UID: \"0dfeb2fc-4030-4599-9628-bea6ed39934a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:04:42.346163 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.346126    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:04:42.369935 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.369899    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:42.621390 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:42.621357    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"]
Sep 14 11:04:42.622056 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:04:42.622028    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dfeb2fc_4030_4599_9628_bea6ed39934a.slice/crio-32bab8a47af60b361a09aaf361fe8c67bcdecd66a5b41da958580ec08fbed5e2 WatchSource:0}: Error finding container 32bab8a47af60b361a09aaf361fe8c67bcdecd66a5b41da958580ec08fbed5e2: Status 404 returned error can't find the container with id 32bab8a47af60b361a09aaf361fe8c67bcdecd66a5b41da958580ec08fbed5e2
Sep 14 11:04:43.616479 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:43.616444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc" event={"ID":"0dfeb2fc-4030-4599-9628-bea6ed39934a","Type":"ContainerStarted","Data":"321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7"}
Sep 14 11:04:43.616699 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:43.616630    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:04:43.616761 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:43.616693    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc" event={"ID":"0dfeb2fc-4030-4599-9628-bea6ed39934a","Type":"ContainerStarted","Data":"32bab8a47af60b361a09aaf361fe8c67bcdecd66a5b41da958580ec08fbed5e2"}
Sep 14 11:04:43.634480 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:43.634429    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc" podStartSLOduration=1.634412176 podStartE2EDuration="1.634412176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:04:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:04:43.633391423 +0000 UTC m=+943.614026930" watchObservedRunningTime="2026-09-14 11:04:43.634412176 +0000 UTC m=+943.615047680"
Sep 14 11:04:43.954101 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:43.954019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:44.242694 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:44.242638    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:44.791393 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:44.791359    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:44.893334 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:44.893303    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:04:54.624189 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:04:54.624157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:05:00.711161 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:00.711080    2576 generic.go:356] "Generic (PLEG): container finished" podID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerID="93c980722be688ee6d0de27793a14819a1d4c7d36616d40c855b7e207fdc8c9b" exitCode=0
Sep 14 11:05:00.711571 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:00.711154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" event={"ID":"4afe9100-eeef-42c4-b066-af291b2fbbd9","Type":"ContainerDied","Data":"93c980722be688ee6d0de27793a14819a1d4c7d36616d40c855b7e207fdc8c9b"}
Sep 14 11:05:00.711571 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:00.711563    2576 scope.go:117] "RemoveContainer" containerID="93c980722be688ee6d0de27793a14819a1d4c7d36616d40c855b7e207fdc8c9b"
Sep 14 11:05:00.712667 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:00.712626    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:05:00.712733 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:00.712719    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:05:00.712770 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:00.712756    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:05:01.721170 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:01.721137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" event={"ID":"4afe9100-eeef-42c4-b066-af291b2fbbd9","Type":"ContainerStarted","Data":"67b29ef0f8aff89f71d6ef861dbe7fc5f5acdb6f1e1631bd9c0070defdcffb63"}
Sep 14 11:05:02.574210 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:02.574163    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:05:02.574566 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:02.574537    2576 patch_prober.go:28] interesting pod/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 14 11:05:02.574687 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:02.574592    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 14 11:05:03.574550 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:03.574509    2576 patch_prober.go:28] interesting pod/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 14 11:05:03.575565 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:03.575172    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 14 11:05:03.978766 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:03.978685    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:04.575114 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:04.575077    2576 patch_prober.go:28] interesting pod/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 14 11:05:04.575606 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:04.575146    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 14 11:05:04.982347 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:04.982315    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:05.575190 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:05.575154    2576 patch_prober.go:28] interesting pod/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 14 11:05:05.575783 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:05.575750    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 14 11:05:05.889421 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:05.889331    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:06.574608 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:06.574570    2576 patch_prober.go:28] interesting pod/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 14 11:05:06.574912 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:06.574880    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 14 11:05:06.827899 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:06.827806    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:07.575324 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:07.575284    2576 patch_prober.go:28] interesting pod/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 14 11:05:07.575662 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:07.575617    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 14 11:05:07.581765 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:07.581739    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:05:08.183988 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:08.183957    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:08.578883 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:08.578854    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:05:08.579883 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:08.579863    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:05:09.066462 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:09.066424    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:09.801389 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:09.801360    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:10.788756 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:10.788722    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:11.750518 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:11.750480    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:12.529460 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:12.529425    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:13.318228 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:13.318192    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:14.232275 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:14.232245    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:19.389339 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:19.389312    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:20.123197 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.123165    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:20.182156 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.182123    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"]
Sep 14 11:05:20.182376 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.182349    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc" podUID="0dfeb2fc-4030-4599-9628-bea6ed39934a" containerName="payload-pre-processing" containerID="cri-o://321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7" gracePeriod=30
Sep 14 11:05:20.221212 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.221186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:20.325007 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.324959    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:20.450433 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.450409    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:05:20.452851 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.452809    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:20.562699 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.562642    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:20.563808 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.563783    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dfeb2fc-4030-4599-9628-bea6ed39934a-plugins-config-volume\") pod \"0dfeb2fc-4030-4599-9628-bea6ed39934a\" (UID: \"0dfeb2fc-4030-4599-9628-bea6ed39934a\") "
Sep 14 11:05:20.563958 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.563895    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shhgl\" (UniqueName: \"kubernetes.io/projected/0dfeb2fc-4030-4599-9628-bea6ed39934a-kube-api-access-shhgl\") pod \"0dfeb2fc-4030-4599-9628-bea6ed39934a\" (UID: \"0dfeb2fc-4030-4599-9628-bea6ed39934a\") "
Sep 14 11:05:20.564421 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.564389    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dfeb2fc-4030-4599-9628-bea6ed39934a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0dfeb2fc-4030-4599-9628-bea6ed39934a" (UID: "0dfeb2fc-4030-4599-9628-bea6ed39934a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:05:20.566703 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.566674    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dfeb2fc-4030-4599-9628-bea6ed39934a-kube-api-access-shhgl" (OuterVolumeSpecName: "kube-api-access-shhgl") pod "0dfeb2fc-4030-4599-9628-bea6ed39934a" (UID: "0dfeb2fc-4030-4599-9628-bea6ed39934a"). InnerVolumeSpecName "kube-api-access-shhgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:05:20.656840 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.656781    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"]
Sep 14 11:05:20.657056 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.657026    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy" containerID="cri-o://67b29ef0f8aff89f71d6ef861dbe7fc5f5acdb6f1e1631bd9c0070defdcffb63" gracePeriod=30
Sep 14 11:05:20.664785 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.664758    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shhgl\" (UniqueName: \"kubernetes.io/projected/0dfeb2fc-4030-4599-9628-bea6ed39934a-kube-api-access-shhgl\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:05:20.664971 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.664952    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dfeb2fc-4030-4599-9628-bea6ed39934a-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:05:20.671134 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.671099    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:20.816493 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.816460    2576 generic.go:356] "Generic (PLEG): container finished" podID="0dfeb2fc-4030-4599-9628-bea6ed39934a" containerID="321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7" exitCode=0
Sep 14 11:05:20.816692 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.816524    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"
Sep 14 11:05:20.816692 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.816553    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc" event={"ID":"0dfeb2fc-4030-4599-9628-bea6ed39934a","Type":"ContainerDied","Data":"321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7"}
Sep 14 11:05:20.816692 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.816607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc" event={"ID":"0dfeb2fc-4030-4599-9628-bea6ed39934a","Type":"ContainerDied","Data":"32bab8a47af60b361a09aaf361fe8c67bcdecd66a5b41da958580ec08fbed5e2"}
Sep 14 11:05:20.816692 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.816630    2576 scope.go:117] "RemoveContainer" containerID="321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7"
Sep 14 11:05:20.826086 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.826067    2576 scope.go:117] "RemoveContainer" containerID="321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7"
Sep 14 11:05:20.826372 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:05:20.826355    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7\": container with ID starting with 321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7 not found: ID does not exist" containerID="321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7"
Sep 14 11:05:20.826435 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.826382    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7"} err="failed to get container status \"321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7\": rpc error: code = NotFound desc = could not find container \"321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7\": container with ID starting with 321237419d6b6e803d263db423302e687521983d230f55262fe08ba85fa83fa7 not found: ID does not exist"
Sep 14 11:05:20.843880 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.843846    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"]
Sep 14 11:05:20.848289 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:20.848262    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc"]
Sep 14 11:05:21.023285 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.023257    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:21.130947 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.130867    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:21.523949 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.523914    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"]
Sep 14 11:05:21.524506 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.524486    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dfeb2fc-4030-4599-9628-bea6ed39934a" containerName="payload-pre-processing"
Sep 14 11:05:21.524587 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.524509    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dfeb2fc-4030-4599-9628-bea6ed39934a" containerName="payload-pre-processing"
Sep 14 11:05:21.524671 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.524635    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dfeb2fc-4030-4599-9628-bea6ed39934a" containerName="payload-pre-processing"
Sep 14 11:05:21.527300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.527282    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.532117 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.532098    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1d16dc05-openshift-default-dockercfg-52z5g\""
Sep 14 11:05:21.565474 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.565446    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"]
Sep 14 11:05:21.573697 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.573608    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:21.674764 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.674730    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-envoy\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.674929 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.674790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-certs\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.674929 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.674856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-credential-socket\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.675027 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.674971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-podinfo\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.675027 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.675017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-socket\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.675140 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.675059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-data\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.675201 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.675154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-token\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.675397 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.675369    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istiod-ca-cert\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.675525 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.675414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdmln\" (UniqueName: \"kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-kube-api-access-kdmln\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.776723 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.776623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-socket\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.776723 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.776691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-data\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.776723 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.776716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-token\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.776971 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.776743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istiod-ca-cert\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.776971 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.776761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdmln\" (UniqueName: \"kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-kube-api-access-kdmln\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.776971 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.776844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-envoy\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.776971 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.776881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-certs\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.776971 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.776911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-credential-socket\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.777228 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.777005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-podinfo\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.777228 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.777204    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-certs\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.777373 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.777323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-socket\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.777439 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.777409    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-credential-socket\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.777492 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.777438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-data\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.777674 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.777617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istiod-ca-cert\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.779265 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.779242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-envoy\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.779438 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.779422    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-podinfo\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.791744 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.791719    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdmln\" (UniqueName: \"kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-kube-api-access-kdmln\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.792193 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.792175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-token\") pod \"e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") " pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:21.837866 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:21.837836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:22.130303 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:05:22.130278    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4e8868_2fd3_4cc6_9885_b6e132efcaed.slice/crio-08cbdd0a96fd38a2505a132779e6c9041e3a530631b4199c2fc2180f22ddee0b WatchSource:0}: Error finding container 08cbdd0a96fd38a2505a132779e6c9041e3a530631b4199c2fc2180f22ddee0b: Status 404 returned error can't find the container with id 08cbdd0a96fd38a2505a132779e6c9041e3a530631b4199c2fc2180f22ddee0b
Sep 14 11:05:22.132478 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:22.132446    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:05:22.132561 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:22.132518    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:05:22.132561 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:22.132545    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:05:22.142200 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:22.142175    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"]
Sep 14 11:05:22.340016 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:22.339977    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:22.564127 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:22.564089    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dfeb2fc-4030-4599-9628-bea6ed39934a" path="/var/lib/kubelet/pods/0dfeb2fc-4030-4599-9628-bea6ed39934a/volumes"
Sep 14 11:05:22.621334 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:22.621294    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:22.830783 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:22.830692    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" event={"ID":"2d4e8868-2fd3-4cc6-9885-b6e132efcaed","Type":"ContainerStarted","Data":"2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8"}
Sep 14 11:05:22.830783 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:22.830758    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" event={"ID":"2d4e8868-2fd3-4cc6-9885-b6e132efcaed","Type":"ContainerStarted","Data":"08cbdd0a96fd38a2505a132779e6c9041e3a530631b4199c2fc2180f22ddee0b"}
Sep 14 11:05:22.838014 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:22.837995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:22.871112 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:22.871055    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" podStartSLOduration=1.871037897 podStartE2EDuration="1.871037897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:05:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:05:22.869763797 +0000 UTC m=+982.850399303" watchObservedRunningTime="2026-09-14 11:05:22.871037897 +0000 UTC m=+982.851673401"
Sep 14 11:05:23.581907 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:23.581869    2576 patch_prober.go:28] interesting pod/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 11:05:23.582291 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:23.581936    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 11:05:23.735992 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:23.735954    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:23.843032 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:23.842956    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:24.345362 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:24.345330    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:24.454602 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:24.454538    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:24.839294 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:24.839261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:24.841343 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:24.841311    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:24.842217 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:24.842194    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:25.851564 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:25.851482    2576 generic.go:356] "Generic (PLEG): container finished" podID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerID="67b29ef0f8aff89f71d6ef861dbe7fc5f5acdb6f1e1631bd9c0070defdcffb63" exitCode=0
Sep 14 11:05:25.852007 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:25.851937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" event={"ID":"4afe9100-eeef-42c4-b066-af291b2fbbd9","Type":"ContainerDied","Data":"67b29ef0f8aff89f71d6ef861dbe7fc5f5acdb6f1e1631bd9c0070defdcffb63"}
Sep 14 11:05:25.852081 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:25.852010    2576 scope.go:117] "RemoveContainer" containerID="93c980722be688ee6d0de27793a14819a1d4c7d36616d40c855b7e207fdc8c9b"
Sep 14 11:05:25.885313 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:25.885284    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:25.921492 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:25.921418    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:05:26.120799 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.120769    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-socket\") pod \"4afe9100-eeef-42c4-b066-af291b2fbbd9\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") "
Sep 14 11:05:26.120799 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.120801    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-envoy\") pod \"4afe9100-eeef-42c4-b066-af291b2fbbd9\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") "
Sep 14 11:05:26.121006 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.120846    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-data\") pod \"4afe9100-eeef-42c4-b066-af291b2fbbd9\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") "
Sep 14 11:05:26.121006 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.120880    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-credential-socket\") pod \"4afe9100-eeef-42c4-b066-af291b2fbbd9\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") "
Sep 14 11:05:26.121006 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.120896    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhkkb\" (UniqueName: \"kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-kube-api-access-rhkkb\") pod \"4afe9100-eeef-42c4-b066-af291b2fbbd9\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") "
Sep 14 11:05:26.121006 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.120916    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-token\") pod \"4afe9100-eeef-42c4-b066-af291b2fbbd9\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") "
Sep 14 11:05:26.121006 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.120983    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-podinfo\") pod \"4afe9100-eeef-42c4-b066-af291b2fbbd9\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") "
Sep 14 11:05:26.121283 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121027    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-certs\") pod \"4afe9100-eeef-42c4-b066-af291b2fbbd9\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") "
Sep 14 11:05:26.121283 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121064    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4afe9100-eeef-42c4-b066-af291b2fbbd9" (UID: "4afe9100-eeef-42c4-b066-af291b2fbbd9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:05:26.121283 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121083    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4afe9100-eeef-42c4-b066-af291b2fbbd9-istiod-ca-cert\") pod \"4afe9100-eeef-42c4-b066-af291b2fbbd9\" (UID: \"4afe9100-eeef-42c4-b066-af291b2fbbd9\") "
Sep 14 11:05:26.121283 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121194    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-data" (OuterVolumeSpecName: "istio-data") pod "4afe9100-eeef-42c4-b066-af291b2fbbd9" (UID: "4afe9100-eeef-42c4-b066-af291b2fbbd9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:05:26.121283 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121206    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4afe9100-eeef-42c4-b066-af291b2fbbd9" (UID: "4afe9100-eeef-42c4-b066-af291b2fbbd9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:05:26.121545 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121408    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4afe9100-eeef-42c4-b066-af291b2fbbd9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4afe9100-eeef-42c4-b066-af291b2fbbd9" (UID: "4afe9100-eeef-42c4-b066-af291b2fbbd9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:05:26.121545 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121413    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4afe9100-eeef-42c4-b066-af291b2fbbd9" (UID: "4afe9100-eeef-42c4-b066-af291b2fbbd9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:05:26.121545 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121522    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-data\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:05:26.121545 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121541    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-credential-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:05:26.121728 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121557    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:05:26.121728 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121570    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4afe9100-eeef-42c4-b066-af291b2fbbd9-istiod-ca-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:05:26.121728 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.121582    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-workload-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:05:26.123329 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.123296    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-kube-api-access-rhkkb" (OuterVolumeSpecName: "kube-api-access-rhkkb") pod "4afe9100-eeef-42c4-b066-af291b2fbbd9" (UID: "4afe9100-eeef-42c4-b066-af291b2fbbd9"). InnerVolumeSpecName "kube-api-access-rhkkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:05:26.123453 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.123358    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4afe9100-eeef-42c4-b066-af291b2fbbd9" (UID: "4afe9100-eeef-42c4-b066-af291b2fbbd9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:05:26.123596 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.123569    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-token" (OuterVolumeSpecName: "istio-token") pod "4afe9100-eeef-42c4-b066-af291b2fbbd9" (UID: "4afe9100-eeef-42c4-b066-af291b2fbbd9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:05:26.123711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.123627    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4afe9100-eeef-42c4-b066-af291b2fbbd9" (UID: "4afe9100-eeef-42c4-b066-af291b2fbbd9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 11:05:26.222360 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.222274    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-envoy\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:05:26.222360 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.222304    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhkkb\" (UniqueName: \"kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-kube-api-access-rhkkb\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:05:26.222360 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.222315    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:05:26.222360 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.222323    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4afe9100-eeef-42c4-b066-af291b2fbbd9-istio-podinfo\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:05:26.789331 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.789294    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:26.871016 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.869105    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"
Sep 14 11:05:26.871016 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.869346    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b" event={"ID":"4afe9100-eeef-42c4-b066-af291b2fbbd9","Type":"ContainerDied","Data":"89e0e7f14d2d79b8fc0d8ee731d8657a1aaba1f949577c80c8088dd27896211c"}
Sep 14 11:05:26.871016 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.869404    2576 scope.go:117] "RemoveContainer" containerID="67b29ef0f8aff89f71d6ef861dbe7fc5f5acdb6f1e1631bd9c0070defdcffb63"
Sep 14 11:05:26.898091 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.898060    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"]
Sep 14 11:05:26.901704 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:26.901675    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b"]
Sep 14 11:05:27.837587 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:27.837555    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:27.941276 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:27.941244    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:28.510616 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.510577    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:28.560879 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.560846    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" path="/var/lib/kubelet/pods/4afe9100-eeef-42c4-b066-af291b2fbbd9/volumes"
Sep 14 11:05:28.612443 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.612409    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:28.632744 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.632715    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"]
Sep 14 11:05:28.633111 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.633099    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy"
Sep 14 11:05:28.633166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.633113    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy"
Sep 14 11:05:28.633166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.633128    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy"
Sep 14 11:05:28.633166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.633133    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy"
Sep 14 11:05:28.633274 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.633196    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy"
Sep 14 11:05:28.636314 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.636291    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:05:28.639282 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.639264    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1d16dc05\""
Sep 14 11:05:28.641552 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.641524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqlsv\" (UniqueName: \"kubernetes.io/projected/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-kube-api-access-jqlsv\") pod \"payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f\" (UID: \"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a\") " pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:05:28.641703 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.641580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-plugins-config-volume\") pod \"payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f\" (UID: \"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a\") " pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:05:28.650631 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.650610    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"]
Sep 14 11:05:28.743182 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.742097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqlsv\" (UniqueName: \"kubernetes.io/projected/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-kube-api-access-jqlsv\") pod \"payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f\" (UID: \"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a\") " pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:05:28.743182 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.742155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-plugins-config-volume\") pod \"payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f\" (UID: \"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a\") " pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:05:28.743182 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.743069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-plugins-config-volume\") pod \"payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f\" (UID: \"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a\") " pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:05:28.760435 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.760353    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqlsv\" (UniqueName: \"kubernetes.io/projected/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-kube-api-access-jqlsv\") pod \"payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f\" (UID: \"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a\") " pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:05:28.946441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:28.946352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:05:29.093250 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:29.093218    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:29.225170 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:29.225142    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"]
Sep 14 11:05:29.227034 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:05:29.227007    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db5afa7_c3ea_46cd_b9b7_8eb05813f36a.slice/crio-c4c19a506d2efe64f7cfaa0e8a0a9726bea1685219fd363ade09e88c94607d3d WatchSource:0}: Error finding container c4c19a506d2efe64f7cfaa0e8a0a9726bea1685219fd363ade09e88c94607d3d: Status 404 returned error can't find the container with id c4c19a506d2efe64f7cfaa0e8a0a9726bea1685219fd363ade09e88c94607d3d
Sep 14 11:05:29.886592 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:29.886559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f" event={"ID":"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a","Type":"ContainerStarted","Data":"8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605"}
Sep 14 11:05:29.886798 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:29.886607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f" event={"ID":"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a","Type":"ContainerStarted","Data":"c4c19a506d2efe64f7cfaa0e8a0a9726bea1685219fd363ade09e88c94607d3d"}
Sep 14 11:05:29.886798 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:29.886643    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:05:29.905771 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:29.905710    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f" podStartSLOduration=1.9056910230000002 podStartE2EDuration="1.905691023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:05:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:05:29.903485949 +0000 UTC m=+989.884121454" watchObservedRunningTime="2026-09-14 11:05:29.905691023 +0000 UTC m=+989.886326525"
Sep 14 11:05:29.980745 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:29.980710    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:30.940634 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:30.940600    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:33.923528 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:33.923493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:34.093850 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:34.093815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:34.270988 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:34.270958    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:40.894900 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:40.894860    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:05:48.991577 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:48.991543    2576 generic.go:356] "Generic (PLEG): container finished" podID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerID="2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8" exitCode=0
Sep 14 11:05:48.992011 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:48.991619    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" event={"ID":"2d4e8868-2fd3-4cc6-9885-b6e132efcaed","Type":"ContainerDied","Data":"2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8"}
Sep 14 11:05:48.992140 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:48.992120    2576 scope.go:117] "RemoveContainer" containerID="2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8"
Sep 14 11:05:48.993328 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:48.993301    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:05:48.993389 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:48.993367    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:05:48.993425 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:48.993399    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:05:49.070429 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:49.070394    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:50.003355 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:50.003316    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" event={"ID":"2d4e8868-2fd3-4cc6-9885-b6e132efcaed","Type":"ContainerStarted","Data":"390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538"}
Sep 14 11:05:50.817107 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:50.817074    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:50.839123 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:50.839095    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:50.840253 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:50.840232    2576 patch_prober.go:28] interesting pod/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 14 11:05:50.840351 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:50.840288    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 14 11:05:51.779590 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:51.779521    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:51.838366 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:51.838333    2576 patch_prober.go:28] interesting pod/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 14 11:05:51.838529 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:51.838391    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 14 11:05:52.825118 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:52.825087    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:52.839210 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:52.839182    2576 patch_prober.go:28] interesting pod/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 14 11:05:52.839365 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:52.839231    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 14 11:05:53.838370 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:53.838339    2576 patch_prober.go:28] interesting pod/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 14 11:05:53.838785 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:53.838394    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 14 11:05:53.922052 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:53.922014    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:54.838661 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:54.838627    2576 patch_prober.go:28] interesting pod/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 14 11:05:54.839037 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:54.838710    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 14 11:05:54.841779 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:54.841755    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:55.048175 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:55.048138    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:55.842670 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:55.842624    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:55.843967 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:55.843944    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:05:56.011966 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:56.011933    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:56.749466 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:56.749432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:57.598786 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:57.598758    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:58.637417 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:58.637388    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:05:59.992797 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:05:59.992768    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:00.930218 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:00.930132    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:02.080236 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:02.080207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:04.641873 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:04.641841    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:06.050597 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:06.050549    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:06.982236 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:06.982204    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:07.023102 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.023068    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"]
Sep 14 11:06:07.023392 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.023366    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f" podUID="2db5afa7-c3ea-46cd-b9b7-8eb05813f36a" containerName="payload-processing" containerID="cri-o://8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605" gracePeriod=30
Sep 14 11:06:07.101153 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.101100    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:07.241529 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.241287    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:07.290921 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.290895    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:06:07.325459 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.325427    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqlsv\" (UniqueName: \"kubernetes.io/projected/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-kube-api-access-jqlsv\") pod \"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a\" (UID: \"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a\") "
Sep 14 11:06:07.325827 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.325533    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-plugins-config-volume\") pod \"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a\" (UID: \"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a\") "
Sep 14 11:06:07.326219 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.326178    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2db5afa7-c3ea-46cd-b9b7-8eb05813f36a" (UID: "2db5afa7-c3ea-46cd-b9b7-8eb05813f36a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:06:07.328319 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.328297    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-kube-api-access-jqlsv" (OuterVolumeSpecName: "kube-api-access-jqlsv") pod "2db5afa7-c3ea-46cd-b9b7-8eb05813f36a" (UID: "2db5afa7-c3ea-46cd-b9b7-8eb05813f36a"). InnerVolumeSpecName "kube-api-access-jqlsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:06:07.329816 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.329792    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:07.426475 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.426420    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:07.426475 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.426470    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqlsv\" (UniqueName: \"kubernetes.io/projected/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a-kube-api-access-jqlsv\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:07.713633 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:07.713542    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:08.094573 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.094542    2576 generic.go:356] "Generic (PLEG): container finished" podID="2db5afa7-c3ea-46cd-b9b7-8eb05813f36a" containerID="8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605" exitCode=0
Sep 14 11:06:08.094846 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.094602    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"
Sep 14 11:06:08.094846 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.094605    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f" event={"ID":"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a","Type":"ContainerDied","Data":"8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605"}
Sep 14 11:06:08.094846 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.094735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f" event={"ID":"2db5afa7-c3ea-46cd-b9b7-8eb05813f36a","Type":"ContainerDied","Data":"c4c19a506d2efe64f7cfaa0e8a0a9726bea1685219fd363ade09e88c94607d3d"}
Sep 14 11:06:08.094846 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.094770    2576 scope.go:117] "RemoveContainer" containerID="8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605"
Sep 14 11:06:08.103529 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.103511    2576 scope.go:117] "RemoveContainer" containerID="8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605"
Sep 14 11:06:08.103818 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:06:08.103801    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605\": container with ID starting with 8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605 not found: ID does not exist" containerID="8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605"
Sep 14 11:06:08.103860 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.103825    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605"} err="failed to get container status \"8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605\": rpc error: code = NotFound desc = could not find container \"8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605\": container with ID starting with 8b8a22460dac8b799e11cebe994bc822aff04fbf18e6a662fa5ae7b9aceca605 not found: ID does not exist"
Sep 14 11:06:08.118919 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.118889    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"]
Sep 14 11:06:08.122976 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.122954    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f"]
Sep 14 11:06:08.432338 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.432257    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"]
Sep 14 11:06:08.432510 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.432486    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy" containerID="cri-o://390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538" gracePeriod=30
Sep 14 11:06:08.472233 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.472205    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:08.563857 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.563813    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2db5afa7-c3ea-46cd-b9b7-8eb05813f36a" path="/var/lib/kubelet/pods/2db5afa7-c3ea-46cd-b9b7-8eb05813f36a/volumes"
Sep 14 11:06:08.797415 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.797386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:08.935528 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:08.935498    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:09.263665 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.263620    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"]
Sep 14 11:06:09.264201 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.264180    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db5afa7-c3ea-46cd-b9b7-8eb05813f36a" containerName="payload-processing"
Sep 14 11:06:09.264282 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.264204    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db5afa7-c3ea-46cd-b9b7-8eb05813f36a" containerName="payload-processing"
Sep 14 11:06:09.264343 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.264317    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4afe9100-eeef-42c4-b066-af291b2fbbd9" containerName="istio-proxy"
Sep 14 11:06:09.264343 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.264330    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2db5afa7-c3ea-46cd-b9b7-8eb05813f36a" containerName="payload-processing"
Sep 14 11:06:09.268869 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.268847    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.272277 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.272255    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-bcc15f82-openshift-default-dockercfg-k6dcf\""
Sep 14 11:06:09.285200 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.285179    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"]
Sep 14 11:06:09.306184 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.306160    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:09.341727 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.341642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-envoy\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.341727 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.341708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-certs\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.341727 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.341752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istiod-ca-cert\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.342243 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.341790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-credential-socket\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.342243 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.341849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-socket\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.342243 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.341880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-data\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.342243 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.341902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-token\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.342243 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.341931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q42p9\" (UniqueName: \"kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-kube-api-access-q42p9\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.342243 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.341962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-podinfo\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.443310 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-envoy\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.443310 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-certs\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.443546 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istiod-ca-cert\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.443546 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-credential-socket\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.443546 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-socket\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.443546 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-data\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.443546 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-token\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.443546 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q42p9\" (UniqueName: \"kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-kube-api-access-q42p9\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.443930 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-podinfo\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.443930 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443859    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-credential-socket\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.443930 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443884    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-data\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.444079 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.443961    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-socket\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.444079 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.444040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-certs\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.444229 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.444213    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istiod-ca-cert\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.445727 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.445706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-envoy\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.446027 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.446006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-podinfo\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.454312 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.454292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-token\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.460965 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.460915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q42p9\" (UniqueName: \"kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-kube-api-access-q42p9\") pod \"e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") " pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.579994 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.579901    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:09.791230 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.791200    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:09.880301 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.880226    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"]
Sep 14 11:06:09.883358 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:06:09.883335    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299534ea_d9d6_4ebb_9eb6_c2d7243268eb.slice/crio-495a6c53803aabf038de72a66ca8fe64f40a6536beb113a8ac34fd584de9f9f4 WatchSource:0}: Error finding container 495a6c53803aabf038de72a66ca8fe64f40a6536beb113a8ac34fd584de9f9f4: Status 404 returned error can't find the container with id 495a6c53803aabf038de72a66ca8fe64f40a6536beb113a8ac34fd584de9f9f4
Sep 14 11:06:09.886038 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.885998    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:06:09.886115 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.886086    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:06:09.886155 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:09.886126    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:06:10.107118 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:10.107086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" event={"ID":"299534ea-d9d6-4ebb-9eb6-c2d7243268eb","Type":"ContainerStarted","Data":"e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1"}
Sep 14 11:06:10.107314 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:10.107135    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" event={"ID":"299534ea-d9d6-4ebb-9eb6-c2d7243268eb","Type":"ContainerStarted","Data":"495a6c53803aabf038de72a66ca8fe64f40a6536beb113a8ac34fd584de9f9f4"}
Sep 14 11:06:10.110386 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:10.110358    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:10.146971 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:10.146877    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" podStartSLOduration=1.146860945 podStartE2EDuration="1.146860945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:06:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:06:10.146267255 +0000 UTC m=+1030.126902776" watchObservedRunningTime="2026-09-14 11:06:10.146860945 +0000 UTC m=+1030.127496510"
Sep 14 11:06:10.580172 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:10.580144    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:10.585611 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:10.585582    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:10.845931 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:10.845856    2576 patch_prober.go:28] interesting pod/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 11:06:10.846075 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:10.845932    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 11:06:11.111961 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:11.111872    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:11.112978 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:11.112957    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:11.707879 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:11.707846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:13.125040 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.125007    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:13.225586 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.225554    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:13.578602 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.578560    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:13.729446 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.729422    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:06:13.787724 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.787696    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-token\") pod \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") "
Sep 14 11:06:13.787910 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.787740    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-certs\") pod \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") "
Sep 14 11:06:13.787910 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.787771    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-socket\") pod \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") "
Sep 14 11:06:13.787910 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.787816    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdmln\" (UniqueName: \"kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-kube-api-access-kdmln\") pod \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") "
Sep 14 11:06:13.787910 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.787879    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-data\") pod \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") "
Sep 14 11:06:13.787910 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.787907    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-credential-socket\") pod \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") "
Sep 14 11:06:13.788216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.787939    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-envoy\") pod \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") "
Sep 14 11:06:13.788216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.787973    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-podinfo\") pod \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") "
Sep 14 11:06:13.788216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.788002    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istiod-ca-cert\") pod \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\" (UID: \"2d4e8868-2fd3-4cc6-9885-b6e132efcaed\") "
Sep 14 11:06:13.788216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.787993    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d4e8868-2fd3-4cc6-9885-b6e132efcaed" (UID: "2d4e8868-2fd3-4cc6-9885-b6e132efcaed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:06:13.788216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.788018    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d4e8868-2fd3-4cc6-9885-b6e132efcaed" (UID: "2d4e8868-2fd3-4cc6-9885-b6e132efcaed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:06:13.788216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.788194    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d4e8868-2fd3-4cc6-9885-b6e132efcaed" (UID: "2d4e8868-2fd3-4cc6-9885-b6e132efcaed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:06:13.788514 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.788300    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d4e8868-2fd3-4cc6-9885-b6e132efcaed" (UID: "2d4e8868-2fd3-4cc6-9885-b6e132efcaed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:06:13.788514 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.788372    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d4e8868-2fd3-4cc6-9885-b6e132efcaed" (UID: "2d4e8868-2fd3-4cc6-9885-b6e132efcaed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:06:13.788514 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.788497    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:13.788750 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.788516    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-workload-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:13.788750 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.788529    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-data\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:13.788750 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.788543    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-credential-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:13.788750 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.788555    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istiod-ca-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:13.790665 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.790602    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d4e8868-2fd3-4cc6-9885-b6e132efcaed" (UID: "2d4e8868-2fd3-4cc6-9885-b6e132efcaed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:06:13.791977 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.791926    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-kube-api-access-kdmln" (OuterVolumeSpecName: "kube-api-access-kdmln") pod "2d4e8868-2fd3-4cc6-9885-b6e132efcaed" (UID: "2d4e8868-2fd3-4cc6-9885-b6e132efcaed"). InnerVolumeSpecName "kube-api-access-kdmln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:06:13.791977 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.791939    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d4e8868-2fd3-4cc6-9885-b6e132efcaed" (UID: "2d4e8868-2fd3-4cc6-9885-b6e132efcaed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:06:13.791977 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.791926    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d4e8868-2fd3-4cc6-9885-b6e132efcaed" (UID: "2d4e8868-2fd3-4cc6-9885-b6e132efcaed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 11:06:13.889809 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.889773    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:13.889809 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.889805    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdmln\" (UniqueName: \"kubernetes.io/projected/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-kube-api-access-kdmln\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:13.889809 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.889816    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-envoy\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:13.890051 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:13.889825    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4e8868-2fd3-4cc6-9885-b6e132efcaed-istio-podinfo\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:14.128514 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.128477    2576 generic.go:356] "Generic (PLEG): container finished" podID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerID="390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538" exitCode=0
Sep 14 11:06:14.128904 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.128528    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"
Sep 14 11:06:14.128904 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.128553    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" event={"ID":"2d4e8868-2fd3-4cc6-9885-b6e132efcaed","Type":"ContainerDied","Data":"390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538"}
Sep 14 11:06:14.128904 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.128608    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4" event={"ID":"2d4e8868-2fd3-4cc6-9885-b6e132efcaed","Type":"ContainerDied","Data":"08cbdd0a96fd38a2505a132779e6c9041e3a530631b4199c2fc2180f22ddee0b"}
Sep 14 11:06:14.128904 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.128629    2576 scope.go:117] "RemoveContainer" containerID="390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538"
Sep 14 11:06:14.138052 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.138028    2576 scope.go:117] "RemoveContainer" containerID="2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8"
Sep 14 11:06:14.146113 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.146095    2576 scope.go:117] "RemoveContainer" containerID="390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538"
Sep 14 11:06:14.146395 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:06:14.146373    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538\": container with ID starting with 390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538 not found: ID does not exist" containerID="390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538"
Sep 14 11:06:14.146486 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.146400    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538"} err="failed to get container status \"390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538\": rpc error: code = NotFound desc = could not find container \"390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538\": container with ID starting with 390d8063552a4fa1d54256dda09ca6695e6ac4509d5ed19cd43b09c51f6cd538 not found: ID does not exist"
Sep 14 11:06:14.146486 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.146416    2576 scope.go:117] "RemoveContainer" containerID="2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8"
Sep 14 11:06:14.146715 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:06:14.146695    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8\": container with ID starting with 2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8 not found: ID does not exist" containerID="2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8"
Sep 14 11:06:14.146770 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.146725    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8"} err="failed to get container status \"2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8\": rpc error: code = NotFound desc = could not find container \"2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8\": container with ID starting with 2032a68ec9d921acaf9f46c2bc284c8764a59255c9832547dfec40f0e97679a8 not found: ID does not exist"
Sep 14 11:06:14.156990 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.156968    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"]
Sep 14 11:06:14.161014 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.160994    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4"]
Sep 14 11:06:14.560551 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:14.560516    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" path="/var/lib/kubelet/pods/2d4e8868-2fd3-4cc6-9885-b6e132efcaed/volumes"
Sep 14 11:06:16.028379 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:16.028343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:16.132538 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:16.132491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:17.163764 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:17.163723    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:18.246388 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:18.246357    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:19.080539 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.080510    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"]
Sep 14 11:06:19.080933 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.080917    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy"
Sep 14 11:06:19.080933 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.080934    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy"
Sep 14 11:06:19.081040 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.081000    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy"
Sep 14 11:06:19.081040 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.081009    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy"
Sep 14 11:06:19.085423 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.085403    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:19.087756 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.087724    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-bcc15f82\""
Sep 14 11:06:19.099409 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.099384    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"]
Sep 14 11:06:19.141854 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.141825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvsxp\" (UniqueName: \"kubernetes.io/projected/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-kube-api-access-pvsxp\") pod \"payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726\" (UID: \"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2\") " pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:19.141854 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.141856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-plugins-config-volume\") pod \"payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726\" (UID: \"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2\") " pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:19.148446 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.148422    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"]
Sep 14 11:06:19.148823 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.148811    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy"
Sep 14 11:06:19.148870 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.148824    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d4e8868-2fd3-4cc6-9885-b6e132efcaed" containerName="istio-proxy"
Sep 14 11:06:19.152089 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.152066    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:19.154571 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.154555    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-bcc15f82-dockercfg-lb2ps\""
Sep 14 11:06:19.172920 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.172899    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"]
Sep 14 11:06:19.242624 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.242588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5h6q\" (UniqueName: \"kubernetes.io/projected/9cee87c7-4a2a-497a-b090-95fdde3d22de-kube-api-access-h5h6q\") pod \"payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr\" (UID: \"9cee87c7-4a2a-497a-b090-95fdde3d22de\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:19.242783 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.242692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvsxp\" (UniqueName: \"kubernetes.io/projected/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-kube-api-access-pvsxp\") pod \"payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726\" (UID: \"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2\") " pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:19.242783 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.242733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-plugins-config-volume\") pod \"payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726\" (UID: \"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2\") " pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:19.242873 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.242819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cee87c7-4a2a-497a-b090-95fdde3d22de-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr\" (UID: \"9cee87c7-4a2a-497a-b090-95fdde3d22de\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:19.243383 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.243364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-plugins-config-volume\") pod \"payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726\" (UID: \"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2\") " pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:19.252139 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.252108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvsxp\" (UniqueName: \"kubernetes.io/projected/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-kube-api-access-pvsxp\") pod \"payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726\" (UID: \"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2\") " pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:19.343811 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.343722    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5h6q\" (UniqueName: \"kubernetes.io/projected/9cee87c7-4a2a-497a-b090-95fdde3d22de-kube-api-access-h5h6q\") pod \"payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr\" (UID: \"9cee87c7-4a2a-497a-b090-95fdde3d22de\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:19.343811 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.343796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cee87c7-4a2a-497a-b090-95fdde3d22de-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr\" (UID: \"9cee87c7-4a2a-497a-b090-95fdde3d22de\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:19.344425 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.344405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cee87c7-4a2a-497a-b090-95fdde3d22de-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr\" (UID: \"9cee87c7-4a2a-497a-b090-95fdde3d22de\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:19.355370 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.355338    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5h6q\" (UniqueName: \"kubernetes.io/projected/9cee87c7-4a2a-497a-b090-95fdde3d22de-kube-api-access-h5h6q\") pod \"payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr\" (UID: \"9cee87c7-4a2a-497a-b090-95fdde3d22de\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:19.395117 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.395070    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:19.461984 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.461807    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:19.572494 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.572465    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:19.671676 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.671638    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"]
Sep 14 11:06:19.674203 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:06:19.674181    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7377314e_e4dc_4af2_8a4d_5ca78b94e4f2.slice/crio-839b8491ce8cdecd9d9ddba4f925783729808c1ff7bca647484de6d5b045d2e4 WatchSource:0}: Error finding container 839b8491ce8cdecd9d9ddba4f925783729808c1ff7bca647484de6d5b045d2e4: Status 404 returned error can't find the container with id 839b8491ce8cdecd9d9ddba4f925783729808c1ff7bca647484de6d5b045d2e4
Sep 14 11:06:19.747347 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.747321    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"]
Sep 14 11:06:19.749021 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:06:19.748997    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cee87c7_4a2a_497a_b090_95fdde3d22de.slice/crio-e66e3ca7ade871b34bce49a597d47a20b39a0be597be663815584ad71391b67f WatchSource:0}: Error finding container e66e3ca7ade871b34bce49a597d47a20b39a0be597be663815584ad71391b67f: Status 404 returned error can't find the container with id e66e3ca7ade871b34bce49a597d47a20b39a0be597be663815584ad71391b67f
Sep 14 11:06:19.909200 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:19.909170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:20.011490 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.011456    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:20.162719 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.162686    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr" event={"ID":"9cee87c7-4a2a-497a-b090-95fdde3d22de","Type":"ContainerStarted","Data":"8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485"}
Sep 14 11:06:20.162910 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.162745    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr" event={"ID":"9cee87c7-4a2a-497a-b090-95fdde3d22de","Type":"ContainerStarted","Data":"e66e3ca7ade871b34bce49a597d47a20b39a0be597be663815584ad71391b67f"}
Sep 14 11:06:20.163069 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.163016    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:20.164531 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.164494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726" event={"ID":"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2","Type":"ContainerStarted","Data":"1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5"}
Sep 14 11:06:20.164643 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.164542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726" event={"ID":"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2","Type":"ContainerStarted","Data":"839b8491ce8cdecd9d9ddba4f925783729808c1ff7bca647484de6d5b045d2e4"}
Sep 14 11:06:20.164643 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.164572    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:20.198816 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.198764    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr" podStartSLOduration=1.198745551 podStartE2EDuration="1.198745551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:06:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:06:20.198563368 +0000 UTC m=+1040.179198875" watchObservedRunningTime="2026-09-14 11:06:20.198745551 +0000 UTC m=+1040.179381056"
Sep 14 11:06:20.219045 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.219010    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"]
Sep 14 11:06:20.219220 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.219200    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw" podUID="1a75c705-5a38-45f9-b954-1176167329bc" containerName="maas-api" containerID="cri-o://a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631" gracePeriod=30
Sep 14 11:06:20.274359 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.273995    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726" podStartSLOduration=1.273974066 podStartE2EDuration="1.273974066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:06:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:06:20.270357058 +0000 UTC m=+1040.250992564" watchObservedRunningTime="2026-09-14 11:06:20.273974066 +0000 UTC m=+1040.254609575"
Sep 14 11:06:20.306497 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.306459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:20.353437 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.353192    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw" podUID="1a75c705-5a38-45f9-b954-1176167329bc" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.38:8443/health\": dial tcp 10.134.0.38:8443: connect: connection refused"
Sep 14 11:06:20.365693 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.365664    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"]
Sep 14 11:06:20.365885 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.365864    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc" podUID="15cc7742-8ba3-4d95-8926-ca7ab76ddbb8" containerName="payload-processing" containerID="cri-o://1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553" gracePeriod=30
Sep 14 11:06:20.443954 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.443917    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:20.514413 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.514384    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:06:20.549101 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.549039    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:20.557062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.556325    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a75c705-5a38-45f9-b954-1176167329bc-openshift-service-ca\") pod \"1a75c705-5a38-45f9-b954-1176167329bc\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") "
Sep 14 11:06:20.557062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.556362    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knb4p\" (UniqueName: \"kubernetes.io/projected/1a75c705-5a38-45f9-b954-1176167329bc-kube-api-access-knb4p\") pod \"1a75c705-5a38-45f9-b954-1176167329bc\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") "
Sep 14 11:06:20.557062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.556475    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-metrics-certs\") pod \"1a75c705-5a38-45f9-b954-1176167329bc\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") "
Sep 14 11:06:20.557062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.556509    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-maas-api-tls\") pod \"1a75c705-5a38-45f9-b954-1176167329bc\" (UID: \"1a75c705-5a38-45f9-b954-1176167329bc\") "
Sep 14 11:06:20.557062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.557017    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a75c705-5a38-45f9-b954-1176167329bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1a75c705-5a38-45f9-b954-1176167329bc" (UID: "1a75c705-5a38-45f9-b954-1176167329bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:06:20.559892 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.559855    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1a75c705-5a38-45f9-b954-1176167329bc" (UID: "1a75c705-5a38-45f9-b954-1176167329bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:06:20.560173 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.560142    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a75c705-5a38-45f9-b954-1176167329bc-kube-api-access-knb4p" (OuterVolumeSpecName: "kube-api-access-knb4p") pod "1a75c705-5a38-45f9-b954-1176167329bc" (UID: "1a75c705-5a38-45f9-b954-1176167329bc"). InnerVolumeSpecName "kube-api-access-knb4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:06:20.560590 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.560559    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1a75c705-5a38-45f9-b954-1176167329bc" (UID: "1a75c705-5a38-45f9-b954-1176167329bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:06:20.634357 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.634333    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:06:20.657690 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.657634    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a75c705-5a38-45f9-b954-1176167329bc-openshift-service-ca\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:20.657812 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.657693    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knb4p\" (UniqueName: \"kubernetes.io/projected/1a75c705-5a38-45f9-b954-1176167329bc-kube-api-access-knb4p\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:20.657812 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.657710    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-metrics-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:20.657812 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.657722    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a75c705-5a38-45f9-b954-1176167329bc-maas-api-tls\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:20.677398 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.677365    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:20.758312 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.758284    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q8zl\" (UniqueName: \"kubernetes.io/projected/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-kube-api-access-4q8zl\") pod \"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8\" (UID: \"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8\") "
Sep 14 11:06:20.758484 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.758358    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-plugins-config-volume\") pod \"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8\" (UID: \"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8\") "
Sep 14 11:06:20.758757 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.758732    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15cc7742-8ba3-4d95-8926-ca7ab76ddbb8" (UID: "15cc7742-8ba3-4d95-8926-ca7ab76ddbb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:06:20.760383 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.760362    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-kube-api-access-4q8zl" (OuterVolumeSpecName: "kube-api-access-4q8zl") pod "15cc7742-8ba3-4d95-8926-ca7ab76ddbb8" (UID: "15cc7742-8ba3-4d95-8926-ca7ab76ddbb8"). InnerVolumeSpecName "kube-api-access-4q8zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:06:20.859866 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.859780    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:20.859866 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.859813    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q8zl\" (UniqueName: \"kubernetes.io/projected/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8-kube-api-access-4q8zl\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:20.996511 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:20.996472    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:21.171704 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.171595    2576 generic.go:356] "Generic (PLEG): container finished" podID="15cc7742-8ba3-4d95-8926-ca7ab76ddbb8" containerID="1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553" exitCode=0
Sep 14 11:06:21.171704 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.171632    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"
Sep 14 11:06:21.171704 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.171684    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc" event={"ID":"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8","Type":"ContainerDied","Data":"1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553"}
Sep 14 11:06:21.171988 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.171751    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc" event={"ID":"15cc7742-8ba3-4d95-8926-ca7ab76ddbb8","Type":"ContainerDied","Data":"e63463292d62ba8ec7e1ebfb388e1cc3d38ba52f2c810ee09535751f7b1e4fdf"}
Sep 14 11:06:21.171988 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.171783    2576 scope.go:117] "RemoveContainer" containerID="1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553"
Sep 14 11:06:21.173952 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.173925    2576 generic.go:356] "Generic (PLEG): container finished" podID="1a75c705-5a38-45f9-b954-1176167329bc" containerID="a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631" exitCode=0
Sep 14 11:06:21.174075 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.173988    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"
Sep 14 11:06:21.174138 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.174075    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw" event={"ID":"1a75c705-5a38-45f9-b954-1176167329bc","Type":"ContainerDied","Data":"a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631"}
Sep 14 11:06:21.174138 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.174112    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw" event={"ID":"1a75c705-5a38-45f9-b954-1176167329bc","Type":"ContainerDied","Data":"c83bec79de377cfcfc38260805a5fa0a7b5a7eb818782de7b1956e897b217789"}
Sep 14 11:06:21.182758 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.182736    2576 scope.go:117] "RemoveContainer" containerID="1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553"
Sep 14 11:06:21.183071 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:06:21.183053    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553\": container with ID starting with 1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553 not found: ID does not exist" containerID="1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553"
Sep 14 11:06:21.183156 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.183084    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553"} err="failed to get container status \"1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553\": rpc error: code = NotFound desc = could not find container \"1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553\": container with ID starting with 1f0f0bf9cf344c175c330447a9678170ab9540fa88551d5665f9189587dd2553 not found: ID does not exist"
Sep 14 11:06:21.183156 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.183108    2576 scope.go:117] "RemoveContainer" containerID="a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631"
Sep 14 11:06:21.192106 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.192081    2576 scope.go:117] "RemoveContainer" containerID="a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631"
Sep 14 11:06:21.192420 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:06:21.192402    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631\": container with ID starting with a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631 not found: ID does not exist" containerID="a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631"
Sep 14 11:06:21.192485 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.192428    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631"} err="failed to get container status \"a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631\": rpc error: code = NotFound desc = could not find container \"a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631\": container with ID starting with a10b53e0e3e2d6be17001befd6544a7ff5fd7f6e747e42c5ae54716c4382e631 not found: ID does not exist"
Sep 14 11:06:21.210247 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.210217    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:21.217183 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.217154    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"]
Sep 14 11:06:21.223732 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.223704    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b275d0-fc5b8948d-nx8kw"]
Sep 14 11:06:21.243062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.243026    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"]
Sep 14 11:06:21.248064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.248037    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc"]
Sep 14 11:06:21.881258 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:21.881229    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:22.560869 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:22.560836    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15cc7742-8ba3-4d95-8926-ca7ab76ddbb8" path="/var/lib/kubelet/pods/15cc7742-8ba3-4d95-8926-ca7ab76ddbb8/volumes"
Sep 14 11:06:22.561269 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:22.561256    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a75c705-5a38-45f9-b954-1176167329bc" path="/var/lib/kubelet/pods/1a75c705-5a38-45f9-b954-1176167329bc/volumes"
Sep 14 11:06:22.965364 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:22.965266    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:24.111936 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:24.111878    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:25.369079 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:25.369041    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:27.631609 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:27.631578    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:27.779396 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:27.779354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:28.099566 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:28.099534    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:30.003406 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:30.003372    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:31.161138 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:31.161076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:31.177180 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:31.177146    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:31.177359 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:31.177232    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:32.273808 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:32.273742    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:33.409168 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:33.409139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:34.623968 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:34.623937    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:35.752475 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:35.752396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:36.345855 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.345825    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"]
Sep 14 11:06:36.346265 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.346248    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a75c705-5a38-45f9-b954-1176167329bc" containerName="maas-api"
Sep 14 11:06:36.346265 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.346267    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a75c705-5a38-45f9-b954-1176167329bc" containerName="maas-api"
Sep 14 11:06:36.346372 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.346276    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15cc7742-8ba3-4d95-8926-ca7ab76ddbb8" containerName="payload-processing"
Sep 14 11:06:36.346372 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.346282    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="15cc7742-8ba3-4d95-8926-ca7ab76ddbb8" containerName="payload-processing"
Sep 14 11:06:36.346372 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.346363    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a75c705-5a38-45f9-b954-1176167329bc" containerName="maas-api"
Sep 14 11:06:36.346471 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.346374    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="15cc7742-8ba3-4d95-8926-ca7ab76ddbb8" containerName="payload-processing"
Sep 14 11:06:36.349278 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.349263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.352069 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.352047    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4ebf73\"/\"kube-root-ca.crt\""
Sep 14 11:06:36.352182 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.352115    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4ebf73\"/\"default-dockercfg-8975n\""
Sep 14 11:06:36.352711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.352683    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4ebf73\"/\"openshift-service-ca.crt\""
Sep 14 11:06:36.352781 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.352725    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4ebf73\"/\"premium-w4-4ebf73-kserve-self-signed-certs\""
Sep 14 11:06:36.359745 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.359722    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"]
Sep 14 11:06:36.385601 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.385540    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:36.513453 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.513405    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-dshm\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.513802 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.513778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5ck8\" (UniqueName: \"kubernetes.io/projected/9f7e2639-1e4b-4e82-817d-e87c98546e59-kube-api-access-m5ck8\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.514082 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.514060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-home\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.514358 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.514336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7e2639-1e4b-4e82-817d-e87c98546e59-tls-certs\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.514589 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.514570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-tmp-dir\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.514769 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.514734    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-model-cache\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.616128 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.616088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-home\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.616388 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.616140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7e2639-1e4b-4e82-817d-e87c98546e59-tls-certs\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.616388 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.616205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-tmp-dir\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.616388 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.616242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-model-cache\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.616388 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.616293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-dshm\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.616388 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.616326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5ck8\" (UniqueName: \"kubernetes.io/projected/9f7e2639-1e4b-4e82-817d-e87c98546e59-kube-api-access-m5ck8\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.616700 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.616572    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-home\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.616700 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.616617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-tmp-dir\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.616816 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.616699    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-model-cache\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.618524 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.618502    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-dshm\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.618741 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.618722    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7e2639-1e4b-4e82-817d-e87c98546e59-tls-certs\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.629276 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.629251    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5ck8\" (UniqueName: \"kubernetes.io/projected/9f7e2639-1e4b-4e82-817d-e87c98546e59-kube-api-access-m5ck8\") pod \"premium-w4-4ebf73-kserve-6d6b84987f-kptb4\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") " pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.658929 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.658905    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:36.709097 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.709043    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:36.942778 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:36.942756    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"]
Sep 14 11:06:36.944058 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:06:36.944035    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f7e2639_1e4b_4e82_817d_e87c98546e59.slice/crio-41c458ef290971f99ad16ac205bf090596935bf4c9755b5230ee29c8d3e616e5 WatchSource:0}: Error finding container 41c458ef290971f99ad16ac205bf090596935bf4c9755b5230ee29c8d3e616e5: Status 404 returned error can't find the container with id 41c458ef290971f99ad16ac205bf090596935bf4c9755b5230ee29c8d3e616e5
Sep 14 11:06:37.256815 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:37.256777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4" event={"ID":"9f7e2639-1e4b-4e82-817d-e87c98546e59","Type":"ContainerStarted","Data":"7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308"}
Sep 14 11:06:37.256995 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:37.256830    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4" event={"ID":"9f7e2639-1e4b-4e82-817d-e87c98546e59","Type":"ContainerStarted","Data":"41c458ef290971f99ad16ac205bf090596935bf4c9755b5230ee29c8d3e616e5"}
Sep 14 11:06:37.258418 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:37.258392    2576 generic.go:356] "Generic (PLEG): container finished" podID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerID="e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1" exitCode=0
Sep 14 11:06:37.258545 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:37.258435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" event={"ID":"299534ea-d9d6-4ebb-9eb6-c2d7243268eb","Type":"ContainerDied","Data":"e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1"}
Sep 14 11:06:37.258838 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:37.258817    2576 scope.go:117] "RemoveContainer" containerID="e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1"
Sep 14 11:06:37.259920 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:37.259890    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:06:37.260018 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:37.259969    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:06:37.260018 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:37.260012    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:06:37.278974 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:37.278922    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4" podStartSLOduration=1.278903591 podStartE2EDuration="1.278903591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:06:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:06:37.276324107 +0000 UTC m=+1057.256959613" watchObservedRunningTime="2026-09-14 11:06:37.278903591 +0000 UTC m=+1057.259539095"
Sep 14 11:06:37.713759 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:37.713635    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:38.264750 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:38.264718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" event={"ID":"299534ea-d9d6-4ebb-9eb6-c2d7243268eb","Type":"ContainerStarted","Data":"dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9"}
Sep 14 11:06:38.580288 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:38.580184    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:38.581671 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:38.581629    2576 patch_prober.go:28] interesting pod/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 14 11:06:38.581872 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:38.581847    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 14 11:06:39.531767 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:39.531728    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:39.580631 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:39.580596    2576 patch_prober.go:28] interesting pod/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 14 11:06:39.580931 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:39.580900    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 14 11:06:40.580519 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:40.580482    2576 patch_prober.go:28] interesting pod/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 14 11:06:40.581131 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:40.581100    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 14 11:06:41.112184 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:41.112146    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:41.580912 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:41.580872    2576 patch_prober.go:28] interesting pod/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 14 11:06:41.581482 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:41.581453    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 14 11:06:42.313309 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.313278    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:42.382962 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.382926    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"]
Sep 14 11:06:42.383497 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.383462    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726" podUID="7377314e-e4dc-4af2-8a4d-5ca78b94e4f2" containerName="payload-processing" containerID="cri-o://1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5" gracePeriod=30
Sep 14 11:06:42.395564 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.395429    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"]
Sep 14 11:06:42.395728 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.395700    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr" podUID="9cee87c7-4a2a-497a-b090-95fdde3d22de" containerName="payload-pre-processing" containerID="cri-o://8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485" gracePeriod=30
Sep 14 11:06:42.509548 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.509519    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:42.582722 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.580672    2576 patch_prober.go:28] interesting pod/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 14 11:06:42.582722 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.580749    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 14 11:06:42.692670 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.677359    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:42.740308 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.740049    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:42.743831 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.743759    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:42.884722 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.883824    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvsxp\" (UniqueName: \"kubernetes.io/projected/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-kube-api-access-pvsxp\") pod \"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2\" (UID: \"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2\") "
Sep 14 11:06:42.884722 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.883878    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-plugins-config-volume\") pod \"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2\" (UID: \"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2\") "
Sep 14 11:06:42.884722 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.883937    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5h6q\" (UniqueName: \"kubernetes.io/projected/9cee87c7-4a2a-497a-b090-95fdde3d22de-kube-api-access-h5h6q\") pod \"9cee87c7-4a2a-497a-b090-95fdde3d22de\" (UID: \"9cee87c7-4a2a-497a-b090-95fdde3d22de\") "
Sep 14 11:06:42.884722 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.883963    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cee87c7-4a2a-497a-b090-95fdde3d22de-plugins-config-volume\") pod \"9cee87c7-4a2a-497a-b090-95fdde3d22de\" (UID: \"9cee87c7-4a2a-497a-b090-95fdde3d22de\") "
Sep 14 11:06:42.884722 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.884643    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cee87c7-4a2a-497a-b090-95fdde3d22de-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9cee87c7-4a2a-497a-b090-95fdde3d22de" (UID: "9cee87c7-4a2a-497a-b090-95fdde3d22de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:06:42.888673 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.885266    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7377314e-e4dc-4af2-8a4d-5ca78b94e4f2" (UID: "7377314e-e4dc-4af2-8a4d-5ca78b94e4f2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:06:42.891893 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.891850    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cee87c7-4a2a-497a-b090-95fdde3d22de-kube-api-access-h5h6q" (OuterVolumeSpecName: "kube-api-access-h5h6q") pod "9cee87c7-4a2a-497a-b090-95fdde3d22de" (UID: "9cee87c7-4a2a-497a-b090-95fdde3d22de"). InnerVolumeSpecName "kube-api-access-h5h6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:06:42.911417 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.911204    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-kube-api-access-pvsxp" (OuterVolumeSpecName: "kube-api-access-pvsxp") pod "7377314e-e4dc-4af2-8a4d-5ca78b94e4f2" (UID: "7377314e-e4dc-4af2-8a4d-5ca78b94e4f2"). InnerVolumeSpecName "kube-api-access-pvsxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:06:42.913511 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.913214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:42.990247 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.990204    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvsxp\" (UniqueName: \"kubernetes.io/projected/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-kube-api-access-pvsxp\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:42.990247 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.990245    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:42.990475 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.990261    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5h6q\" (UniqueName: \"kubernetes.io/projected/9cee87c7-4a2a-497a-b090-95fdde3d22de-kube-api-access-h5h6q\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:42.990475 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:42.990276    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cee87c7-4a2a-497a-b090-95fdde3d22de-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:43.086123 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.086082    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"]
Sep 14 11:06:43.087324 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.086309    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy" containerID="cri-o://dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9" gracePeriod=30
Sep 14 11:06:43.183439 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.183291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:43.301920 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.301891    2576 generic.go:356] "Generic (PLEG): container finished" podID="9cee87c7-4a2a-497a-b090-95fdde3d22de" containerID="8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485" exitCode=0
Sep 14 11:06:43.302108 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.301940    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"
Sep 14 11:06:43.302108 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.301979    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr" event={"ID":"9cee87c7-4a2a-497a-b090-95fdde3d22de","Type":"ContainerDied","Data":"8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485"}
Sep 14 11:06:43.302108 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.302043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr" event={"ID":"9cee87c7-4a2a-497a-b090-95fdde3d22de","Type":"ContainerDied","Data":"e66e3ca7ade871b34bce49a597d47a20b39a0be597be663815584ad71391b67f"}
Sep 14 11:06:43.302307 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.302124    2576 scope.go:117] "RemoveContainer" containerID="8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485"
Sep 14 11:06:43.303701 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.303673    2576 generic.go:356] "Generic (PLEG): container finished" podID="7377314e-e4dc-4af2-8a4d-5ca78b94e4f2" containerID="1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5" exitCode=0
Sep 14 11:06:43.303829 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.303737    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"
Sep 14 11:06:43.303829 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.303762    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726" event={"ID":"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2","Type":"ContainerDied","Data":"1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5"}
Sep 14 11:06:43.303829 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.303805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726" event={"ID":"7377314e-e4dc-4af2-8a4d-5ca78b94e4f2","Type":"ContainerDied","Data":"839b8491ce8cdecd9d9ddba4f925783729808c1ff7bca647484de6d5b045d2e4"}
Sep 14 11:06:43.312911 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.312824    2576 scope.go:117] "RemoveContainer" containerID="8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485"
Sep 14 11:06:43.313198 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:06:43.313172    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485\": container with ID starting with 8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485 not found: ID does not exist" containerID="8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485"
Sep 14 11:06:43.313278 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.313212    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485"} err="failed to get container status \"8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485\": rpc error: code = NotFound desc = could not find container \"8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485\": container with ID starting with 8db0da30785470759cd277c12047427b7a80c5645aa8a9ba65e59574ea343485 not found: ID does not exist"
Sep 14 11:06:43.313278 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.313238    2576 scope.go:117] "RemoveContainer" containerID="1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5"
Sep 14 11:06:43.322680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.322635    2576 scope.go:117] "RemoveContainer" containerID="1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5"
Sep 14 11:06:43.323010 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:06:43.322989    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5\": container with ID starting with 1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5 not found: ID does not exist" containerID="1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5"
Sep 14 11:06:43.323105 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.323016    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5"} err="failed to get container status \"1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5\": rpc error: code = NotFound desc = could not find container \"1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5\": container with ID starting with 1d46efbb8d94397c47d8bc37f8418a033eae3de0b685b603507bc7800557d1d5 not found: ID does not exist"
Sep 14 11:06:43.350823 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.350788    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"]
Sep 14 11:06:43.354635 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.354608    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr"]
Sep 14 11:06:43.386236 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.386195    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"]
Sep 14 11:06:43.389562 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.389526    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726"]
Sep 14 11:06:43.584060 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.584012    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:43.810300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:43.810266    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:44.347233 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:44.347205    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:44.561002 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:44.560972    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7377314e-e4dc-4af2-8a4d-5ca78b94e4f2" path="/var/lib/kubelet/pods/7377314e-e4dc-4af2-8a4d-5ca78b94e4f2/volumes"
Sep 14 11:06:44.561332 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:44.561320    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cee87c7-4a2a-497a-b090-95fdde3d22de" path="/var/lib/kubelet/pods/9cee87c7-4a2a-497a-b090-95fdde3d22de/volumes"
Sep 14 11:06:44.914804 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:44.914770    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:46.440945 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:46.440914    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:46.659685 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:46.659635    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:46.659864 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:46.659707    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:46.672195 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:46.672171    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:46.939157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:46.939125    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:47.344676 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:47.344631    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:06:48.847287 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.847263    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:48.866175 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.866131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:48.950950 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.950864    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-podinfo\") pod \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") "
Sep 14 11:06:48.950950 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.950911    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-credential-socket\") pod \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") "
Sep 14 11:06:48.950950 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.950945    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istiod-ca-cert\") pod \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") "
Sep 14 11:06:48.951222 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.950971    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-socket\") pod \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") "
Sep 14 11:06:48.951222 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951000    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-data\") pod \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") "
Sep 14 11:06:48.951222 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951018    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-certs\") pod \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") "
Sep 14 11:06:48.951222 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951064    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-token\") pod \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") "
Sep 14 11:06:48.951222 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951095    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-envoy\") pod \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") "
Sep 14 11:06:48.951222 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951131    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q42p9\" (UniqueName: \"kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-kube-api-access-q42p9\") pod \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\" (UID: \"299534ea-d9d6-4ebb-9eb6-c2d7243268eb\") "
Sep 14 11:06:48.951525 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951333    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "299534ea-d9d6-4ebb-9eb6-c2d7243268eb" (UID: "299534ea-d9d6-4ebb-9eb6-c2d7243268eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:06:48.951525 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951353    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "299534ea-d9d6-4ebb-9eb6-c2d7243268eb" (UID: "299534ea-d9d6-4ebb-9eb6-c2d7243268eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:06:48.951525 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951391    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "299534ea-d9d6-4ebb-9eb6-c2d7243268eb" (UID: "299534ea-d9d6-4ebb-9eb6-c2d7243268eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:06:48.951525 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951408    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "299534ea-d9d6-4ebb-9eb6-c2d7243268eb" (UID: "299534ea-d9d6-4ebb-9eb6-c2d7243268eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:06:48.951525 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951454    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "299534ea-d9d6-4ebb-9eb6-c2d7243268eb" (UID: "299534ea-d9d6-4ebb-9eb6-c2d7243268eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:06:48.951525 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951514    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-credential-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:48.951525 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951533    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:48.951844 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951548    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-data\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:48.951844 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.951561    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-workload-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:48.953359 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.953326    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "299534ea-d9d6-4ebb-9eb6-c2d7243268eb" (UID: "299534ea-d9d6-4ebb-9eb6-c2d7243268eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:06:48.953469 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.953355    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "299534ea-d9d6-4ebb-9eb6-c2d7243268eb" (UID: "299534ea-d9d6-4ebb-9eb6-c2d7243268eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:06:48.953682 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.953619    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "299534ea-d9d6-4ebb-9eb6-c2d7243268eb" (UID: "299534ea-d9d6-4ebb-9eb6-c2d7243268eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 11:06:48.953756 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:48.953696    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-kube-api-access-q42p9" (OuterVolumeSpecName: "kube-api-access-q42p9") pod "299534ea-d9d6-4ebb-9eb6-c2d7243268eb" (UID: "299534ea-d9d6-4ebb-9eb6-c2d7243268eb"). InnerVolumeSpecName "kube-api-access-q42p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:06:49.052557 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.052528    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-podinfo\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:49.052557 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.052552    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istiod-ca-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:49.052557 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.052561    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:49.052802 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.052568    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-istio-envoy\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:49.052802 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.052577    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q42p9\" (UniqueName: \"kubernetes.io/projected/299534ea-d9d6-4ebb-9eb6-c2d7243268eb-kube-api-access-q42p9\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:06:49.346007 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.345969    2576 generic.go:356] "Generic (PLEG): container finished" podID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerID="dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9" exitCode=0
Sep 14 11:06:49.346204 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.346015    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" event={"ID":"299534ea-d9d6-4ebb-9eb6-c2d7243268eb","Type":"ContainerDied","Data":"dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9"}
Sep 14 11:06:49.346204 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.346032    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"
Sep 14 11:06:49.346204 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.346063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2" event={"ID":"299534ea-d9d6-4ebb-9eb6-c2d7243268eb","Type":"ContainerDied","Data":"495a6c53803aabf038de72a66ca8fe64f40a6536beb113a8ac34fd584de9f9f4"}
Sep 14 11:06:49.346204 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.346091    2576 scope.go:117] "RemoveContainer" containerID="dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9"
Sep 14 11:06:49.355034 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.355019    2576 scope.go:117] "RemoveContainer" containerID="e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1"
Sep 14 11:06:49.362741 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.362724    2576 scope.go:117] "RemoveContainer" containerID="dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9"
Sep 14 11:06:49.363030 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:06:49.363012    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9\": container with ID starting with dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9 not found: ID does not exist" containerID="dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9"
Sep 14 11:06:49.363116 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.363041    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9"} err="failed to get container status \"dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9\": rpc error: code = NotFound desc = could not find container \"dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9\": container with ID starting with dade997d410b0abe2c9c72403d8f5e935014fe7f4af4edb35783f789d1958bf9 not found: ID does not exist"
Sep 14 11:06:49.363116 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.363062    2576 scope.go:117] "RemoveContainer" containerID="e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1"
Sep 14 11:06:49.363315 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:06:49.363298    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1\": container with ID starting with e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1 not found: ID does not exist" containerID="e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1"
Sep 14 11:06:49.363354 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.363322    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1"} err="failed to get container status \"e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1\": rpc error: code = NotFound desc = could not find container \"e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1\": container with ID starting with e9301fafe38b2b68ef66eff2c95b37603900dd8faa35b40bba31277321c4cea1 not found: ID does not exist"
Sep 14 11:06:49.397409 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.397376    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"]
Sep 14 11:06:49.409095 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:49.409066    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2"]
Sep 14 11:06:50.176613 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:50.176579    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:50.560135 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:50.560102    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" path="/var/lib/kubelet/pods/299534ea-d9d6-4ebb-9eb6-c2d7243268eb/volumes"
Sep 14 11:06:51.545793 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:51.545758    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:52.872819 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.872782    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"]
Sep 14 11:06:52.873201 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.873181    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy"
Sep 14 11:06:52.873201 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.873191    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy"
Sep 14 11:06:52.873281 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.873207    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7377314e-e4dc-4af2-8a4d-5ca78b94e4f2" containerName="payload-processing"
Sep 14 11:06:52.873281 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.873213    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7377314e-e4dc-4af2-8a4d-5ca78b94e4f2" containerName="payload-processing"
Sep 14 11:06:52.873281 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.873219    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cee87c7-4a2a-497a-b090-95fdde3d22de" containerName="payload-pre-processing"
Sep 14 11:06:52.873281 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.873225    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cee87c7-4a2a-497a-b090-95fdde3d22de" containerName="payload-pre-processing"
Sep 14 11:06:52.873281 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.873231    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy"
Sep 14 11:06:52.873281 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.873238    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy"
Sep 14 11:06:52.873476 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.873291    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy"
Sep 14 11:06:52.873476 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.873299    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cee87c7-4a2a-497a-b090-95fdde3d22de" containerName="payload-pre-processing"
Sep 14 11:06:52.873476 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.873306    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7377314e-e4dc-4af2-8a4d-5ca78b94e4f2" containerName="payload-processing"
Sep 14 11:06:52.877688 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.877670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.887946 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.887922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-model-cache\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.888076 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.887962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-home\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.888076 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.888040    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-tmp-dir\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.888166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.888088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sm5f\" (UniqueName: \"kubernetes.io/projected/504589a5-819e-4cfa-af69-e65e959968c6-kube-api-access-9sm5f\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.888166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.888133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/504589a5-819e-4cfa-af69-e65e959968c6-tls-certs\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.888166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.888149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-dshm\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.901523 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.901500    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7984b1\"/\"premium-w0-7984b1-kserve-self-signed-certs\""
Sep 14 11:06:52.902153 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.902139    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7984b1\"/\"kube-root-ca.crt\""
Sep 14 11:06:52.905945 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.905927    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7984b1\"/\"default-dockercfg-ff6n2\""
Sep 14 11:06:52.908559 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.908543    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7984b1\"/\"openshift-service-ca.crt\""
Sep 14 11:06:52.919447 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.919424    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"]
Sep 14 11:06:52.988706 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.988672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/504589a5-819e-4cfa-af69-e65e959968c6-tls-certs\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.988706 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.988708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-dshm\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.988943 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.988750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-model-cache\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.988943 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.988780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-home\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.988943 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.988841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-tmp-dir\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.988943 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.988877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sm5f\" (UniqueName: \"kubernetes.io/projected/504589a5-819e-4cfa-af69-e65e959968c6-kube-api-access-9sm5f\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.989258 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.989232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-home\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.989327 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.989247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-model-cache\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.989327 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.989317    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-tmp-dir\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.991159 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.991128    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-dshm\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.991319 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.991304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/504589a5-819e-4cfa-af69-e65e959968c6-tls-certs\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:52.998885 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:52.998858    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sm5f\" (UniqueName: \"kubernetes.io/projected/504589a5-819e-4cfa-af69-e65e959968c6-kube-api-access-9sm5f\") pod \"premium-w0-7984b1-kserve-686876ff6c-np4r9\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") " pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:53.186231 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:53.186123    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:06:53.464123 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:53.464040    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"]
Sep 14 11:06:53.468286 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:06:53.468246    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod504589a5_819e_4cfa_af69_e65e959968c6.slice/crio-3453f7137269de1ae41e8b46185a891f2f8a0766627ca50f88381bb830f22684 WatchSource:0}: Error finding container 3453f7137269de1ae41e8b46185a891f2f8a0766627ca50f88381bb830f22684: Status 404 returned error can't find the container with id 3453f7137269de1ae41e8b46185a891f2f8a0766627ca50f88381bb830f22684
Sep 14 11:06:54.130883 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:54.130844    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:54.372176 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:54.372137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9" event={"ID":"504589a5-819e-4cfa-af69-e65e959968c6","Type":"ContainerStarted","Data":"0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20"}
Sep 14 11:06:54.372354 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:54.372187    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9" event={"ID":"504589a5-819e-4cfa-af69-e65e959968c6","Type":"ContainerStarted","Data":"3453f7137269de1ae41e8b46185a891f2f8a0766627ca50f88381bb830f22684"}
Sep 14 11:06:54.400233 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:54.400142    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9" podStartSLOduration=2.400123115 podStartE2EDuration="2.400123115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:06:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:06:54.39729128 +0000 UTC m=+1074.377926785" watchObservedRunningTime="2026-09-14 11:06:54.400123115 +0000 UTC m=+1074.380758620"
Sep 14 11:06:54.913319 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:54.913286    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:55.140596 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:55.140537    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:06:55.474865 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:06:55.474830    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:02.838808 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:02.838775    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:02.931330 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:02.931296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:03.186730 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:03.186613    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:07:03.186730 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:03.186695    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:07:03.199262 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:03.199233    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:07:03.438298 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:03.438210    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:07:03.510964 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:03.510932    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:03.783348 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:03.783299    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:04.181220 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.181136    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:04.469804 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.469726    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"]
Sep 14 11:07:04.470157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.470144    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="299534ea-d9d6-4ebb-9eb6-c2d7243268eb" containerName="istio-proxy"
Sep 14 11:07:04.474875 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.474855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.477844 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.477826    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-cc14fe-openshift-default-dockercfg-c2bq8\""
Sep 14 11:07:04.498134 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.498106    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"]
Sep 14 11:07:04.501813 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.501786    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:04.596876 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.596844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvkcm\" (UniqueName: \"kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-kube-api-access-rvkcm\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.597035 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.596912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-socket\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.597035 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.596995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-credential-socket\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.597151 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.597067    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-podinfo\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.597151 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.597096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-token\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.597151 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.597128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de572ade-f4f4-41b6-b22d-924f5c94fa40-istiod-ca-cert\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.597266 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.597186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-certs\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.597266 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.597228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-envoy\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.597340 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.597290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-data\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.698318 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.698283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-token\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.698318 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.698325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de572ade-f4f4-41b6-b22d-924f5c94fa40-istiod-ca-cert\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.698533 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.698362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-certs\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.698533 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.698387    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-envoy\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.698533 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.698410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-data\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.698533 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.698450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvkcm\" (UniqueName: \"kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-kube-api-access-rvkcm\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.698780 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.698607    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-socket\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.698780 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.698697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-credential-socket\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.698780 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.698742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-podinfo\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.698930 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.698833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-certs\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.698985 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.698921    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-data\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.699041 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.699023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-socket\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.699093 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.699049    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-credential-socket\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.699203 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.699184    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de572ade-f4f4-41b6-b22d-924f5c94fa40-istiod-ca-cert\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.700832 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.700809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-envoy\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.701061 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.701042    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-podinfo\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.713373 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.713348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-token\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.714223 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.714199    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvkcm\" (UniqueName: \"kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-kube-api-access-rvkcm\") pod \"e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") " pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.785404 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.785361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:04.802777 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:04.802746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:05.082691 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:05.082665    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"]
Sep 14 11:07:05.085061 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:07:05.085031    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde572ade_f4f4_41b6_b22d_924f5c94fa40.slice/crio-811bd592e9488d2b0f6a6a092745feaff47dfb79b01fb99da6bbbb2ad7089e59 WatchSource:0}: Error finding container 811bd592e9488d2b0f6a6a092745feaff47dfb79b01fb99da6bbbb2ad7089e59: Status 404 returned error can't find the container with id 811bd592e9488d2b0f6a6a092745feaff47dfb79b01fb99da6bbbb2ad7089e59
Sep 14 11:07:05.087269 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:05.087234    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:07:05.087379 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:05.087312    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:07:05.087379 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:05.087368    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:07:05.442314 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:05.442228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" event={"ID":"de572ade-f4f4-41b6-b22d-924f5c94fa40","Type":"ContainerStarted","Data":"070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a"}
Sep 14 11:07:05.442314 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:05.442286    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" event={"ID":"de572ade-f4f4-41b6-b22d-924f5c94fa40","Type":"ContainerStarted","Data":"811bd592e9488d2b0f6a6a092745feaff47dfb79b01fb99da6bbbb2ad7089e59"}
Sep 14 11:07:05.487686 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:05.487616    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" podStartSLOduration=1.487601992 podStartE2EDuration="1.487601992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:07:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:07:05.486967093 +0000 UTC m=+1085.467602599" watchObservedRunningTime="2026-09-14 11:07:05.487601992 +0000 UTC m=+1085.468237496"
Sep 14 11:07:05.785465 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:05.785433    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:06.791891 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:06.791859    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:06.935193 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:06.935160    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:07.452708 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:07.452681    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:07.453710 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:07.453686    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:07.567738 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:07.567706    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:07.661029 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:07.661002    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:07.906828 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:07.906797    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:08.831104 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:08.831074    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:11.489346 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:11.489314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:11.634421 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:11.634391    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:11.774429 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:11.774342    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:11.935264 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:11.935229    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:12.224210 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.224130    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"]
Sep 14 11:07:12.227896 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.227880    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:07:12.230537 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.230505    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-cc14fe-dockercfg-lpchq\""
Sep 14 11:07:12.230537 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.230522    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-cc14fe\""
Sep 14 11:07:12.239382 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.239362    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"]
Sep 14 11:07:12.242838 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.242814    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"]
Sep 14 11:07:12.249237 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.249203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:07:12.262144 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.262118    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"]
Sep 14 11:07:12.278841 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.278794    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:12.373966 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.373928    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:12.376265 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.376239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46ecf466-bc87-4226-8485-7edfbd6bf734-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth\" (UID: \"46ecf466-bc87-4226-8485-7edfbd6bf734\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:07:12.376398 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.376276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5kn7\" (UniqueName: \"kubernetes.io/projected/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-kube-api-access-f5kn7\") pod \"payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl\" (UID: \"ec647a6c-d636-4aec-81a3-5eb88ce30dfd\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:07:12.376398 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.376315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl\" (UID: \"ec647a6c-d636-4aec-81a3-5eb88ce30dfd\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:07:12.376483 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.376443    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5fzw\" (UniqueName: \"kubernetes.io/projected/46ecf466-bc87-4226-8485-7edfbd6bf734-kube-api-access-s5fzw\") pod \"payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth\" (UID: \"46ecf466-bc87-4226-8485-7edfbd6bf734\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:07:12.477852 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.477756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5fzw\" (UniqueName: \"kubernetes.io/projected/46ecf466-bc87-4226-8485-7edfbd6bf734-kube-api-access-s5fzw\") pod \"payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth\" (UID: \"46ecf466-bc87-4226-8485-7edfbd6bf734\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:07:12.478032 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.477863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46ecf466-bc87-4226-8485-7edfbd6bf734-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth\" (UID: \"46ecf466-bc87-4226-8485-7edfbd6bf734\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:07:12.478032 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.477891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5kn7\" (UniqueName: \"kubernetes.io/projected/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-kube-api-access-f5kn7\") pod \"payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl\" (UID: \"ec647a6c-d636-4aec-81a3-5eb88ce30dfd\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:07:12.478032 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.477924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl\" (UID: \"ec647a6c-d636-4aec-81a3-5eb88ce30dfd\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:07:12.478591 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.478567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46ecf466-bc87-4226-8485-7edfbd6bf734-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth\" (UID: \"46ecf466-bc87-4226-8485-7edfbd6bf734\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:07:12.478704 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.478592    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl\" (UID: \"ec647a6c-d636-4aec-81a3-5eb88ce30dfd\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:07:12.486419 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.486394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5fzw\" (UniqueName: \"kubernetes.io/projected/46ecf466-bc87-4226-8485-7edfbd6bf734-kube-api-access-s5fzw\") pod \"payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth\" (UID: \"46ecf466-bc87-4226-8485-7edfbd6bf734\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:07:12.486583 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.486566    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5kn7\" (UniqueName: \"kubernetes.io/projected/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-kube-api-access-f5kn7\") pod \"payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl\" (UID: \"ec647a6c-d636-4aec-81a3-5eb88ce30dfd\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:07:12.539021 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.538990    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:07:12.562966 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.562768    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:07:12.820293 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.820263    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"]
Sep 14 11:07:12.821990 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:07:12.821959    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec647a6c_d636_4aec_81a3_5eb88ce30dfd.slice/crio-68e3b8549000f1e7804799031439b6c1577d9dfb2dab2ca2268494c3c53deb18 WatchSource:0}: Error finding container 68e3b8549000f1e7804799031439b6c1577d9dfb2dab2ca2268494c3c53deb18: Status 404 returned error can't find the container with id 68e3b8549000f1e7804799031439b6c1577d9dfb2dab2ca2268494c3c53deb18
Sep 14 11:07:12.853467 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:12.853437    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"]
Sep 14 11:07:12.854947 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:07:12.854919    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ecf466_bc87_4226_8485_7edfbd6bf734.slice/crio-056cf4ce518613bbdb6bf4a35604a61c14dc32eca8d978a5bab256bad1037597 WatchSource:0}: Error finding container 056cf4ce518613bbdb6bf4a35604a61c14dc32eca8d978a5bab256bad1037597: Status 404 returned error can't find the container with id 056cf4ce518613bbdb6bf4a35604a61c14dc32eca8d978a5bab256bad1037597
Sep 14 11:07:13.486064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:13.486025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl" event={"ID":"ec647a6c-d636-4aec-81a3-5eb88ce30dfd","Type":"ContainerStarted","Data":"0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545"}
Sep 14 11:07:13.486265 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:13.486102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl" event={"ID":"ec647a6c-d636-4aec-81a3-5eb88ce30dfd","Type":"ContainerStarted","Data":"68e3b8549000f1e7804799031439b6c1577d9dfb2dab2ca2268494c3c53deb18"}
Sep 14 11:07:13.486345 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:13.486273    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:07:13.487796 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:13.487772    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth" event={"ID":"46ecf466-bc87-4226-8485-7edfbd6bf734","Type":"ContainerStarted","Data":"7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d"}
Sep 14 11:07:13.487931 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:13.487817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth" event={"ID":"46ecf466-bc87-4226-8485-7edfbd6bf734","Type":"ContainerStarted","Data":"056cf4ce518613bbdb6bf4a35604a61c14dc32eca8d978a5bab256bad1037597"}
Sep 14 11:07:13.487931 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:13.487925    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:07:13.507113 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:13.507053    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl" podStartSLOduration=1.50703984 podStartE2EDuration="1.50703984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:07:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:07:13.504354049 +0000 UTC m=+1093.484989556" watchObservedRunningTime="2026-09-14 11:07:13.50703984 +0000 UTC m=+1093.487675344"
Sep 14 11:07:13.521686 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:13.521605    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth" podStartSLOduration=1.5215891780000002 podStartE2EDuration="1.521589178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:07:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:07:13.521518847 +0000 UTC m=+1093.502154360" watchObservedRunningTime="2026-09-14 11:07:13.521589178 +0000 UTC m=+1093.502224685"
Sep 14 11:07:20.734951 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:20.734913    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:21.381764 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:21.381730    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:24.495712 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:24.495679    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:07:24.496531 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:24.496509    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:07:27.364821 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:27.364792    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:27.510778 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:27.510727    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:27.613599 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:27.613568    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:32.593389 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:32.593354    2576 generic.go:356] "Generic (PLEG): container finished" podID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerID="070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a" exitCode=0
Sep 14 11:07:32.593976 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:32.593411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" event={"ID":"de572ade-f4f4-41b6-b22d-924f5c94fa40","Type":"ContainerDied","Data":"070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a"}
Sep 14 11:07:32.593976 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:32.593823    2576 scope.go:117] "RemoveContainer" containerID="070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a"
Sep 14 11:07:32.595031 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:32.594995    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:07:32.595141 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:32.595072    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:07:32.595141 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:32.595103    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:07:33.601099 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:33.601066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" event={"ID":"de572ade-f4f4-41b6-b22d-924f5c94fa40","Type":"ContainerStarted","Data":"7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0"}
Sep 14 11:07:33.786216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:33.786182    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:33.787425 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:33.787397    2576 patch_prober.go:28] interesting pod/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 14 11:07:33.787666 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:33.787626    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 14 11:07:34.785859 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:34.785823    2576 patch_prober.go:28] interesting pod/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 14 11:07:34.786449 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:34.786417    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 14 11:07:35.613715 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:35.613679    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:35.786043 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:35.786008    2576 patch_prober.go:28] interesting pod/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 14 11:07:35.786637 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:35.786606    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 14 11:07:36.761256 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:36.761223    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:36.786419 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:36.786375    2576 patch_prober.go:28] interesting pod/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 14 11:07:36.786920 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:36.786443    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 14 11:07:37.453488 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:37.453434    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:37.525061 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:37.525032    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:37.680246 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:37.680200    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:37.786691 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:37.786637    2576 patch_prober.go:28] interesting pod/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 14 11:07:37.787365 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:37.787332    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 14 11:07:38.596932 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:38.596893    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:38.883488 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:38.883405    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:38.885585 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:38.885560    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:07:39.571556 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:39.571522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:40.375128 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:40.375092    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:41.952700 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:41.952672    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:42.025130 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:42.025089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:43.398834 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:43.398798    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:46.474034 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:46.474001    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:49.615522 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:49.615441    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:49.734042 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:49.733997    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:07:50.068122 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:07:50.068089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:00.403454 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:00.403423    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:01.146179 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:01.146142    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:01.980663 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:01.980610    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:08.519222 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:08.519187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:08.621456 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:08.621423    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:12.838764 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:12.838728    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:17.756601 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:17.756564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:19.764060 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:19.764029    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:26.823049 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:26.822960    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:27.013261 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:27.013220    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:27.483193 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:27.483157    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:33.601784 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:33.601749    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:33.869261 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:33.869180    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:33.971615 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:33.971580    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:34.093394 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.093364    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:34.607234 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.607200    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"]
Sep 14 11:08:34.610906 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.610886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.613876 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.613860    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e977dc37-openshift-default-dockercfg-hgsqb\""
Sep 14 11:08:34.631186 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.631163    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"]
Sep 14 11:08:34.647501 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.647472    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:34.676703 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.676640    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-envoy\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.676889 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.676734    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-credential-socket\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.676889 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.676756    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3d1003-226d-49b3-8849-152c36e473f1-istiod-ca-cert\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.676889 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.676800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-istio-token\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.677078 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.676917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3d1003-226d-49b3-8849-152c36e473f1-istio-podinfo\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.677078 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.676967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfzmj\" (UniqueName: \"kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-kube-api-access-cfzmj\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.677078 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.676999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-socket\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.677235 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.677104    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-certs\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.677235 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.677129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-data\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.778683 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.778620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-istio-token\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.778871 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.778708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3d1003-226d-49b3-8849-152c36e473f1-istio-podinfo\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.778871 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.778743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfzmj\" (UniqueName: \"kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-kube-api-access-cfzmj\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.778871 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.778767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-socket\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.778871 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.778847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-certs\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.778871 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.778870    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-data\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.779161 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.778907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-envoy\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.779161 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.778954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-credential-socket\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.779161 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.778981    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3d1003-226d-49b3-8849-152c36e473f1-istiod-ca-cert\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.779399 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.779378    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-certs\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.779459 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.779423    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-credential-socket\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.779577 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.779557    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-data\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.779641 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.779591    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-socket\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.779934 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.779912    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3d1003-226d-49b3-8849-152c36e473f1-istiod-ca-cert\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.781303 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.781281    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-envoy\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.781396 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.781381    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3d1003-226d-49b3-8849-152c36e473f1-istio-podinfo\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.791589 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.791567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-istio-token\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.791878 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.791855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfzmj\" (UniqueName: \"kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-kube-api-access-cfzmj\") pod \"e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") " pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:34.838395 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.838364    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:34.921042 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:34.920949    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:35.173195 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:35.173121    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:35.214256 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:35.214230    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"]
Sep 14 11:08:35.216283 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:08:35.216256    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3d1003_226d_49b3_8849_152c36e473f1.slice/crio-f13c268b0ab82a14687e19a92b9edbd008a215317073d34873c43bc123022aaf WatchSource:0}: Error finding container f13c268b0ab82a14687e19a92b9edbd008a215317073d34873c43bc123022aaf: Status 404 returned error can't find the container with id f13c268b0ab82a14687e19a92b9edbd008a215317073d34873c43bc123022aaf
Sep 14 11:08:35.218531 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:35.218496    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:08:35.218636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:35.218576    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:08:35.218636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:35.218617    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:08:35.918834 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:35.918798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" event={"ID":"4d3d1003-226d-49b3-8849-152c36e473f1","Type":"ContainerStarted","Data":"1119d2525b15c85c92eb135447f527a75322e19a7e7ced3b15a4c969b26251e4"}
Sep 14 11:08:35.919211 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:35.918854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" event={"ID":"4d3d1003-226d-49b3-8849-152c36e473f1","Type":"ContainerStarted","Data":"f13c268b0ab82a14687e19a92b9edbd008a215317073d34873c43bc123022aaf"}
Sep 14 11:08:35.921136 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:35.921120    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:35.947137 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:35.947090    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" podStartSLOduration=1.947073203 podStartE2EDuration="1.947073203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:08:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:08:35.945628289 +0000 UTC m=+1175.926263794" watchObservedRunningTime="2026-09-14 11:08:35.947073203 +0000 UTC m=+1175.927708708"
Sep 14 11:08:36.289660 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:36.289617    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:36.926495 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:36.926468    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:37.213016 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:37.212933    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:37.928534 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:37.928501    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:37.929556 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:37.929536    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:08:38.751075 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:38.751048    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:39.610977 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:39.610936    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:40.347378 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:40.347336    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:41.396921 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:41.396883    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:41.960566 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:41.960535    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:42.067616 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:42.067584    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:42.369813 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:42.369782    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:43.494448 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:43.494416    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:44.510806 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:44.510776    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:45.434415 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:45.434377    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:45.532808 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:45.532775    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:46.373916 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.373866    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:46.403576 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.403545    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"]
Sep 14 11:08:46.403863 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.403823    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl" podUID="ec647a6c-d636-4aec-81a3-5eb88ce30dfd" containerName="payload-processing" containerID="cri-o://0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545" gracePeriod=30
Sep 14 11:08:46.410373 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.410230    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"]
Sep 14 11:08:46.410838 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.410465    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth" podUID="46ecf466-bc87-4226-8485-7edfbd6bf734" containerName="payload-pre-processing" containerID="cri-o://7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d" gracePeriod=30
Sep 14 11:08:46.487996 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.487966    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:46.595447 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.595384    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:46.695144 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.695117    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:46.707089 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.707067    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:08:46.711050 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.711031    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:08:46.800289 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.800255    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-plugins-config-volume\") pod \"ec647a6c-d636-4aec-81a3-5eb88ce30dfd\" (UID: \"ec647a6c-d636-4aec-81a3-5eb88ce30dfd\") "
Sep 14 11:08:46.800474 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.800308    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5kn7\" (UniqueName: \"kubernetes.io/projected/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-kube-api-access-f5kn7\") pod \"ec647a6c-d636-4aec-81a3-5eb88ce30dfd\" (UID: \"ec647a6c-d636-4aec-81a3-5eb88ce30dfd\") "
Sep 14 11:08:46.800697 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.800669    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ec647a6c-d636-4aec-81a3-5eb88ce30dfd" (UID: "ec647a6c-d636-4aec-81a3-5eb88ce30dfd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:08:46.800761 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.800750    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:08:46.802524 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.802497    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-kube-api-access-f5kn7" (OuterVolumeSpecName: "kube-api-access-f5kn7") pod "ec647a6c-d636-4aec-81a3-5eb88ce30dfd" (UID: "ec647a6c-d636-4aec-81a3-5eb88ce30dfd"). InnerVolumeSpecName "kube-api-access-f5kn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:08:46.830438 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.830405    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:46.902178 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.901332    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46ecf466-bc87-4226-8485-7edfbd6bf734-plugins-config-volume\") pod \"46ecf466-bc87-4226-8485-7edfbd6bf734\" (UID: \"46ecf466-bc87-4226-8485-7edfbd6bf734\") "
Sep 14 11:08:46.902178 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.901381    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5fzw\" (UniqueName: \"kubernetes.io/projected/46ecf466-bc87-4226-8485-7edfbd6bf734-kube-api-access-s5fzw\") pod \"46ecf466-bc87-4226-8485-7edfbd6bf734\" (UID: \"46ecf466-bc87-4226-8485-7edfbd6bf734\") "
Sep 14 11:08:46.902178 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.901768    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5kn7\" (UniqueName: \"kubernetes.io/projected/ec647a6c-d636-4aec-81a3-5eb88ce30dfd-kube-api-access-f5kn7\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:08:46.902178 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.901779    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46ecf466-bc87-4226-8485-7edfbd6bf734-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "46ecf466-bc87-4226-8485-7edfbd6bf734" (UID: "46ecf466-bc87-4226-8485-7edfbd6bf734"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:08:46.904682 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.904627    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46ecf466-bc87-4226-8485-7edfbd6bf734-kube-api-access-s5fzw" (OuterVolumeSpecName: "kube-api-access-s5fzw") pod "46ecf466-bc87-4226-8485-7edfbd6bf734" (UID: "46ecf466-bc87-4226-8485-7edfbd6bf734"). InnerVolumeSpecName "kube-api-access-s5fzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:08:46.927920 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.927887    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:46.977113 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.977082    2576 generic.go:356] "Generic (PLEG): container finished" podID="46ecf466-bc87-4226-8485-7edfbd6bf734" containerID="7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d" exitCode=0
Sep 14 11:08:46.977293 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.977134    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"
Sep 14 11:08:46.977293 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.977175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth" event={"ID":"46ecf466-bc87-4226-8485-7edfbd6bf734","Type":"ContainerDied","Data":"7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d"}
Sep 14 11:08:46.977293 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.977235    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth" event={"ID":"46ecf466-bc87-4226-8485-7edfbd6bf734","Type":"ContainerDied","Data":"056cf4ce518613bbdb6bf4a35604a61c14dc32eca8d978a5bab256bad1037597"}
Sep 14 11:08:46.977293 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.977268    2576 scope.go:117] "RemoveContainer" containerID="7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d"
Sep 14 11:08:46.978778 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.978751    2576 generic.go:356] "Generic (PLEG): container finished" podID="ec647a6c-d636-4aec-81a3-5eb88ce30dfd" containerID="0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545" exitCode=0
Sep 14 11:08:46.978917 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.978811    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl" event={"ID":"ec647a6c-d636-4aec-81a3-5eb88ce30dfd","Type":"ContainerDied","Data":"0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545"}
Sep 14 11:08:46.978917 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.978821    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"
Sep 14 11:08:46.978917 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.978850    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl" event={"ID":"ec647a6c-d636-4aec-81a3-5eb88ce30dfd","Type":"ContainerDied","Data":"68e3b8549000f1e7804799031439b6c1577d9dfb2dab2ca2268494c3c53deb18"}
Sep 14 11:08:46.988712 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.988695    2576 scope.go:117] "RemoveContainer" containerID="7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d"
Sep 14 11:08:46.989164 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:08:46.989141    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d\": container with ID starting with 7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d not found: ID does not exist" containerID="7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d"
Sep 14 11:08:46.989266 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.989175    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d"} err="failed to get container status \"7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d\": rpc error: code = NotFound desc = could not find container \"7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d\": container with ID starting with 7d450034f98242a7d65a4b3fb2cde135960706ba6a1969d12e62d545f8d32a0d not found: ID does not exist"
Sep 14 11:08:46.989266 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.989197    2576 scope.go:117] "RemoveContainer" containerID="0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545"
Sep 14 11:08:46.998159 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.998143    2576 scope.go:117] "RemoveContainer" containerID="0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545"
Sep 14 11:08:46.998373 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:08:46.998355    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545\": container with ID starting with 0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545 not found: ID does not exist" containerID="0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545"
Sep 14 11:08:46.998422 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:46.998380    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545"} err="failed to get container status \"0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545\": rpc error: code = NotFound desc = could not find container \"0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545\": container with ID starting with 0d23167d7cc35abd56eca2f4f718f8726441bc0a7cd38daa71f36e921bfdc545 not found: ID does not exist"
Sep 14 11:08:47.002553 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.002532    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46ecf466-bc87-4226-8485-7edfbd6bf734-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:08:47.002640 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.002556    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5fzw\" (UniqueName: \"kubernetes.io/projected/46ecf466-bc87-4226-8485-7edfbd6bf734-kube-api-access-s5fzw\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:08:47.003366 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.003347    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"]
Sep 14 11:08:47.008803 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.008783    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl"]
Sep 14 11:08:47.031754 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.031732    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"]
Sep 14 11:08:47.041073 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.041052    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth"]
Sep 14 11:08:47.149099 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.149066    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:47.425274 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.425226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:47.598794 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.598762    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:47.698020 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.697945    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"]
Sep 14 11:08:47.698357 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.698343    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec647a6c-d636-4aec-81a3-5eb88ce30dfd" containerName="payload-processing"
Sep 14 11:08:47.698401 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.698361    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec647a6c-d636-4aec-81a3-5eb88ce30dfd" containerName="payload-processing"
Sep 14 11:08:47.698401 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.698378    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46ecf466-bc87-4226-8485-7edfbd6bf734" containerName="payload-pre-processing"
Sep 14 11:08:47.698401 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.698385    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46ecf466-bc87-4226-8485-7edfbd6bf734" containerName="payload-pre-processing"
Sep 14 11:08:47.698497 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.698455    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec647a6c-d636-4aec-81a3-5eb88ce30dfd" containerName="payload-processing"
Sep 14 11:08:47.698497 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.698463    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="46ecf466-bc87-4226-8485-7edfbd6bf734" containerName="payload-pre-processing"
Sep 14 11:08:47.700122 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.700101    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:47.702949 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.702935    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:08:47.705102 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.705086    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e977dc37\""
Sep 14 11:08:47.721364 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.721339    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"]
Sep 14 11:08:47.810000 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.809962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfqfg\" (UniqueName: \"kubernetes.io/projected/cbb22312-e120-4211-b8b5-a32455e4efd3-kube-api-access-zfqfg\") pod \"payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph\" (UID: \"cbb22312-e120-4211-b8b5-a32455e4efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:08:47.810166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.810008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbb22312-e120-4211-b8b5-a32455e4efd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph\" (UID: \"cbb22312-e120-4211-b8b5-a32455e4efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:08:47.859554 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.859520    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"]
Sep 14 11:08:47.864078 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.864052    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:08:47.866408 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.866372    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e977dc37-dockercfg-9mdpz\""
Sep 14 11:08:47.872438 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.872407    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"]
Sep 14 11:08:47.911372 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.911341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfqfg\" (UniqueName: \"kubernetes.io/projected/cbb22312-e120-4211-b8b5-a32455e4efd3-kube-api-access-zfqfg\") pod \"payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph\" (UID: \"cbb22312-e120-4211-b8b5-a32455e4efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:08:47.911532 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.911377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbb22312-e120-4211-b8b5-a32455e4efd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph\" (UID: \"cbb22312-e120-4211-b8b5-a32455e4efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:08:47.912088 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.912071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbb22312-e120-4211-b8b5-a32455e4efd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph\" (UID: \"cbb22312-e120-4211-b8b5-a32455e4efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:08:47.920196 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:47.920174    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfqfg\" (UniqueName: \"kubernetes.io/projected/cbb22312-e120-4211-b8b5-a32455e4efd3-kube-api-access-zfqfg\") pod \"payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph\" (UID: \"cbb22312-e120-4211-b8b5-a32455e4efd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:08:48.012569 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.012538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjlf4\" (UniqueName: \"kubernetes.io/projected/1cfdae36-0cd1-487c-81a6-837b26838c4c-kube-api-access-jjlf4\") pod \"payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md\" (UID: \"1cfdae36-0cd1-487c-81a6-837b26838c4c\") " pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:08:48.012754 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.012589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cfdae36-0cd1-487c-81a6-837b26838c4c-plugins-config-volume\") pod \"payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md\" (UID: \"1cfdae36-0cd1-487c-81a6-837b26838c4c\") " pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:08:48.012806 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.012755    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:08:48.113230 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.113194    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlf4\" (UniqueName: \"kubernetes.io/projected/1cfdae36-0cd1-487c-81a6-837b26838c4c-kube-api-access-jjlf4\") pod \"payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md\" (UID: \"1cfdae36-0cd1-487c-81a6-837b26838c4c\") " pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:08:48.113401 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.113246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cfdae36-0cd1-487c-81a6-837b26838c4c-plugins-config-volume\") pod \"payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md\" (UID: \"1cfdae36-0cd1-487c-81a6-837b26838c4c\") " pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:08:48.113956 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.113934    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cfdae36-0cd1-487c-81a6-837b26838c4c-plugins-config-volume\") pod \"payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md\" (UID: \"1cfdae36-0cd1-487c-81a6-837b26838c4c\") " pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:08:48.122564 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.122542    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjlf4\" (UniqueName: \"kubernetes.io/projected/1cfdae36-0cd1-487c-81a6-837b26838c4c-kube-api-access-jjlf4\") pod \"payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md\" (UID: \"1cfdae36-0cd1-487c-81a6-837b26838c4c\") " pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:08:48.137427 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.137375    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:48.178137 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.178114    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:08:48.290524 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.290497    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"]
Sep 14 11:08:48.292640 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:08:48.292610    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb22312_e120_4211_b8b5_a32455e4efd3.slice/crio-7e52155f242601efcf3ab0c57deec886b909df34e376980dc6a175260c6bd637 WatchSource:0}: Error finding container 7e52155f242601efcf3ab0c57deec886b909df34e376980dc6a175260c6bd637: Status 404 returned error can't find the container with id 7e52155f242601efcf3ab0c57deec886b909df34e376980dc6a175260c6bd637
Sep 14 11:08:48.481323 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.481295    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"]
Sep 14 11:08:48.484229 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:08:48.484202    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cfdae36_0cd1_487c_81a6_837b26838c4c.slice/crio-9477cb5921235b286682d7b3d4aa590d7193879cf1bdaf2ccff5b1e5b3309684 WatchSource:0}: Error finding container 9477cb5921235b286682d7b3d4aa590d7193879cf1bdaf2ccff5b1e5b3309684: Status 404 returned error can't find the container with id 9477cb5921235b286682d7b3d4aa590d7193879cf1bdaf2ccff5b1e5b3309684
Sep 14 11:08:48.560668 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.560622    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46ecf466-bc87-4226-8485-7edfbd6bf734" path="/var/lib/kubelet/pods/46ecf466-bc87-4226-8485-7edfbd6bf734/volumes"
Sep 14 11:08:48.561051 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.561033    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec647a6c-d636-4aec-81a3-5eb88ce30dfd" path="/var/lib/kubelet/pods/ec647a6c-d636-4aec-81a3-5eb88ce30dfd/volumes"
Sep 14 11:08:48.993217 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.993181    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md" event={"ID":"1cfdae36-0cd1-487c-81a6-837b26838c4c","Type":"ContainerStarted","Data":"b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c"}
Sep 14 11:08:48.993697 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.993382    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:08:48.993697 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.993415    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md" event={"ID":"1cfdae36-0cd1-487c-81a6-837b26838c4c","Type":"ContainerStarted","Data":"9477cb5921235b286682d7b3d4aa590d7193879cf1bdaf2ccff5b1e5b3309684"}
Sep 14 11:08:48.994936 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.994909    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph" event={"ID":"cbb22312-e120-4211-b8b5-a32455e4efd3","Type":"ContainerStarted","Data":"444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c"}
Sep 14 11:08:48.995052 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.994950    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph" event={"ID":"cbb22312-e120-4211-b8b5-a32455e4efd3","Type":"ContainerStarted","Data":"7e52155f242601efcf3ab0c57deec886b909df34e376980dc6a175260c6bd637"}
Sep 14 11:08:48.995052 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:48.995000    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:08:49.041243 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:49.041196    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md" podStartSLOduration=2.041181273 podStartE2EDuration="2.041181273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:08:49.040981619 +0000 UTC m=+1189.021617124" watchObservedRunningTime="2026-09-14 11:08:49.041181273 +0000 UTC m=+1189.021816834"
Sep 14 11:08:49.081320 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:49.081267    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph" podStartSLOduration=2.081247895 podStartE2EDuration="2.081247895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:08:49.07691008 +0000 UTC m=+1189.057545585" watchObservedRunningTime="2026-09-14 11:08:49.081247895 +0000 UTC m=+1189.061883404"
Sep 14 11:08:49.550165 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:49.550131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:50.382969 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:50.382935    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:51.552711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:51.552676    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:52.304819 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:52.304780    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:52.482849 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:52.482805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:53.125092 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:53.125054    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:54.265892 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:54.265848    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:54.346775 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:54.346740    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:54.523458 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:54.523366    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"]
Sep 14 11:08:54.523623 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:54.523596    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy" containerID="cri-o://7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0" gracePeriod=30
Sep 14 11:08:54.554044 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:54.553969    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:55.522519 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:55.522484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:55.617578 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:55.617542    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:57.987208 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:57.987175    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:58.106325 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:58.106292    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:58.230556 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:58.230523    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:08:59.822640 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.822615    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:08:59.924783 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.924751    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-socket\") pod \"de572ade-f4f4-41b6-b22d-924f5c94fa40\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") "
Sep 14 11:08:59.924952 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.924792    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-certs\") pod \"de572ade-f4f4-41b6-b22d-924f5c94fa40\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") "
Sep 14 11:08:59.924952 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.924837    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-token\") pod \"de572ade-f4f4-41b6-b22d-924f5c94fa40\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") "
Sep 14 11:08:59.924952 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.924900    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvkcm\" (UniqueName: \"kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-kube-api-access-rvkcm\") pod \"de572ade-f4f4-41b6-b22d-924f5c94fa40\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") "
Sep 14 11:08:59.924952 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.924926    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-credential-socket\") pod \"de572ade-f4f4-41b6-b22d-924f5c94fa40\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") "
Sep 14 11:08:59.924952 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.924952    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-data\") pod \"de572ade-f4f4-41b6-b22d-924f5c94fa40\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") "
Sep 14 11:08:59.925209 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.924990    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-podinfo\") pod \"de572ade-f4f4-41b6-b22d-924f5c94fa40\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") "
Sep 14 11:08:59.925209 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.925021    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-envoy\") pod \"de572ade-f4f4-41b6-b22d-924f5c94fa40\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") "
Sep 14 11:08:59.925209 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.925047    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de572ade-f4f4-41b6-b22d-924f5c94fa40-istiod-ca-cert\") pod \"de572ade-f4f4-41b6-b22d-924f5c94fa40\" (UID: \"de572ade-f4f4-41b6-b22d-924f5c94fa40\") "
Sep 14 11:08:59.925377 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.925036    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de572ade-f4f4-41b6-b22d-924f5c94fa40" (UID: "de572ade-f4f4-41b6-b22d-924f5c94fa40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:08:59.925377 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.925109    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de572ade-f4f4-41b6-b22d-924f5c94fa40" (UID: "de572ade-f4f4-41b6-b22d-924f5c94fa40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:08:59.925377 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.925307    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-data" (OuterVolumeSpecName: "istio-data") pod "de572ade-f4f4-41b6-b22d-924f5c94fa40" (UID: "de572ade-f4f4-41b6-b22d-924f5c94fa40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:08:59.925377 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.925338    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de572ade-f4f4-41b6-b22d-924f5c94fa40" (UID: "de572ade-f4f4-41b6-b22d-924f5c94fa40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:08:59.925588 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.925426    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de572ade-f4f4-41b6-b22d-924f5c94fa40-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de572ade-f4f4-41b6-b22d-924f5c94fa40" (UID: "de572ade-f4f4-41b6-b22d-924f5c94fa40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:08:59.927211 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.927181    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-kube-api-access-rvkcm" (OuterVolumeSpecName: "kube-api-access-rvkcm") pod "de572ade-f4f4-41b6-b22d-924f5c94fa40" (UID: "de572ade-f4f4-41b6-b22d-924f5c94fa40"). InnerVolumeSpecName "kube-api-access-rvkcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:08:59.927336 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.927221    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de572ade-f4f4-41b6-b22d-924f5c94fa40" (UID: "de572ade-f4f4-41b6-b22d-924f5c94fa40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 11:08:59.927336 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.927229    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-token" (OuterVolumeSpecName: "istio-token") pod "de572ade-f4f4-41b6-b22d-924f5c94fa40" (UID: "de572ade-f4f4-41b6-b22d-924f5c94fa40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:08:59.927336 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:08:59.927279    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de572ade-f4f4-41b6-b22d-924f5c94fa40" (UID: "de572ade-f4f4-41b6-b22d-924f5c94fa40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:09:00.002388 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.002357    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:09:00.002555 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.002536    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:09:00.026856 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.026824    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-envoy\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:00.027072 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.027057    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de572ade-f4f4-41b6-b22d-924f5c94fa40-istiod-ca-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:00.027157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.027076    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:00.027157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.027089    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-workload-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:00.027157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.027103    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:00.027157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.027116    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvkcm\" (UniqueName: \"kubernetes.io/projected/de572ade-f4f4-41b6-b22d-924f5c94fa40-kube-api-access-rvkcm\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:00.027157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.027131    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-credential-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:00.027157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.027145    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-data\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:00.027157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.027158    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de572ade-f4f4-41b6-b22d-924f5c94fa40-istio-podinfo\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:00.062890 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.062797    2576 generic.go:356] "Generic (PLEG): container finished" podID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerID="7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0" exitCode=0
Sep 14 11:09:00.062890 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.062856    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"
Sep 14 11:09:00.062890 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.062880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" event={"ID":"de572ade-f4f4-41b6-b22d-924f5c94fa40","Type":"ContainerDied","Data":"7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0"}
Sep 14 11:09:00.063158 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.062934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf" event={"ID":"de572ade-f4f4-41b6-b22d-924f5c94fa40","Type":"ContainerDied","Data":"811bd592e9488d2b0f6a6a092745feaff47dfb79b01fb99da6bbbb2ad7089e59"}
Sep 14 11:09:00.063158 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.062961    2576 scope.go:117] "RemoveContainer" containerID="7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0"
Sep 14 11:09:00.095669 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.087197    2576 scope.go:117] "RemoveContainer" containerID="070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a"
Sep 14 11:09:00.111899 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.111880    2576 scope.go:117] "RemoveContainer" containerID="7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0"
Sep 14 11:09:00.112205 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:09:00.112186    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0\": container with ID starting with 7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0 not found: ID does not exist" containerID="7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0"
Sep 14 11:09:00.112247 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.112228    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0"} err="failed to get container status \"7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0\": rpc error: code = NotFound desc = could not find container \"7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0\": container with ID starting with 7381c99859f93278b0a8b71734b09fc0ea544205268e6f7ce6b46b555667c9f0 not found: ID does not exist"
Sep 14 11:09:00.112290 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.112249    2576 scope.go:117] "RemoveContainer" containerID="070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a"
Sep 14 11:09:00.112753 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:09:00.112719    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a\": container with ID starting with 070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a not found: ID does not exist" containerID="070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a"
Sep 14 11:09:00.112903 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.112757    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a"} err="failed to get container status \"070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a\": rpc error: code = NotFound desc = could not find container \"070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a\": container with ID starting with 070487c2eef49bc6d005f5708e7b4d7fe49a5be805958e46e6026c33c8d2237a not found: ID does not exist"
Sep 14 11:09:00.115660 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.115627    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"]
Sep 14 11:09:00.123203 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.123182    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf"]
Sep 14 11:09:00.562143 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:00.562107    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" path="/var/lib/kubelet/pods/de572ade-f4f4-41b6-b22d-924f5c94fa40/volumes"
Sep 14 11:09:04.969141 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:04.969110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:05.128870 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:05.128835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:05.227983 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:05.227897    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:07.107545 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:07.107513    2576 generic.go:356] "Generic (PLEG): container finished" podID="4d3d1003-226d-49b3-8849-152c36e473f1" containerID="1119d2525b15c85c92eb135447f527a75322e19a7e7ced3b15a4c969b26251e4" exitCode=0
Sep 14 11:09:07.107973 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:07.107586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" event={"ID":"4d3d1003-226d-49b3-8849-152c36e473f1","Type":"ContainerDied","Data":"1119d2525b15c85c92eb135447f527a75322e19a7e7ced3b15a4c969b26251e4"}
Sep 14 11:09:07.108032 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:07.107995    2576 scope.go:117] "RemoveContainer" containerID="1119d2525b15c85c92eb135447f527a75322e19a7e7ced3b15a4c969b26251e4"
Sep 14 11:09:07.109106 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:07.109073    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:09:07.109214 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:07.109158    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:09:07.109277 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:07.109209    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:09:07.753768 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:07.753734    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:07.929346 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:07.929315    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:09:08.114744 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:08.114633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" event={"ID":"4d3d1003-226d-49b3-8849-152c36e473f1","Type":"ContainerStarted","Data":"2b8278b91d11ead4ec2b4eb507119cae788eba75f6d5330e3bf1a343577e4769"}
Sep 14 11:09:08.144665 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:08.144628    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:08.922013 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:08.921969    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:09:08.923194 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:08.923171    2576 patch_prober.go:28] interesting pod/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 14 11:09:08.923273 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:08.923224    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 14 11:09:09.295065 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:09.295022    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:09.922322 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:09.922288    2576 patch_prober.go:28] interesting pod/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 14 11:09:09.922493 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:09.922340    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 14 11:09:10.297753 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:10.297708    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:10.922160 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:10.922124    2576 patch_prober.go:28] interesting pod/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 14 11:09:10.922422 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:10.922181    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 14 11:09:11.209892 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:11.209803    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:11.921907 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:11.921864    2576 patch_prober.go:28] interesting pod/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 14 11:09:11.922308 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:11.921931    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 14 11:09:12.033285 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:12.033250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:12.284323 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:12.284289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:12.921568 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:12.921530    2576 patch_prober.go:28] interesting pod/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 14 11:09:12.921793 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:12.921612    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 14 11:09:12.964900 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:12.964866    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:13.097168 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:13.097123    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:13.232913 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:13.232868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:13.550040 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:13.549951    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:13.926076 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:13.925998    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:09:13.926293 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:13.926274    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:09:13.926929 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:13.926915    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:09:14.563963 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:14.563934    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:15.786407 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:15.786374    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:19.953804 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:19.953748    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:20.043705 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.043673    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:20.424981 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.424947    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:20.763417 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.763381    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"]
Sep 14 11:09:20.763852 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.763836    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy"
Sep 14 11:09:20.763906 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.763854    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy"
Sep 14 11:09:20.763906 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.763862    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy"
Sep 14 11:09:20.763906 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.763868    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy"
Sep 14 11:09:20.764006 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.763927    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy"
Sep 14 11:09:20.767385 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.767359    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:20.774674 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.771172    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-d6e5fb\"/\"noten-model-d6e5fb-kserve-self-signed-certs\""
Sep 14 11:09:20.774674 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.771643    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-d6e5fb\"/\"default-dockercfg-zzc2t\""
Sep 14 11:09:20.774674 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.772391    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-d6e5fb\"/\"kube-root-ca.crt\""
Sep 14 11:09:20.774674 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.772916    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-d6e5fb\"/\"openshift-service-ca.crt\""
Sep 14 11:09:20.794938 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.794906    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"]
Sep 14 11:09:20.931389 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.931350    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgkzd\" (UniqueName: \"kubernetes.io/projected/95f4c5e0-3071-4c10-8029-6a49fd572ab9-kube-api-access-wgkzd\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:20.931389 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.931388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tls-certs\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:20.931681 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.931422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tmp-dir\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:20.931681 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.931589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-model-cache\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:20.931681 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.931642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-home\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:20.931803 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:20.931714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-dshm\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.033166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.033075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgkzd\" (UniqueName: \"kubernetes.io/projected/95f4c5e0-3071-4c10-8029-6a49fd572ab9-kube-api-access-wgkzd\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.033166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.033115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tls-certs\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.033166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.033159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tmp-dir\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.033973 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.033262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-model-cache\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.033973 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.033298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-home\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.033973 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.033332    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-dshm\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.033973 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.033746    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-home\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.033973 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.033743    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-model-cache\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.033973 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.033779    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tmp-dir\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.035663 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.035625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-dshm\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.035779 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.035632    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tls-certs\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.041839 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.041816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgkzd\" (UniqueName: \"kubernetes.io/projected/95f4c5e0-3071-4c10-8029-6a49fd572ab9-kube-api-access-wgkzd\") pod \"noten-model-d6e5fb-kserve-6d596b54c-jvvvt\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") " pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.086284 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.086253    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:21.133536 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.133502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:21.362804 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.362777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"]
Sep 14 11:09:21.365110 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:09:21.365084    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95f4c5e0_3071_4c10_8029_6a49fd572ab9.slice/crio-c4124b5c0642b935c57ed6ce2447df6a207f5421ce042b308b8c697695866b1f WatchSource:0}: Error finding container c4124b5c0642b935c57ed6ce2447df6a207f5421ce042b308b8c697695866b1f: Status 404 returned error can't find the container with id c4124b5c0642b935c57ed6ce2447df6a207f5421ce042b308b8c697695866b1f
Sep 14 11:09:21.495891 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:21.495855    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:22.184251 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:22.184216    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt" event={"ID":"95f4c5e0-3071-4c10-8029-6a49fd572ab9","Type":"ContainerStarted","Data":"29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c"}
Sep 14 11:09:22.184696 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:22.184261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt" event={"ID":"95f4c5e0-3071-4c10-8029-6a49fd572ab9","Type":"ContainerStarted","Data":"c4124b5c0642b935c57ed6ce2447df6a207f5421ce042b308b8c697695866b1f"}
Sep 14 11:09:22.208695 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:22.208626    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt" podStartSLOduration=2.208606625 podStartE2EDuration="2.208606625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:09:22.207921408 +0000 UTC m=+1222.188556913" watchObservedRunningTime="2026-09-14 11:09:22.208606625 +0000 UTC m=+1222.189242131"
Sep 14 11:09:22.475281 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:22.475151    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:23.292332 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:23.292301    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:24.186832 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:24.186800    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:25.252331 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:25.252302    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:25.354290 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:25.354251    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:26.147717 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:26.147681    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:27.270314 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:27.270278    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:30.908552 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:30.908495    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"]
Sep 14 11:09:30.909044 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:30.908825    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md" podUID="1cfdae36-0cd1-487c-81a6-837b26838c4c" containerName="payload-processing" containerID="cri-o://b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c" gracePeriod=30
Sep 14 11:09:30.911770 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:30.911740    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"]
Sep 14 11:09:30.912005 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:30.911960    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph" podUID="cbb22312-e120-4211-b8b5-a32455e4efd3" containerName="payload-pre-processing" containerID="cri-o://444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c" gracePeriod=30
Sep 14 11:09:31.087513 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.087478    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:31.087873 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.087848    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:31.101796 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.101774    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:31.200846 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.200820    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:09:31.203423 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.203401    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.233542    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfqfg\" (UniqueName: \"kubernetes.io/projected/cbb22312-e120-4211-b8b5-a32455e4efd3-kube-api-access-zfqfg\") pod \"cbb22312-e120-4211-b8b5-a32455e4efd3\" (UID: \"cbb22312-e120-4211-b8b5-a32455e4efd3\") "
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.233593    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjlf4\" (UniqueName: \"kubernetes.io/projected/1cfdae36-0cd1-487c-81a6-837b26838c4c-kube-api-access-jjlf4\") pod \"1cfdae36-0cd1-487c-81a6-837b26838c4c\" (UID: \"1cfdae36-0cd1-487c-81a6-837b26838c4c\") "
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.233698    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cfdae36-0cd1-487c-81a6-837b26838c4c-plugins-config-volume\") pod \"1cfdae36-0cd1-487c-81a6-837b26838c4c\" (UID: \"1cfdae36-0cd1-487c-81a6-837b26838c4c\") "
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.233725    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbb22312-e120-4211-b8b5-a32455e4efd3-plugins-config-volume\") pod \"cbb22312-e120-4211-b8b5-a32455e4efd3\" (UID: \"cbb22312-e120-4211-b8b5-a32455e4efd3\") "
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.233793    2576 generic.go:356] "Generic (PLEG): container finished" podID="cbb22312-e120-4211-b8b5-a32455e4efd3" containerID="444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c" exitCode=0
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.234283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph" event={"ID":"cbb22312-e120-4211-b8b5-a32455e4efd3","Type":"ContainerDied","Data":"444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c"}
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.234720    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cfdae36-0cd1-487c-81a6-837b26838c4c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1cfdae36-0cd1-487c-81a6-837b26838c4c" (UID: "1cfdae36-0cd1-487c-81a6-837b26838c4c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.234885    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.235188    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbb22312-e120-4211-b8b5-a32455e4efd3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cbb22312-e120-4211-b8b5-a32455e4efd3" (UID: "cbb22312-e120-4211-b8b5-a32455e4efd3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.236016    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph" event={"ID":"cbb22312-e120-4211-b8b5-a32455e4efd3","Type":"ContainerDied","Data":"7e52155f242601efcf3ab0c57deec886b909df34e376980dc6a175260c6bd637"}
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.236055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md" event={"ID":"1cfdae36-0cd1-487c-81a6-837b26838c4c","Type":"ContainerDied","Data":"b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c"}
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.236053    2576 generic.go:356] "Generic (PLEG): container finished" podID="1cfdae36-0cd1-487c-81a6-837b26838c4c" containerID="b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c" exitCode=0
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.236079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md" event={"ID":"1cfdae36-0cd1-487c-81a6-837b26838c4c","Type":"ContainerDied","Data":"9477cb5921235b286682d7b3d4aa590d7193879cf1bdaf2ccff5b1e5b3309684"}
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.236106    2576 scope.go:117] "RemoveContainer" containerID="444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c"
Sep 14 11:09:31.237680 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.236250    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"
Sep 14 11:09:31.238561 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.238124    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbb22312-e120-4211-b8b5-a32455e4efd3-kube-api-access-zfqfg" (OuterVolumeSpecName: "kube-api-access-zfqfg") pod "cbb22312-e120-4211-b8b5-a32455e4efd3" (UID: "cbb22312-e120-4211-b8b5-a32455e4efd3"). InnerVolumeSpecName "kube-api-access-zfqfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:09:31.239049 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.238824    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cfdae36-0cd1-487c-81a6-837b26838c4c-kube-api-access-jjlf4" (OuterVolumeSpecName: "kube-api-access-jjlf4") pod "1cfdae36-0cd1-487c-81a6-837b26838c4c" (UID: "1cfdae36-0cd1-487c-81a6-837b26838c4c"). InnerVolumeSpecName "kube-api-access-jjlf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:09:31.252471 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.252374    2576 scope.go:117] "RemoveContainer" containerID="444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c"
Sep 14 11:09:31.260604 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:09:31.252990    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c\": container with ID starting with 444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c not found: ID does not exist" containerID="444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c"
Sep 14 11:09:31.260604 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.253048    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c"} err="failed to get container status \"444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c\": rpc error: code = NotFound desc = could not find container \"444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c\": container with ID starting with 444f710deb5e111ef49afe4e78719d89926fc2e4d3cb5c24466bfad23c4b970c not found: ID does not exist"
Sep 14 11:09:31.260604 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.253076    2576 scope.go:117] "RemoveContainer" containerID="b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c"
Sep 14 11:09:31.266994 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.266945    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:09:31.269993 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.269962    2576 scope.go:117] "RemoveContainer" containerID="b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c"
Sep 14 11:09:31.270547 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:09:31.270418    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c\": container with ID starting with b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c not found: ID does not exist" containerID="b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c"
Sep 14 11:09:31.270696 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.270562    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c"} err="failed to get container status \"b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c\": rpc error: code = NotFound desc = could not find container \"b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c\": container with ID starting with b3c8117da7ef81ee888671b9e2015a24fb533be2930a486483bfa4b04691c56c not found: ID does not exist"
Sep 14 11:09:31.335001 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.334969    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfqfg\" (UniqueName: \"kubernetes.io/projected/cbb22312-e120-4211-b8b5-a32455e4efd3-kube-api-access-zfqfg\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:31.335001 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.334995    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjlf4\" (UniqueName: \"kubernetes.io/projected/1cfdae36-0cd1-487c-81a6-837b26838c4c-kube-api-access-jjlf4\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:31.335001 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.335007    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cfdae36-0cd1-487c-81a6-837b26838c4c-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:31.335345 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.335015    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbb22312-e120-4211-b8b5-a32455e4efd3-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:31.431085 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.430996    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:31.561319 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.561292    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"]
Sep 14 11:09:31.569254 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.569225    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph"]
Sep 14 11:09:31.587366 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.587340    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"]
Sep 14 11:09:31.595853 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:31.595824    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md"]
Sep 14 11:09:32.560081 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:32.560039    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cfdae36-0cd1-487c-81a6-837b26838c4c" path="/var/lib/kubelet/pods/1cfdae36-0cd1-487c-81a6-837b26838c4c/volumes"
Sep 14 11:09:32.560595 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:32.560575    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbb22312-e120-4211-b8b5-a32455e4efd3" path="/var/lib/kubelet/pods/cbb22312-e120-4211-b8b5-a32455e4efd3/volumes"
Sep 14 11:09:33.207846 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:33.207812    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:33.325198 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:33.325164    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:34.169097 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:34.169068    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:35.100905 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:35.100872    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:35.966496 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:35.966463    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:38.687074 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:38.687043    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:39.081303 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:39.081271    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"]
Sep 14 11:09:39.081505 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:39.081483    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy" containerID="cri-o://2b8278b91d11ead4ec2b4eb507119cae788eba75f6d5330e3bf1a343577e4769" gracePeriod=30
Sep 14 11:09:39.583362 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:39.583327    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:39.688776 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:39.688744    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:43.928741 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:43.928703    2576 patch_prober.go:28] interesting pod/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 11:09:43.929151 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:43.928780    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 11:09:44.308618 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.308586    2576 generic.go:356] "Generic (PLEG): container finished" podID="4d3d1003-226d-49b3-8849-152c36e473f1" containerID="2b8278b91d11ead4ec2b4eb507119cae788eba75f6d5330e3bf1a343577e4769" exitCode=0
Sep 14 11:09:44.308790 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.308669    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" event={"ID":"4d3d1003-226d-49b3-8849-152c36e473f1","Type":"ContainerDied","Data":"2b8278b91d11ead4ec2b4eb507119cae788eba75f6d5330e3bf1a343577e4769"}
Sep 14 11:09:44.308790 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.308731    2576 scope.go:117] "RemoveContainer" containerID="1119d2525b15c85c92eb135447f527a75322e19a7e7ced3b15a4c969b26251e4"
Sep 14 11:09:44.342726 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.342702    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:09:44.462307 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462217    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-istio-token\") pod \"4d3d1003-226d-49b3-8849-152c36e473f1\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") "
Sep 14 11:09:44.462307 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462259    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-credential-socket\") pod \"4d3d1003-226d-49b3-8849-152c36e473f1\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") "
Sep 14 11:09:44.462307 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462286    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-socket\") pod \"4d3d1003-226d-49b3-8849-152c36e473f1\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") "
Sep 14 11:09:44.462586 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462319    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-envoy\") pod \"4d3d1003-226d-49b3-8849-152c36e473f1\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") "
Sep 14 11:09:44.462586 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462415    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3d1003-226d-49b3-8849-152c36e473f1-istio-podinfo\") pod \"4d3d1003-226d-49b3-8849-152c36e473f1\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") "
Sep 14 11:09:44.462586 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462473    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-data\") pod \"4d3d1003-226d-49b3-8849-152c36e473f1\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") "
Sep 14 11:09:44.462586 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462529    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfzmj\" (UniqueName: \"kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-kube-api-access-cfzmj\") pod \"4d3d1003-226d-49b3-8849-152c36e473f1\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") "
Sep 14 11:09:44.462586 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462539    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4d3d1003-226d-49b3-8849-152c36e473f1" (UID: "4d3d1003-226d-49b3-8849-152c36e473f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:09:44.462586 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462558    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-certs\") pod \"4d3d1003-226d-49b3-8849-152c36e473f1\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") "
Sep 14 11:09:44.462928 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462614    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3d1003-226d-49b3-8849-152c36e473f1-istiod-ca-cert\") pod \"4d3d1003-226d-49b3-8849-152c36e473f1\" (UID: \"4d3d1003-226d-49b3-8849-152c36e473f1\") "
Sep 14 11:09:44.462928 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462744    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4d3d1003-226d-49b3-8849-152c36e473f1" (UID: "4d3d1003-226d-49b3-8849-152c36e473f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:09:44.462928 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462813    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4d3d1003-226d-49b3-8849-152c36e473f1" (UID: "4d3d1003-226d-49b3-8849-152c36e473f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:09:44.463091 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.462949    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-data" (OuterVolumeSpecName: "istio-data") pod "4d3d1003-226d-49b3-8849-152c36e473f1" (UID: "4d3d1003-226d-49b3-8849-152c36e473f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:09:44.463152 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.463118    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d3d1003-226d-49b3-8849-152c36e473f1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4d3d1003-226d-49b3-8849-152c36e473f1" (UID: "4d3d1003-226d-49b3-8849-152c36e473f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:09:44.463242 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.463226    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:44.463300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.463247    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3d1003-226d-49b3-8849-152c36e473f1-istiod-ca-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:44.463300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.463260    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-credential-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:44.463300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.463275    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-workload-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:44.463300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.463290    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-data\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:44.465063 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.465032    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4d3d1003-226d-49b3-8849-152c36e473f1" (UID: "4d3d1003-226d-49b3-8849-152c36e473f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:09:44.465063 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.465033    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-kube-api-access-cfzmj" (OuterVolumeSpecName: "kube-api-access-cfzmj") pod "4d3d1003-226d-49b3-8849-152c36e473f1" (UID: "4d3d1003-226d-49b3-8849-152c36e473f1"). InnerVolumeSpecName "kube-api-access-cfzmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:09:44.465220 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.465063    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-istio-token" (OuterVolumeSpecName: "istio-token") pod "4d3d1003-226d-49b3-8849-152c36e473f1" (UID: "4d3d1003-226d-49b3-8849-152c36e473f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:09:44.465220 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.465073    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d3d1003-226d-49b3-8849-152c36e473f1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4d3d1003-226d-49b3-8849-152c36e473f1" (UID: "4d3d1003-226d-49b3-8849-152c36e473f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 11:09:44.564710 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.564680    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3d1003-226d-49b3-8849-152c36e473f1-istio-envoy\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:44.564710 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.564704    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3d1003-226d-49b3-8849-152c36e473f1-istio-podinfo\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:44.564710 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.564713    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfzmj\" (UniqueName: \"kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-kube-api-access-cfzmj\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:44.564710 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:44.564721    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3d1003-226d-49b3-8849-152c36e473f1-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:09:45.315701 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:45.315661    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2" event={"ID":"4d3d1003-226d-49b3-8849-152c36e473f1","Type":"ContainerDied","Data":"f13c268b0ab82a14687e19a92b9edbd008a215317073d34873c43bc123022aaf"}
Sep 14 11:09:45.315701 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:45.315688    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"
Sep 14 11:09:45.316180 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:45.315752    2576 scope.go:117] "RemoveContainer" containerID="2b8278b91d11ead4ec2b4eb507119cae788eba75f6d5330e3bf1a343577e4769"
Sep 14 11:09:45.334167 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:45.334139    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"]
Sep 14 11:09:45.341529 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:45.341501    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2"]
Sep 14 11:09:45.613368 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:45.613275    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:45.728106 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:45.728076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:45.823694 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:45.823637    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:45.964814 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:45.964732    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:46.560882 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:46.560851    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" path="/var/lib/kubelet/pods/4d3d1003-226d-49b3-8849-152c36e473f1/volumes"
Sep 14 11:09:52.404687 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:52.404642    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:52.538309 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:52.538272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:53.328740 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.328612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:53.623157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623080    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"]
Sep 14 11:09:53.623480 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623471    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cfdae36-0cd1-487c-81a6-837b26838c4c" containerName="payload-processing"
Sep 14 11:09:53.623524 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623483    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cfdae36-0cd1-487c-81a6-837b26838c4c" containerName="payload-processing"
Sep 14 11:09:53.623524 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623498    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy"
Sep 14 11:09:53.623524 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623507    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy"
Sep 14 11:09:53.623524 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623520    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy"
Sep 14 11:09:53.623662 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623526    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy"
Sep 14 11:09:53.623662 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623532    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbb22312-e120-4211-b8b5-a32455e4efd3" containerName="payload-pre-processing"
Sep 14 11:09:53.623662 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623537    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbb22312-e120-4211-b8b5-a32455e4efd3" containerName="payload-pre-processing"
Sep 14 11:09:53.623662 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623596    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy"
Sep 14 11:09:53.623662 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623604    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cfdae36-0cd1-487c-81a6-837b26838c4c" containerName="payload-processing"
Sep 14 11:09:53.623662 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623612    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbb22312-e120-4211-b8b5-a32455e4efd3" containerName="payload-pre-processing"
Sep 14 11:09:53.623662 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623618    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="de572ade-f4f4-41b6-b22d-924f5c94fa40" containerName="istio-proxy"
Sep 14 11:09:53.623662 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.623624    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d3d1003-226d-49b3-8849-152c36e473f1" containerName="istio-proxy"
Sep 14 11:09:53.628125 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.628107    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.631117 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.631094    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-ae9d47-openshift-default-dockercfg-kv6sd\""
Sep 14 11:09:53.639886 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.639865    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"]
Sep 14 11:09:53.658374 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.658343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:53.753499 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.753465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-envoy\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.753708 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.753533    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-socket\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.753708 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.753570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-certs\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.753708 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.753676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-data\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.753848 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.753758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3f11681-9cd2-4524-bc8e-cc2080496e90-istiod-ca-cert\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.753848 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.753784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-token\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.753848 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.753811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6cct\" (UniqueName: \"kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-kube-api-access-c6cct\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.753848 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.753836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-credential-socket\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.753990 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.753869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-podinfo\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855111 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3f11681-9cd2-4524-bc8e-cc2080496e90-istiod-ca-cert\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855275 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-token\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855275 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6cct\" (UniqueName: \"kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-kube-api-access-c6cct\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855275 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-credential-socket\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855275 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-podinfo\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855275 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-envoy\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855542 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-socket\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855542 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-certs\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855542 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-data\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855716 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-credential-socket\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855757 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855729    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-socket\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855797 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-certs\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.855837 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.855818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-data\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.856155 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.856138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3f11681-9cd2-4524-bc8e-cc2080496e90-istiod-ca-cert\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.857581 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.857562    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-envoy\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.857723 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.857706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-podinfo\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.863567 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.863542    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-token\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.863732 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.863542    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6cct\" (UniqueName: \"kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-kube-api-access-c6cct\") pod \"e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") " pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.939627 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.939540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:53.962189 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:53.962108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:54.221497 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:54.221472    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"]
Sep 14 11:09:54.223731 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:09:54.223702    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f11681_9cd2_4524_bc8e_cc2080496e90.slice/crio-036bf25b50a46513c684f21c66dc976181353467dcb05ad546cc0e8154b76987 WatchSource:0}: Error finding container 036bf25b50a46513c684f21c66dc976181353467dcb05ad546cc0e8154b76987: Status 404 returned error can't find the container with id 036bf25b50a46513c684f21c66dc976181353467dcb05ad546cc0e8154b76987
Sep 14 11:09:54.226081 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:54.226036    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:09:54.226183 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:54.226130    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:09:54.226224 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:54.226183    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:09:54.362320 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:54.362283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" event={"ID":"b3f11681-9cd2-4524-bc8e-cc2080496e90","Type":"ContainerStarted","Data":"ffaf3d8f5ec8e7889f327eba59442be29aac695db0c6e1836d428d8e49c0d41d"}
Sep 14 11:09:54.362483 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:54.362339    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" event={"ID":"b3f11681-9cd2-4524-bc8e-cc2080496e90","Type":"ContainerStarted","Data":"036bf25b50a46513c684f21c66dc976181353467dcb05ad546cc0e8154b76987"}
Sep 14 11:09:54.387098 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:54.387035    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" podStartSLOduration=1.387014146 podStartE2EDuration="1.387014146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:09:54.38337744 +0000 UTC m=+1254.364012946" watchObservedRunningTime="2026-09-14 11:09:54.387014146 +0000 UTC m=+1254.367649652"
Sep 14 11:09:54.815415 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:54.815378    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:54.940713 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:54.940674    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:55.008691 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:55.008627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:55.152041 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:55.151936    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:55.589845 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:55.589814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:55.945936 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:55.945854    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:56.305782 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:56.305743    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:56.373631 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:56.373579    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:56.374570 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:56.374553    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:09:56.400781 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:56.400740    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:56.807112 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:56.807071    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:57.810564 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:57.810532    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:58.154334 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:58.154257    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"]
Sep 14 11:09:58.228976 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:58.228945    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:09:59.124311 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:09:59.124271    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:00.300851 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:00.300823    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:00.505411 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:00.505379    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:01.392570 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:01.392533    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:02.424775 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:02.424737    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:02.542503 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:02.542459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:02.659753 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:02.659671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:02.813906 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:02.813877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:03.077798 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.077764    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:03.180436 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.180404    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:03.219339 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.219298    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"]
Sep 14 11:10:03.224009 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.223988    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:10:03.226308 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.226286    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-ae9d47\""
Sep 14 11:10:03.226452 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.226340    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-ae9d47-dockercfg-dnkzg\""
Sep 14 11:10:03.235472 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.235444    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"]
Sep 14 11:10:03.271380 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.271346    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"]
Sep 14 11:10:03.274779 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.274760    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:10:03.284007 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.283979    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"]
Sep 14 11:10:03.353981 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.351181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm777\" (UniqueName: \"kubernetes.io/projected/1d836414-fc27-4e4b-b545-b8f5e9dfa743-kube-api-access-gm777\") pod \"payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9\" (UID: \"1d836414-fc27-4e4b-b545-b8f5e9dfa743\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:10:03.353981 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.351265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw\" (UID: \"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:10:03.353981 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.351292    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nl28\" (UniqueName: \"kubernetes.io/projected/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-kube-api-access-6nl28\") pod \"payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw\" (UID: \"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:10:03.353981 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.351344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d836414-fc27-4e4b-b545-b8f5e9dfa743-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9\" (UID: \"1d836414-fc27-4e4b-b545-b8f5e9dfa743\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:10:03.452052 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.452017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d836414-fc27-4e4b-b545-b8f5e9dfa743-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9\" (UID: \"1d836414-fc27-4e4b-b545-b8f5e9dfa743\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:10:03.452530 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.452110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm777\" (UniqueName: \"kubernetes.io/projected/1d836414-fc27-4e4b-b545-b8f5e9dfa743-kube-api-access-gm777\") pod \"payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9\" (UID: \"1d836414-fc27-4e4b-b545-b8f5e9dfa743\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:10:03.452530 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.452151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw\" (UID: \"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:10:03.452530 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.452169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nl28\" (UniqueName: \"kubernetes.io/projected/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-kube-api-access-6nl28\") pod \"payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw\" (UID: \"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:10:03.452879 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.452860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw\" (UID: \"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:10:03.452944 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.452926    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d836414-fc27-4e4b-b545-b8f5e9dfa743-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9\" (UID: \"1d836414-fc27-4e4b-b545-b8f5e9dfa743\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:10:03.460180 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.460153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm777\" (UniqueName: \"kubernetes.io/projected/1d836414-fc27-4e4b-b545-b8f5e9dfa743-kube-api-access-gm777\") pod \"payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9\" (UID: \"1d836414-fc27-4e4b-b545-b8f5e9dfa743\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:10:03.460180 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.460164    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nl28\" (UniqueName: \"kubernetes.io/projected/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-kube-api-access-6nl28\") pod \"payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw\" (UID: \"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:10:03.536137 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.536101    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:10:03.570426 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.570388    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:03.586923 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.586807    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:10:03.817033 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.817005    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"]
Sep 14 11:10:03.818743 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:10:03.818703    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8b6d59_2a6b_4e4f_9ad6_9b9689f80396.slice/crio-8f09820de9a0757c4c000ddfd05b34f1f6164b719b9de5157f5001410a1a21f3 WatchSource:0}: Error finding container 8f09820de9a0757c4c000ddfd05b34f1f6164b719b9de5157f5001410a1a21f3: Status 404 returned error can't find the container with id 8f09820de9a0757c4c000ddfd05b34f1f6164b719b9de5157f5001410a1a21f3
Sep 14 11:10:03.878171 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:03.878011    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"]
Sep 14 11:10:03.881328 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:10:03.881304    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d836414_fc27_4e4b_b545_b8f5e9dfa743.slice/crio-db9a483b17e92fd625b672718d36ab1fb9cd8186f459c811fa564710c487cc98 WatchSource:0}: Error finding container db9a483b17e92fd625b672718d36ab1fb9cd8186f459c811fa564710c487cc98: Status 404 returned error can't find the container with id db9a483b17e92fd625b672718d36ab1fb9cd8186f459c811fa564710c487cc98
Sep 14 11:10:04.379027 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:04.378995    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:04.416336 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:04.416298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw" event={"ID":"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396","Type":"ContainerStarted","Data":"2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87"}
Sep 14 11:10:04.416550 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:04.416366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw" event={"ID":"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396","Type":"ContainerStarted","Data":"8f09820de9a0757c4c000ddfd05b34f1f6164b719b9de5157f5001410a1a21f3"}
Sep 14 11:10:04.416550 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:04.416397    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:10:04.417959 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:04.417937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9" event={"ID":"1d836414-fc27-4e4b-b545-b8f5e9dfa743","Type":"ContainerStarted","Data":"d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb"}
Sep 14 11:10:04.418080 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:04.417975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9" event={"ID":"1d836414-fc27-4e4b-b545-b8f5e9dfa743","Type":"ContainerStarted","Data":"db9a483b17e92fd625b672718d36ab1fb9cd8186f459c811fa564710c487cc98"}
Sep 14 11:10:04.418080 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:04.418076    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:10:04.463124 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:04.463069    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw" podStartSLOduration=1.463048108 podStartE2EDuration="1.463048108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:10:04.440085692 +0000 UTC m=+1264.420721199" watchObservedRunningTime="2026-09-14 11:10:04.463048108 +0000 UTC m=+1264.443683613"
Sep 14 11:10:04.463590 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:04.463168    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9" podStartSLOduration=1.463161733 podStartE2EDuration="1.463161733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:10:04.46075533 +0000 UTC m=+1264.441390835" watchObservedRunningTime="2026-09-14 11:10:04.463161733 +0000 UTC m=+1264.443797243"
Sep 14 11:10:05.378342 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:05.378290    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:06.666788 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:06.666751    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:08.490252 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:08.490211    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:09.258283 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:09.258250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:09.367332 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:09.367292    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:09.456913 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:09.456872    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:09.574375 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:09.574292    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:09.651757 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:09.651714    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:09.899249 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:09.899153    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:10.206793 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:10.206700    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:10.983894 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:10.983856    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:11.937523 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:11.937478    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:12.381688 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:12.381631    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:12.481914 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:12.481877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:12.763269 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:12.763240    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:13.173897 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.173804    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt" podUID="95f4c5e0-3071-4c10-8029-6a49fd572ab9" containerName="main" containerID="cri-o://29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c" gracePeriod=45
Sep 14 11:10:13.432093 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.432032    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:10:13.450801 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.450764    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tmp-dir\") pod \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") "
Sep 14 11:10:13.450801 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.450810    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-dshm\") pod \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") "
Sep 14 11:10:13.451138 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.450842    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgkzd\" (UniqueName: \"kubernetes.io/projected/95f4c5e0-3071-4c10-8029-6a49fd572ab9-kube-api-access-wgkzd\") pod \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") "
Sep 14 11:10:13.451138 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.450870    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-home\") pod \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") "
Sep 14 11:10:13.451138 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.450903    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-model-cache\") pod \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") "
Sep 14 11:10:13.451138 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.451046    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tls-certs\") pod \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\" (UID: \"95f4c5e0-3071-4c10-8029-6a49fd572ab9\") "
Sep 14 11:10:13.451335 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.451243    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-home" (OuterVolumeSpecName: "home") pod "95f4c5e0-3071-4c10-8029-6a49fd572ab9" (UID: "95f4c5e0-3071-4c10-8029-6a49fd572ab9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:10:13.451436 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.451412    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-home\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:13.451708 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.451626    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-model-cache" (OuterVolumeSpecName: "model-cache") pod "95f4c5e0-3071-4c10-8029-6a49fd572ab9" (UID: "95f4c5e0-3071-4c10-8029-6a49fd572ab9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:10:13.451813 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.451741    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "95f4c5e0-3071-4c10-8029-6a49fd572ab9" (UID: "95f4c5e0-3071-4c10-8029-6a49fd572ab9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:10:13.453792 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.453753    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95f4c5e0-3071-4c10-8029-6a49fd572ab9-kube-api-access-wgkzd" (OuterVolumeSpecName: "kube-api-access-wgkzd") pod "95f4c5e0-3071-4c10-8029-6a49fd572ab9" (UID: "95f4c5e0-3071-4c10-8029-6a49fd572ab9"). InnerVolumeSpecName "kube-api-access-wgkzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:10:13.453792 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.453776    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-dshm" (OuterVolumeSpecName: "dshm") pod "95f4c5e0-3071-4c10-8029-6a49fd572ab9" (UID: "95f4c5e0-3071-4c10-8029-6a49fd572ab9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:10:13.453947 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.453875    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "95f4c5e0-3071-4c10-8029-6a49fd572ab9" (UID: "95f4c5e0-3071-4c10-8029-6a49fd572ab9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:10:13.466311 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.466275    2576 generic.go:356] "Generic (PLEG): container finished" podID="95f4c5e0-3071-4c10-8029-6a49fd572ab9" containerID="29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c" exitCode=0
Sep 14 11:10:13.466446 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.466320    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"
Sep 14 11:10:13.466446 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.466366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt" event={"ID":"95f4c5e0-3071-4c10-8029-6a49fd572ab9","Type":"ContainerDied","Data":"29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c"}
Sep 14 11:10:13.466446 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.466416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt" event={"ID":"95f4c5e0-3071-4c10-8029-6a49fd572ab9","Type":"ContainerDied","Data":"c4124b5c0642b935c57ed6ce2447df6a207f5421ce042b308b8c697695866b1f"}
Sep 14 11:10:13.466446 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.466441    2576 scope.go:117] "RemoveContainer" containerID="29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c"
Sep 14 11:10:13.476345 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.476244    2576 scope.go:117] "RemoveContainer" containerID="29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c"
Sep 14 11:10:13.476835 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:10:13.476794    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c\": container with ID starting with 29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c not found: ID does not exist" containerID="29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c"
Sep 14 11:10:13.476936 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.476840    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c"} err="failed to get container status \"29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c\": rpc error: code = NotFound desc = could not find container \"29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c\": container with ID starting with 29305facdf767765021e908152b99f1c1e7a75926077f8d4d82dec0a57af849c not found: ID does not exist"
Sep 14 11:10:13.496665 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.496618    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"]
Sep 14 11:10:13.499713 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.499688    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-d6e5fb/noten-model-d6e5fb-kserve-6d596b54c-jvvvt"]
Sep 14 11:10:13.552238 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.552208    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tmp-dir\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:13.552238 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.552233    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-dshm\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:13.552238 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.552244    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgkzd\" (UniqueName: \"kubernetes.io/projected/95f4c5e0-3071-4c10-8029-6a49fd572ab9-kube-api-access-wgkzd\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:13.552478 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.552253    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95f4c5e0-3071-4c10-8029-6a49fd572ab9-model-cache\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:13.552478 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.552262    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95f4c5e0-3071-4c10-8029-6a49fd572ab9-tls-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:13.596377 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:13.596344    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:14.561749 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:14.561718    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95f4c5e0-3071-4c10-8029-6a49fd572ab9" path="/var/lib/kubelet/pods/95f4c5e0-3071-4c10-8029-6a49fd572ab9/volumes"
Sep 14 11:10:15.099925 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:15.099890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:15.425282 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:15.425197    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:10:15.425420 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:15.425294    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:10:16.160479 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:16.160441    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:16.260380 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:16.260346    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:16.378982 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:16.378952    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:16.711491 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:16.711453    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:16.876221 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:16.876191    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:17.085891 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:17.085848    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:17.208355 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:17.208307    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:17.372046 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:17.371953    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"]
Sep 14 11:10:17.372533 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:17.372488    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy" containerID="cri-o://61ec361f91b0d761b05bb0e7068d3dd0ab8a9ce0c87a38e3260a9277017582e9" gracePeriod=30
Sep 14 11:10:17.425305 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:17.425256    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:18.430407 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:18.430368    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:19.593336 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:19.593293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:20.201119 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:20.201076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:20.365616 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:20.365573    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:21.122515 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:21.122477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:21.684993 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:21.684885    2576 patch_prober.go:28] interesting pod/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 11:10:21.685261 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:21.685021    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 11:10:22.347318 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.347282    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:22.462377 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.462345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:22.527968 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.527536    2576 generic.go:356] "Generic (PLEG): container finished" podID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerID="61ec361f91b0d761b05bb0e7068d3dd0ab8a9ce0c87a38e3260a9277017582e9" exitCode=0
Sep 14 11:10:22.527968 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.527617    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" event={"ID":"c91f8d98-14ce-40eb-b193-7033d7da7c71","Type":"ContainerDied","Data":"61ec361f91b0d761b05bb0e7068d3dd0ab8a9ce0c87a38e3260a9277017582e9"}
Sep 14 11:10:22.527968 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.527701    2576 scope.go:117] "RemoveContainer" containerID="b68a71211dba5771906644024f68bd2c6e8dd579cab55df5cd2a8d3aef9e20ad"
Sep 14 11:10:22.655200 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.655176    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:10:22.750277 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750243    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-socket\") pod \"c91f8d98-14ce-40eb-b193-7033d7da7c71\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") "
Sep 14 11:10:22.750441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750307    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-credential-socket\") pod \"c91f8d98-14ce-40eb-b193-7033d7da7c71\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") "
Sep 14 11:10:22.750441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750359    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-envoy\") pod \"c91f8d98-14ce-40eb-b193-7033d7da7c71\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") "
Sep 14 11:10:22.750559 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750464    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-data\") pod \"c91f8d98-14ce-40eb-b193-7033d7da7c71\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") "
Sep 14 11:10:22.750559 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750498    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c91f8d98-14ce-40eb-b193-7033d7da7c71-istiod-ca-cert\") pod \"c91f8d98-14ce-40eb-b193-7033d7da7c71\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") "
Sep 14 11:10:22.750559 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750506    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c91f8d98-14ce-40eb-b193-7033d7da7c71" (UID: "c91f8d98-14ce-40eb-b193-7033d7da7c71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:10:22.750559 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750535    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-token\") pod \"c91f8d98-14ce-40eb-b193-7033d7da7c71\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") "
Sep 14 11:10:22.750817 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750565    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-podinfo\") pod \"c91f8d98-14ce-40eb-b193-7033d7da7c71\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") "
Sep 14 11:10:22.750817 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750593    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fllp\" (UniqueName: \"kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-kube-api-access-9fllp\") pod \"c91f8d98-14ce-40eb-b193-7033d7da7c71\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") "
Sep 14 11:10:22.750817 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750620    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-certs\") pod \"c91f8d98-14ce-40eb-b193-7033d7da7c71\" (UID: \"c91f8d98-14ce-40eb-b193-7033d7da7c71\") "
Sep 14 11:10:22.750817 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750618    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c91f8d98-14ce-40eb-b193-7033d7da7c71" (UID: "c91f8d98-14ce-40eb-b193-7033d7da7c71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:10:22.750817 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750760    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-data" (OuterVolumeSpecName: "istio-data") pod "c91f8d98-14ce-40eb-b193-7033d7da7c71" (UID: "c91f8d98-14ce-40eb-b193-7033d7da7c71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:10:22.751076 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.750991    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c91f8d98-14ce-40eb-b193-7033d7da7c71" (UID: "c91f8d98-14ce-40eb-b193-7033d7da7c71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:10:22.751076 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.751021    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-data\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:22.751076 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.751041    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:22.751076 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.751055    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-credential-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:22.751278 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.751123    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c91f8d98-14ce-40eb-b193-7033d7da7c71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c91f8d98-14ce-40eb-b193-7033d7da7c71" (UID: "c91f8d98-14ce-40eb-b193-7033d7da7c71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:10:22.752719 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.752695    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c91f8d98-14ce-40eb-b193-7033d7da7c71" (UID: "c91f8d98-14ce-40eb-b193-7033d7da7c71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:10:22.752719 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.752710    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-token" (OuterVolumeSpecName: "istio-token") pod "c91f8d98-14ce-40eb-b193-7033d7da7c71" (UID: "c91f8d98-14ce-40eb-b193-7033d7da7c71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:10:22.752976 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.752962    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c91f8d98-14ce-40eb-b193-7033d7da7c71" (UID: "c91f8d98-14ce-40eb-b193-7033d7da7c71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 11:10:22.753060 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.753038    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-kube-api-access-9fllp" (OuterVolumeSpecName: "kube-api-access-9fllp") pod "c91f8d98-14ce-40eb-b193-7033d7da7c71" (UID: "c91f8d98-14ce-40eb-b193-7033d7da7c71"). InnerVolumeSpecName "kube-api-access-9fllp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:10:22.852300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.852206    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c91f8d98-14ce-40eb-b193-7033d7da7c71-istiod-ca-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:22.852300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.852239    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:22.852300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.852251    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-podinfo\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:22.852300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.852264    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fllp\" (UniqueName: \"kubernetes.io/projected/c91f8d98-14ce-40eb-b193-7033d7da7c71-kube-api-access-9fllp\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:22.852300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.852277    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-workload-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:22.852300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:22.852288    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c91f8d98-14ce-40eb-b193-7033d7da7c71-istio-envoy\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:10:23.288068 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:23.288030    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:23.535053 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:23.535012    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9" event={"ID":"c91f8d98-14ce-40eb-b193-7033d7da7c71","Type":"ContainerDied","Data":"485bfa065e922a48e299919b0c1359bb31cc49be405e14eb81f5ade11f8230e5"}
Sep 14 11:10:23.535527 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:23.535083    2576 scope.go:117] "RemoveContainer" containerID="61ec361f91b0d761b05bb0e7068d3dd0ab8a9ce0c87a38e3260a9277017582e9"
Sep 14 11:10:23.535527 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:23.535027    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"
Sep 14 11:10:23.564756 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:23.564722    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"]
Sep 14 11:10:23.571686 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:23.571640    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9"]
Sep 14 11:10:24.516894 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:24.516854    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:24.561419 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:24.561387    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" path="/var/lib/kubelet/pods/c91f8d98-14ce-40eb-b193-7033d7da7c71/volumes"
Sep 14 11:10:24.681274 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:24.681237    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:25.193378 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.193336    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:25.482985 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.482954    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:25.548859 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.548828    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerID="ffaf3d8f5ec8e7889f327eba59442be29aac695db0c6e1836d428d8e49c0d41d" exitCode=0
Sep 14 11:10:25.549041 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.548905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" event={"ID":"b3f11681-9cd2-4524-bc8e-cc2080496e90","Type":"ContainerDied","Data":"ffaf3d8f5ec8e7889f327eba59442be29aac695db0c6e1836d428d8e49c0d41d"}
Sep 14 11:10:25.549409 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.549392    2576 scope.go:117] "RemoveContainer" containerID="ffaf3d8f5ec8e7889f327eba59442be29aac695db0c6e1836d428d8e49c0d41d"
Sep 14 11:10:25.550573 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.550537    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:10:25.550683 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.550604    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:10:25.550683 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.550634    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:10:25.710685 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.710583    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:25.964740 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.964705    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"]
Sep 14 11:10:25.965135 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.965119    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy"
Sep 14 11:10:25.965135 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.965134    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy"
Sep 14 11:10:25.965305 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.965147    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy"
Sep 14 11:10:25.965305 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.965152    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy"
Sep 14 11:10:25.965305 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.965159    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95f4c5e0-3071-4c10-8029-6a49fd572ab9" containerName="main"
Sep 14 11:10:25.965305 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.965164    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="95f4c5e0-3071-4c10-8029-6a49fd572ab9" containerName="main"
Sep 14 11:10:25.965305 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.965233    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="95f4c5e0-3071-4c10-8029-6a49fd572ab9" containerName="main"
Sep 14 11:10:25.965305 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.965243    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy"
Sep 14 11:10:25.965305 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.965251    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c91f8d98-14ce-40eb-b193-7033d7da7c71" containerName="istio-proxy"
Sep 14 11:10:25.967924 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.967903    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:10:25.973220 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.973195    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-22b014\""
Sep 14 11:10:25.973354 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.973328    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-22b014-dockercfg-z2jw2\""
Sep 14 11:10:25.991953 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:25.991921    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"]
Sep 14 11:10:26.082559 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.082528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c287e963-5491-40b3-b564-b1f7b81233d5-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t\" (UID: \"c287e963-5491-40b3-b564-b1f7b81233d5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:10:26.082735 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.082589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz72s\" (UniqueName: \"kubernetes.io/projected/c287e963-5491-40b3-b564-b1f7b81233d5-kube-api-access-nz72s\") pod \"payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t\" (UID: \"c287e963-5491-40b3-b564-b1f7b81233d5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:10:26.183951 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.183916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c287e963-5491-40b3-b564-b1f7b81233d5-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t\" (UID: \"c287e963-5491-40b3-b564-b1f7b81233d5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:10:26.184122 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.183993    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz72s\" (UniqueName: \"kubernetes.io/projected/c287e963-5491-40b3-b564-b1f7b81233d5-kube-api-access-nz72s\") pod \"payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t\" (UID: \"c287e963-5491-40b3-b564-b1f7b81233d5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:10:26.184704 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.184685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c287e963-5491-40b3-b564-b1f7b81233d5-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t\" (UID: \"c287e963-5491-40b3-b564-b1f7b81233d5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:10:26.193504 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.193479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz72s\" (UniqueName: \"kubernetes.io/projected/c287e963-5491-40b3-b564-b1f7b81233d5-kube-api-access-nz72s\") pod \"payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t\" (UID: \"c287e963-5491-40b3-b564-b1f7b81233d5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:10:26.279639 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.279605    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:10:26.303505 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.303473    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:26.374212 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.374176    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:10:26.561924 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.561843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" event={"ID":"b3f11681-9cd2-4524-bc8e-cc2080496e90","Type":"ContainerStarted","Data":"84f9dbcf86c155e5413ab01e4277079465426b0262e7b1a4d1a3eafbf980738a"}
Sep 14 11:10:26.565898 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.565880    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"]
Sep 14 11:10:26.568214 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:10:26.568191    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc287e963_5491_40b3_b564_b1f7b81233d5.slice/crio-35d8c2fa8f5fc6a8d37869bf81aa6e4376f78abed922974179419dabc99dd037 WatchSource:0}: Error finding container 35d8c2fa8f5fc6a8d37869bf81aa6e4376f78abed922974179419dabc99dd037: Status 404 returned error can't find the container with id 35d8c2fa8f5fc6a8d37869bf81aa6e4376f78abed922974179419dabc99dd037
Sep 14 11:10:26.940284 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.940197    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:10:26.941142 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.941116    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 14 11:10:26.941251 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:26.941169    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 14 11:10:27.568153 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:27.568120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t" event={"ID":"c287e963-5491-40b3-b564-b1f7b81233d5","Type":"ContainerStarted","Data":"97b45fb17b46e6601a5024c015eee36bd5a5cd3a7c8adb345e04871df94c7a01"}
Sep 14 11:10:27.568328 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:27.568172    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t" event={"ID":"c287e963-5491-40b3-b564-b1f7b81233d5","Type":"ContainerStarted","Data":"35d8c2fa8f5fc6a8d37869bf81aa6e4376f78abed922974179419dabc99dd037"}
Sep 14 11:10:27.568328 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:27.568203    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:10:27.666910 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:27.666875    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:27.940447 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:27.940353    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 14 11:10:27.940447 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:27.940404    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 14 11:10:28.885520 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:28.885480    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:28.940507 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:28.940467    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 14 11:10:28.940919 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:28.940530    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 14 11:10:29.940612 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:29.940571    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 14 11:10:29.941102 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:29.940640    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 14 11:10:30.051089 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:30.051045    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:30.202185 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:30.202097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:30.393527 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:30.393485    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:30.529080 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:30.529048    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:30.940675 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:30.940571    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 14 11:10:30.940675 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:30.940635    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 14 11:10:31.393076 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:31.393017    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:31.637380 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:31.637351    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:31.940405 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:31.940365    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 14 11:10:31.940583 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:31.940436    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 14 11:10:32.549752 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:32.549719    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:32.736703 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:32.736641    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:32.945051 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:32.944969    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:10:32.945267 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:32.945246    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:10:32.945978 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:32.945957    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:10:32.980233 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:32.980176    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t" podStartSLOduration=7.98015877 podStartE2EDuration="7.98015877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:10:27.602674063 +0000 UTC m=+1287.583309567" watchObservedRunningTime="2026-09-14 11:10:32.98015877 +0000 UTC m=+1292.960794275"
Sep 14 11:10:33.501670 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:33.501617    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:35.150269 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:35.150231    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:35.328044 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:35.327999    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:36.165901 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:36.165862    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:37.027295 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:37.027256    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:37.454867 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:37.454780    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:37.553873 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:37.553837    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:37.813152 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:37.813109    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:37.992644 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:37.992614    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:38.315866 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:38.315832    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:38.576830 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:38.576739    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:10:38.793454 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:38.793417    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:38.888438 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:38.888345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:39.097304 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:39.097266    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:39.867737 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:39.867706    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:40.393299 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:40.393259    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:41.686532 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:41.686493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:42.233449 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:42.233413    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:42.321378 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:42.321345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:42.730219 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:42.730187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:43.609002 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:43.608955    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:44.499566 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:44.499530    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:45.399409 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:45.399377    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:46.229181 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:46.229156    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:46.354048 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:46.354019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:46.667257 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:46.667156    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:46.796596 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:46.796566    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:46.898068 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:46.898036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:47.295577 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:47.295546    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:48.069254 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:48.069219    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:48.678662 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:48.678627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:48.981675 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:48.981633    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:49.286830 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:49.286736    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:51.673518 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:51.673454    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:52.343518 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:52.343486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:52.474098 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:52.474051    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:53.357814 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:53.357782    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:53.460984 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:53.460943    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:53.627033 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:53.626938    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:54.621808 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:54.621774    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:55.407881 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:55.407843    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:56.188271 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:56.188238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:57.180371 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:57.180333    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:57.274389 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:57.274351    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:57.731499 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:57.731457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:57.835714 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:57.835672    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:58.027006 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.026926    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"]
Sep 14 11:10:58.030765 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.030749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:10:58.032993 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.032978    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e6e0b4a3\""
Sep 14 11:10:58.033117 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.033098    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e6e0b4a3-dockercfg-zd8pp\""
Sep 14 11:10:58.041630 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.041596    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"]
Sep 14 11:10:58.100733 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.100697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzmgf\" (UniqueName: \"kubernetes.io/projected/3fbc268f-d16b-47d4-9aa9-100462abdcfe-kube-api-access-gzmgf\") pod \"payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829\" (UID: \"3fbc268f-d16b-47d4-9aa9-100462abdcfe\") " pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:10:58.100921 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.100743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fbc268f-d16b-47d4-9aa9-100462abdcfe-plugins-config-volume\") pod \"payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829\" (UID: \"3fbc268f-d16b-47d4-9aa9-100462abdcfe\") " pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:10:58.202208 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.202173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzmgf\" (UniqueName: \"kubernetes.io/projected/3fbc268f-d16b-47d4-9aa9-100462abdcfe-kube-api-access-gzmgf\") pod \"payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829\" (UID: \"3fbc268f-d16b-47d4-9aa9-100462abdcfe\") " pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:10:58.202387 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.202215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fbc268f-d16b-47d4-9aa9-100462abdcfe-plugins-config-volume\") pod \"payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829\" (UID: \"3fbc268f-d16b-47d4-9aa9-100462abdcfe\") " pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:10:58.202931 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.202915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fbc268f-d16b-47d4-9aa9-100462abdcfe-plugins-config-volume\") pod \"payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829\" (UID: \"3fbc268f-d16b-47d4-9aa9-100462abdcfe\") " pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:10:58.211546 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.211522    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzmgf\" (UniqueName: \"kubernetes.io/projected/3fbc268f-d16b-47d4-9aa9-100462abdcfe-kube-api-access-gzmgf\") pod \"payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829\" (UID: \"3fbc268f-d16b-47d4-9aa9-100462abdcfe\") " pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:10:58.226275 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.226253    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:10:58.342751 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.342640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:10:58.620286 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.620257    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"]
Sep 14 11:10:58.622549 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:10:58.622513    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fbc268f_d16b_47d4_9aa9_100462abdcfe.slice/crio-f37c1fa6c702b10cce272fac29cfad54e1fd6cea9d2b3b193415d385c319f0e1 WatchSource:0}: Error finding container f37c1fa6c702b10cce272fac29cfad54e1fd6cea9d2b3b193415d385c319f0e1: Status 404 returned error can't find the container with id f37c1fa6c702b10cce272fac29cfad54e1fd6cea9d2b3b193415d385c319f0e1
Sep 14 11:10:58.750250 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.750215    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829" event={"ID":"3fbc268f-d16b-47d4-9aa9-100462abdcfe","Type":"ContainerStarted","Data":"adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44"}
Sep 14 11:10:58.750250 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.750267    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829" event={"ID":"3fbc268f-d16b-47d4-9aa9-100462abdcfe","Type":"ContainerStarted","Data":"f37c1fa6c702b10cce272fac29cfad54e1fd6cea9d2b3b193415d385c319f0e1"}
Sep 14 11:10:58.750524 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.750294    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:10:58.774042 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:58.773980    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829" podStartSLOduration=0.773963583 podStartE2EDuration="773.963583ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:10:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:10:58.77035514 +0000 UTC m=+1318.750990647" watchObservedRunningTime="2026-09-14 11:10:58.773963583 +0000 UTC m=+1318.754599087"
Sep 14 11:10:59.207246 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:10:59.207198    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:00.061114 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:00.061083    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:00.797353 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:00.797314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:01.219471 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:01.219438    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:01.623525 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:01.623481    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:02.053403 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.053343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:02.363342 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.363236    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:02.507796 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.507767    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:02.654746 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.654671    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"]
Sep 14 11:11:02.659670 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.659622    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.669912 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.669884    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-0fb86d-openshift-default-dockercfg-6zj6b\""
Sep 14 11:11:02.689714 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.689680    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"]
Sep 14 11:11:02.727589 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.727555    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:02.747352 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.747314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-envoy\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.747529 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.747368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-certs\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.747529 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.747436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-token\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.747529 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.747512    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-data\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.747669 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.747558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/819b83de-1486-41f9-a3bd-3947fe445ea6-istiod-ca-cert\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.747669 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.747599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-socket\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.747753 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.747740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z7t8\" (UniqueName: \"kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-kube-api-access-5z7t8\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.747794 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.747766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-podinfo\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.747794 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.747786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-credential-socket\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.848502 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.848465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-token\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.848744 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.848525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-data\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.848744 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.848550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/819b83de-1486-41f9-a3bd-3947fe445ea6-istiod-ca-cert\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.848744 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.848593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-socket\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.848744 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.848684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z7t8\" (UniqueName: \"kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-kube-api-access-5z7t8\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.848744 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.848709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-podinfo\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.848744 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.848733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-credential-socket\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.849157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.848787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-envoy\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.849157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.848820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-certs\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.849157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.848975    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-data\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.849157 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.849121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-certs\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.849432 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.849394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-credential-socket\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.850180 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.850149    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/819b83de-1486-41f9-a3bd-3947fe445ea6-istiod-ca-cert\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.850331 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.850308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-socket\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.851840 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.851814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-envoy\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.852868 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.852843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-podinfo\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.862621 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.862390    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z7t8\" (UniqueName: \"kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-kube-api-access-5z7t8\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.862926 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.862899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-token\") pod \"e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") " pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:02.863143 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.863060    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:02.970620 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:02.970520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:03.271792 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:03.271766    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"]
Sep 14 11:11:03.275015 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:11:03.274986    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819b83de_1486_41f9_a3bd_3947fe445ea6.slice/crio-57bc37de07484e760bdf56e2aad2e4aff420688cb673d5cdaf7cb5b138a4b0cf WatchSource:0}: Error finding container 57bc37de07484e760bdf56e2aad2e4aff420688cb673d5cdaf7cb5b138a4b0cf: Status 404 returned error can't find the container with id 57bc37de07484e760bdf56e2aad2e4aff420688cb673d5cdaf7cb5b138a4b0cf
Sep 14 11:11:03.277635 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:03.277584    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:11:03.277735 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:03.277720    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:11:03.277785 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:03.277767    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:11:03.778539 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:03.778504    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" event={"ID":"819b83de-1486-41f9-a3bd-3947fe445ea6","Type":"ContainerStarted","Data":"d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad"}
Sep 14 11:11:03.779016 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:03.778564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" event={"ID":"819b83de-1486-41f9-a3bd-3947fe445ea6","Type":"ContainerStarted","Data":"57bc37de07484e760bdf56e2aad2e4aff420688cb673d5cdaf7cb5b138a4b0cf"}
Sep 14 11:11:03.829609 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:03.829542    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" podStartSLOduration=1.829517305 podStartE2EDuration="1.829517305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:11:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:11:03.826841986 +0000 UTC m=+1323.807477492" watchObservedRunningTime="2026-09-14 11:11:03.829517305 +0000 UTC m=+1323.810152812"
Sep 14 11:11:03.971376 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:03.971339    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:04.005405 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:04.005358    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:04.977439 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:04.977406    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:05.245360 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:05.245330    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:05.789323 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:05.789286    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:05.790400 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:05.790377    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:05.868790 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:05.868753    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:05.980994 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:05.980956    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:06.395672 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:06.395612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:08.129450 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:08.129420    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:09.037355 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:09.037322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:09.108728 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:09.108699    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:09.758063 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:09.758026    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:11:09.767910 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:09.767884    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:10.667941 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:10.667904    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:11.587916 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:11.587879    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:11.688144 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:11.688106    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:11.870009 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:11.869890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:12.206263 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:12.206188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:12.304858 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:12.304827    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:12.757031 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:12.757005    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:13.690384 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:13.690354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:14.495574 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:14.495527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:15.459153 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:15.459119    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:16.641776 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:16.641747    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:18.248609 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:18.248574    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:18.604261 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:18.604136    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:19.596133 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:19.596097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:20.671980 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:20.671940    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:21.731819 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:21.731785    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:22.983825 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:22.983776    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:23.599205 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:23.599172    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:24.564093 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:24.564050    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:25.427478 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:25.427432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:25.648227 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:25.648198    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:26.297913 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:26.297875    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:27.072370 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:27.072339    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:27.813995 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:27.813963    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:32.891856 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:32.891815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:38.781717 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:38.781674    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:11:47.007939 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:47.007905    2576 generic.go:356] "Generic (PLEG): container finished" podID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerID="d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad" exitCode=0
Sep 14 11:11:47.008386 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:47.007977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" event={"ID":"819b83de-1486-41f9-a3bd-3947fe445ea6","Type":"ContainerDied","Data":"d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad"}
Sep 14 11:11:47.008386 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:47.008359    2576 scope.go:117] "RemoveContainer" containerID="d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad"
Sep 14 11:11:47.009533 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:47.009501    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:11:47.009642 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:47.009584    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:11:47.009735 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:47.009642    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:11:48.015081 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:48.015040    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" event={"ID":"819b83de-1486-41f9-a3bd-3947fe445ea6","Type":"ContainerStarted","Data":"2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19"}
Sep 14 11:11:48.972523 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:48.972481    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:48.972746 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:48.972527    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 14 11:11:48.972746 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:48.972603    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 14 11:11:49.971188 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:49.971143    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 14 11:11:49.971712 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:49.971214    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 14 11:11:50.789705 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:50.789663    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:50.971465 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:50.971418    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 14 11:11:50.971977 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:50.971490    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 14 11:11:51.971247 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:51.971204    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 14 11:11:51.971549 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:51.971522    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 14 11:11:52.970965 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:52.970926    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 14 11:11:52.971150 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:52.970989    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 14 11:11:53.975441 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:53.975411    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:53.976402 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:53.976382    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:11:57.389039 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:11:57.388990    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:12:14.462759 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:12:14.462723    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:12:22.916343 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:12:22.916306    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:12:59.180121 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:12:59.180085    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:12:59.972513 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:12:59.972475    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:00.759594 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:00.759558    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:01.506521 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:01.506479    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:02.477868 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:02.477835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:03.252088 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:03.252054    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:04.174992 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:04.174961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:05.026768 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:05.026719    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:05.922686 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:05.922640    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:14.453351 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.453308    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:14.490495 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.490459    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"]
Sep 14 11:13:14.490831 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.490797    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829" podUID="3fbc268f-d16b-47d4-9aa9-100462abdcfe" containerName="payload-processing" containerID="cri-o://adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44" gracePeriod=30
Sep 14 11:13:14.554746 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.554712    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:14.658457 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.658422    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:14.759920 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.759891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:14.773730 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.773703    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:13:14.871486 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.871452    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fbc268f-d16b-47d4-9aa9-100462abdcfe-plugins-config-volume\") pod \"3fbc268f-d16b-47d4-9aa9-100462abdcfe\" (UID: \"3fbc268f-d16b-47d4-9aa9-100462abdcfe\") "
Sep 14 11:13:14.871711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.871518    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzmgf\" (UniqueName: \"kubernetes.io/projected/3fbc268f-d16b-47d4-9aa9-100462abdcfe-kube-api-access-gzmgf\") pod \"3fbc268f-d16b-47d4-9aa9-100462abdcfe\" (UID: \"3fbc268f-d16b-47d4-9aa9-100462abdcfe\") "
Sep 14 11:13:14.871905 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.871874    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fbc268f-d16b-47d4-9aa9-100462abdcfe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3fbc268f-d16b-47d4-9aa9-100462abdcfe" (UID: "3fbc268f-d16b-47d4-9aa9-100462abdcfe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:13:14.874088 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.874056    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fbc268f-d16b-47d4-9aa9-100462abdcfe-kube-api-access-gzmgf" (OuterVolumeSpecName: "kube-api-access-gzmgf") pod "3fbc268f-d16b-47d4-9aa9-100462abdcfe" (UID: "3fbc268f-d16b-47d4-9aa9-100462abdcfe"). InnerVolumeSpecName "kube-api-access-gzmgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:13:14.972820 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.972785    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzmgf\" (UniqueName: \"kubernetes.io/projected/3fbc268f-d16b-47d4-9aa9-100462abdcfe-kube-api-access-gzmgf\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:13:14.972820 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:14.972819    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fbc268f-d16b-47d4-9aa9-100462abdcfe-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:13:15.375991 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:15.375941    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:15.464167 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:15.464135    2576 generic.go:356] "Generic (PLEG): container finished" podID="3fbc268f-d16b-47d4-9aa9-100462abdcfe" containerID="adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44" exitCode=0
Sep 14 11:13:15.464577 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:15.464181    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"
Sep 14 11:13:15.464577 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:15.464231    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829" event={"ID":"3fbc268f-d16b-47d4-9aa9-100462abdcfe","Type":"ContainerDied","Data":"adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44"}
Sep 14 11:13:15.464577 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:15.464286    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829" event={"ID":"3fbc268f-d16b-47d4-9aa9-100462abdcfe","Type":"ContainerDied","Data":"f37c1fa6c702b10cce272fac29cfad54e1fd6cea9d2b3b193415d385c319f0e1"}
Sep 14 11:13:15.464577 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:15.464309    2576 scope.go:117] "RemoveContainer" containerID="adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44"
Sep 14 11:13:15.474739 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:15.474691    2576 scope.go:117] "RemoveContainer" containerID="adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44"
Sep 14 11:13:15.475018 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:13:15.474998    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44\": container with ID starting with adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44 not found: ID does not exist" containerID="adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44"
Sep 14 11:13:15.475084 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:15.475034    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44"} err="failed to get container status \"adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44\": rpc error: code = NotFound desc = could not find container \"adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44\": container with ID starting with adec7329ef9f71700c7772ed6139c21e198fb656374a5acd4c534919888fee44 not found: ID does not exist"
Sep 14 11:13:15.524296 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:15.524263    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"]
Sep 14 11:13:15.541827 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:15.541796    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829"]
Sep 14 11:13:16.507278 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:16.507241    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:16.560459 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:16.560427    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fbc268f-d16b-47d4-9aa9-100462abdcfe" path="/var/lib/kubelet/pods/3fbc268f-d16b-47d4-9aa9-100462abdcfe/volumes"
Sep 14 11:13:17.436861 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:17.436829    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:17.885407 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:17.885375    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:18.234801 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:18.234763    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:19.277542 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:19.277508    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:20.023625 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:20.023588    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:20.898694 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:20.898636    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:22.925408 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:22.925372    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:23.635974 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.635932    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"]
Sep 14 11:13:23.636413 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.636393    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fbc268f-d16b-47d4-9aa9-100462abdcfe" containerName="payload-processing"
Sep 14 11:13:23.636499 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.636415    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fbc268f-d16b-47d4-9aa9-100462abdcfe" containerName="payload-processing"
Sep 14 11:13:23.636611 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.636547    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fbc268f-d16b-47d4-9aa9-100462abdcfe" containerName="payload-processing"
Sep 14 11:13:23.639641 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.639619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.643979 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.643957    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"auth-test-model-0fb86d-kserve-self-signed-certs\""
Sep 14 11:13:23.644144 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.644128    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"openshift-service-ca.crt\""
Sep 14 11:13:23.644871 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.644852    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"kube-root-ca.crt\""
Sep 14 11:13:23.644984 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.644958    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"default-dockercfg-dgnjk\""
Sep 14 11:13:23.650310 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.650284    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"]
Sep 14 11:13:23.725024 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.724985    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:23.754271 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.754239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-model-cache\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.754438 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.754276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tmp-dir\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.754438 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.754304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkc8z\" (UniqueName: \"kubernetes.io/projected/d8d99194-1bbb-42a7-983a-fa1f02e836f6-kube-api-access-dkc8z\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.754561 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.754465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-dshm\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.754561 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.754519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-home\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.754643 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.754571    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tls-certs\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.855603 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.855563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-dshm\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.855822 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.855615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-home\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.855822 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.855669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tls-certs\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.855822 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.855717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-model-cache\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.855822 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.855749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tmp-dir\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.855822 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.855784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkc8z\" (UniqueName: \"kubernetes.io/projected/d8d99194-1bbb-42a7-983a-fa1f02e836f6-kube-api-access-dkc8z\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.856088 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.856069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-home\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.856142 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.856116    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-model-cache\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.856142 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.856136    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tmp-dir\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.857868 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.857847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-dshm\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.858239 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.858219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tls-certs\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.864759 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.864742    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkc8z\" (UniqueName: \"kubernetes.io/projected/d8d99194-1bbb-42a7-983a-fa1f02e836f6-kube-api-access-dkc8z\") pod \"auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:23.950605 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:23.950517    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:24.225392 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:24.225369    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"]
Sep 14 11:13:24.227499 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:13:24.227472    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8d99194_1bbb_42a7_983a_fa1f02e836f6.slice/crio-2032bd63362ab034cb7d7c5e21999f12d18fdb4b0c06d7ceab64b316ed0b733f WatchSource:0}: Error finding container 2032bd63362ab034cb7d7c5e21999f12d18fdb4b0c06d7ceab64b316ed0b733f: Status 404 returned error can't find the container with id 2032bd63362ab034cb7d7c5e21999f12d18fdb4b0c06d7ceab64b316ed0b733f
Sep 14 11:13:24.515852 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:24.515814    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n" event={"ID":"d8d99194-1bbb-42a7-983a-fa1f02e836f6","Type":"ContainerStarted","Data":"cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225"}
Sep 14 11:13:24.515852 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:24.515854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n" event={"ID":"d8d99194-1bbb-42a7-983a-fa1f02e836f6","Type":"ContainerStarted","Data":"2032bd63362ab034cb7d7c5e21999f12d18fdb4b0c06d7ceab64b316ed0b733f"}
Sep 14 11:13:24.552264 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:24.552214    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n" podStartSLOduration=1.552198677 podStartE2EDuration="1.552198677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:13:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:13:24.550187931 +0000 UTC m=+1464.530823446" watchObservedRunningTime="2026-09-14 11:13:24.552198677 +0000 UTC m=+1464.532834181"
Sep 14 11:13:33.951531 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:33.951493    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:33.951995 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:33.951545    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:33.964202 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:33.964178    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:34.577032 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:34.577001    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:13:45.925572 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:45.925538    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:13:59.283117 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:13:59.283087    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:01.552332 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:01.552296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:05.794446 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:05.794401    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:15.553375 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:15.553338    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:30.151096 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:30.151023    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:38.356257 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:38.356222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:40.004256 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:40.004218    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:40.147350 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:40.147319    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:40.873898 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:40.873851    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:41.032890 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:41.032852    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:42.345208 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:42.345171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:44.290251 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:44.290219    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:49.929571 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:49.929534    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:50.103736 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:50.103700    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:50.671603 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:50.671564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:57.364448 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:57.364413    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:57.517569 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:57.517539    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:14:57.656225 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:14:57.656141    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:00.234332 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.234297    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7"]
Sep 14 11:15:00.239829 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.239643    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7"
Sep 14 11:15:00.246413 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.246381    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pv9g8\""
Sep 14 11:15:00.252942 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.252921    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7"
Sep 14 11:15:00.258285 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.258262    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw"]
Sep 14 11:15:00.262666 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.262626    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw"
Sep 14 11:15:00.265491 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.265466    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7"]
Sep 14 11:15:00.282366 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.282306    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw"]
Sep 14 11:15:00.297889 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.297865    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw"
Sep 14 11:15:00.562809 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.562782    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7"]
Sep 14 11:15:00.563260 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:15:00.563236    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2176b516_9e24_4492_8503_5f60a8f4d5e0.slice/crio-401afbea46dbbeb4632fffe8685cde16492051595e38aaf1f5cb9fc96770aae4 WatchSource:0}: Error finding container 401afbea46dbbeb4632fffe8685cde16492051595e38aaf1f5cb9fc96770aae4: Status 404 returned error can't find the container with id 401afbea46dbbeb4632fffe8685cde16492051595e38aaf1f5cb9fc96770aae4
Sep 14 11:15:00.565243 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.565226    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 11:15:00.605446 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:00.605409    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw"]
Sep 14 11:15:00.607558 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:15:00.607533    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4677ce7b_dfab_4f42_8e9e_71432d6579da.slice/crio-671c0dd9ece002ea8cacb271f740f8674b822df5a1bd9ad100e3fd22c3d9f292 WatchSource:0}: Error finding container 671c0dd9ece002ea8cacb271f740f8674b822df5a1bd9ad100e3fd22c3d9f292: Status 404 returned error can't find the container with id 671c0dd9ece002ea8cacb271f740f8674b822df5a1bd9ad100e3fd22c3d9f292
Sep 14 11:15:01.002574 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:01.002541    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw" event={"ID":"4677ce7b-dfab-4f42-8e9e-71432d6579da","Type":"ContainerStarted","Data":"671c0dd9ece002ea8cacb271f740f8674b822df5a1bd9ad100e3fd22c3d9f292"}
Sep 14 11:15:01.003767 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:01.003746    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7" event={"ID":"2176b516-9e24-4492-8503-5f60a8f4d5e0","Type":"ContainerStarted","Data":"401afbea46dbbeb4632fffe8685cde16492051595e38aaf1f5cb9fc96770aae4"}
Sep 14 11:15:04.023051 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:04.023011    2576 generic.go:356] "Generic (PLEG): container finished" podID="2176b516-9e24-4492-8503-5f60a8f4d5e0" containerID="8b8e29c97c39a840a1a914af456771fc02a460a8e7c4459e5d2309fe6611a87e" exitCode=0
Sep 14 11:15:04.023493 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:04.023096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7" event={"ID":"2176b516-9e24-4492-8503-5f60a8f4d5e0","Type":"ContainerDied","Data":"8b8e29c97c39a840a1a914af456771fc02a460a8e7c4459e5d2309fe6611a87e"}
Sep 14 11:15:04.024609 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:04.024586    2576 generic.go:356] "Generic (PLEG): container finished" podID="4677ce7b-dfab-4f42-8e9e-71432d6579da" containerID="aec64b0a55b582c9679b85a529a96a763fb578cf62640dd5c24459e7ea3f9d95" exitCode=0
Sep 14 11:15:04.024724 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:04.024616    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw" event={"ID":"4677ce7b-dfab-4f42-8e9e-71432d6579da","Type":"ContainerDied","Data":"aec64b0a55b582c9679b85a529a96a763fb578cf62640dd5c24459e7ea3f9d95"}
Sep 14 11:15:05.163897 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:05.163859    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7"
Sep 14 11:15:05.204575 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:05.204545    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw"
Sep 14 11:15:06.036757 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:06.036726    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7"
Sep 14 11:15:06.036757 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:06.036743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7" event={"ID":"2176b516-9e24-4492-8503-5f60a8f4d5e0","Type":"ContainerDied","Data":"401afbea46dbbeb4632fffe8685cde16492051595e38aaf1f5cb9fc96770aae4"}
Sep 14 11:15:06.037019 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:06.036789    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="401afbea46dbbeb4632fffe8685cde16492051595e38aaf1f5cb9fc96770aae4"
Sep 14 11:15:06.037974 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:06.037955    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw"
Sep 14 11:15:06.037974 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:06.037963    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw" event={"ID":"4677ce7b-dfab-4f42-8e9e-71432d6579da","Type":"ContainerDied","Data":"671c0dd9ece002ea8cacb271f740f8674b822df5a1bd9ad100e3fd22c3d9f292"}
Sep 14 11:15:06.038164 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:06.038000    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="671c0dd9ece002ea8cacb271f740f8674b822df5a1bd9ad100e3fd22c3d9f292"
Sep 14 11:15:08.101143 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:08.101109    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:08.325484 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:08.325452    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:14.261596 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:14.261559    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:14.372278 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:14.372242    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:17.025591 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:17.025554    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:17.209319 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:17.209288    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:17.323675 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:17.323571    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:18.999805 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:18.999775    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:20.289555 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:20.289517    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:21.155291 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:21.155263    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:22.108446 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:22.108381    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:23.005379 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:23.005330    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:23.929829 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:23.929797    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:24.085449 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:24.085409    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"]
Sep 14 11:15:24.174508 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:24.174472    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:24.921418 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:24.921386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:26.093051 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:26.093018    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:28.828431 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:28.828396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:29.422188 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:29.422155    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:33.287914 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:33.287868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:33.580509 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:33.580428    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:34.622195 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:34.622145    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:35.584133 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:35.584103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:36.270469 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.270429    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:36.373266 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.373232    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:36.479589 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.479554    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:36.626263 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.626180    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:36.930914 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.930843    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"]
Sep 14 11:15:36.931243 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.931231    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2176b516-9e24-4492-8503-5f60a8f4d5e0" containerName="cleanup"
Sep 14 11:15:36.931296 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.931245    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2176b516-9e24-4492-8503-5f60a8f4d5e0" containerName="cleanup"
Sep 14 11:15:36.931296 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.931266    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4677ce7b-dfab-4f42-8e9e-71432d6579da" containerName="cleanup"
Sep 14 11:15:36.931296 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.931272    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4677ce7b-dfab-4f42-8e9e-71432d6579da" containerName="cleanup"
Sep 14 11:15:36.931400 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.931332    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4677ce7b-dfab-4f42-8e9e-71432d6579da" containerName="cleanup"
Sep 14 11:15:36.931400 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.931344    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2176b516-9e24-4492-8503-5f60a8f4d5e0" containerName="cleanup"
Sep 14 11:15:36.939070 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.939047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:36.941478 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.941453    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-29e74e-openshift-default-dockercfg-h89zv\""
Sep 14 11:15:36.958141 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.958111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"]
Sep 14 11:15:36.985506 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:36.985460    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:37.054301 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.054271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-credential-socket\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.054487 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.054311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-token\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.054487 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.054337    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-podinfo\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.054487 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.054436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-data\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.054487 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.054460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-certs\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.054699 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.054506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb8hh\" (UniqueName: \"kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-kube-api-access-mb8hh\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.054699 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.054532    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-envoy\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.054699 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.054552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-socket\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.054699 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.054582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5900dd06-ce41-4947-957f-c621b4b2f82d-istiod-ca-cert\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155406 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-credential-socket\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155619 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-token\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155619 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-podinfo\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155619 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-data\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155619 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-certs\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155619 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb8hh\" (UniqueName: \"kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-kube-api-access-mb8hh\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155619 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-envoy\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155994 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-socket\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155994 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5900dd06-ce41-4947-957f-c621b4b2f82d-istiod-ca-cert\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155994 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-data\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155994 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155940    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-credential-socket\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.155994 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.155973    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-certs\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.156235 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.156129    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-socket\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.156457 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.156435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5900dd06-ce41-4947-957f-c621b4b2f82d-istiod-ca-cert\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.157871 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.157843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-envoy\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.158197 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.158170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-podinfo\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.167413 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.167355    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-token\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.172281 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.172251    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:37.172724 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.172399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb8hh\" (UniqueName: \"kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-kube-api-access-mb8hh\") pod \"e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") " pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.248968 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.248933    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:37.544566 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.544533    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"]
Sep 14 11:15:37.546306 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:15:37.546285    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5900dd06_ce41_4947_957f_c621b4b2f82d.slice/crio-e8ff365efef98aeb1f0e43ea19c4f628efdd8b99471d5ed6b0ab75300385eb5d WatchSource:0}: Error finding container e8ff365efef98aeb1f0e43ea19c4f628efdd8b99471d5ed6b0ab75300385eb5d: Status 404 returned error can't find the container with id e8ff365efef98aeb1f0e43ea19c4f628efdd8b99471d5ed6b0ab75300385eb5d
Sep 14 11:15:37.548529 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.548494    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:15:37.548600 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.548560    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:15:37.548600 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.548587    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:15:37.612413 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:37.612391    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:38.208828 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.208789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" event={"ID":"5900dd06-ce41-4947-957f-c621b4b2f82d","Type":"ContainerStarted","Data":"c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9"}
Sep 14 11:15:38.209027 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.208854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" event={"ID":"5900dd06-ce41-4947-957f-c621b4b2f82d","Type":"ContainerStarted","Data":"e8ff365efef98aeb1f0e43ea19c4f628efdd8b99471d5ed6b0ab75300385eb5d"}
Sep 14 11:15:38.238200 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.238147    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" podStartSLOduration=2.238132158 podStartE2EDuration="2.238132158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:15:38.236020128 +0000 UTC m=+1598.216655640" watchObservedRunningTime="2026-09-14 11:15:38.238132158 +0000 UTC m=+1598.218767662"
Sep 14 11:15:38.250142 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.250109    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:38.255536 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.255511    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:38.326023 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.325993    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"]
Sep 14 11:15:38.466754 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.466635    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:38.613418 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.613379    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"]
Sep 14 11:15:38.613844 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.613587    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw" podUID="4ba4c739-59b6-4336-852f-1f491aa23fb4" containerName="maas-api" containerID="cri-o://4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586" gracePeriod=30
Sep 14 11:15:38.677792 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.677742    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:38.894899 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.894876    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:15:38.982115 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.982034    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba4c739-59b6-4336-852f-1f491aa23fb4-openshift-service-ca\") pod \"4ba4c739-59b6-4336-852f-1f491aa23fb4\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") "
Sep 14 11:15:38.982115 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.982085    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-maas-api-tls\") pod \"4ba4c739-59b6-4336-852f-1f491aa23fb4\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") "
Sep 14 11:15:38.982115 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.982110    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg2dt\" (UniqueName: \"kubernetes.io/projected/4ba4c739-59b6-4336-852f-1f491aa23fb4-kube-api-access-xg2dt\") pod \"4ba4c739-59b6-4336-852f-1f491aa23fb4\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") "
Sep 14 11:15:38.982358 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.982255    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-metrics-certs\") pod \"4ba4c739-59b6-4336-852f-1f491aa23fb4\" (UID: \"4ba4c739-59b6-4336-852f-1f491aa23fb4\") "
Sep 14 11:15:38.982459 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.982434    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ba4c739-59b6-4336-852f-1f491aa23fb4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4ba4c739-59b6-4336-852f-1f491aa23fb4" (UID: "4ba4c739-59b6-4336-852f-1f491aa23fb4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:15:38.982598 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.982582    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba4c739-59b6-4336-852f-1f491aa23fb4-openshift-service-ca\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:38.984188 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.984164    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ba4c739-59b6-4336-852f-1f491aa23fb4-kube-api-access-xg2dt" (OuterVolumeSpecName: "kube-api-access-xg2dt") pod "4ba4c739-59b6-4336-852f-1f491aa23fb4" (UID: "4ba4c739-59b6-4336-852f-1f491aa23fb4"). InnerVolumeSpecName "kube-api-access-xg2dt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:15:38.984341 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.984321    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4ba4c739-59b6-4336-852f-1f491aa23fb4" (UID: "4ba4c739-59b6-4336-852f-1f491aa23fb4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:15:38.984386 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:38.984357    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4ba4c739-59b6-4336-852f-1f491aa23fb4" (UID: "4ba4c739-59b6-4336-852f-1f491aa23fb4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:15:39.062298 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.062254    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:39.083624 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.083595    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-metrics-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:39.083624 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.083618    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ba4c739-59b6-4336-852f-1f491aa23fb4-maas-api-tls\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:39.083624 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.083627    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg2dt\" (UniqueName: \"kubernetes.io/projected/4ba4c739-59b6-4336-852f-1f491aa23fb4-kube-api-access-xg2dt\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:39.105217 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.105183    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9" podUID="504589a5-819e-4cfa-af69-e65e959968c6" containerName="main" containerID="cri-o://0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20" gracePeriod=45
Sep 14 11:15:39.226728 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.223687    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ba4c739-59b6-4336-852f-1f491aa23fb4" containerID="4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586" exitCode=0
Sep 14 11:15:39.226728 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.224980    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"
Sep 14 11:15:39.230844 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.230727    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw" event={"ID":"4ba4c739-59b6-4336-852f-1f491aa23fb4","Type":"ContainerDied","Data":"4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586"}
Sep 14 11:15:39.231081 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.231029    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw" event={"ID":"4ba4c739-59b6-4336-852f-1f491aa23fb4","Type":"ContainerDied","Data":"ad2af5256a1b520be6f504e1cee5515d683cb49f4c0077aec0c56653ba3a335e"}
Sep 14 11:15:39.231244 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.231211    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:39.231405 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.231357    2576 scope.go:117] "RemoveContainer" containerID="4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586"
Sep 14 11:15:39.237340 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.237303    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:15:39.245874 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.245829    2576 scope.go:117] "RemoveContainer" containerID="4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586"
Sep 14 11:15:39.246234 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:15:39.246213    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586\": container with ID starting with 4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586 not found: ID does not exist" containerID="4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586"
Sep 14 11:15:39.246317 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.246245    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586"} err="failed to get container status \"4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586\": rpc error: code = NotFound desc = could not find container \"4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586\": container with ID starting with 4b6079be16fc146775069b45c5f18466c51cbd3268579216694e00e2f1660586 not found: ID does not exist"
Sep 14 11:15:39.315181 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.315106    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"]
Sep 14 11:15:39.319448 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.319415    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7984b1-77d95f68bb-cn5dw"]
Sep 14 11:15:39.380414 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.380388    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:15:39.407318 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.407258    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:39.488561 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.488483    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-dshm\") pod \"504589a5-819e-4cfa-af69-e65e959968c6\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") "
Sep 14 11:15:39.488561 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.488535    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-model-cache\") pod \"504589a5-819e-4cfa-af69-e65e959968c6\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") "
Sep 14 11:15:39.488778 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.488580    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-tmp-dir\") pod \"504589a5-819e-4cfa-af69-e65e959968c6\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") "
Sep 14 11:15:39.488778 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.488725    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/504589a5-819e-4cfa-af69-e65e959968c6-tls-certs\") pod \"504589a5-819e-4cfa-af69-e65e959968c6\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") "
Sep 14 11:15:39.488778 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.488757    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-home\") pod \"504589a5-819e-4cfa-af69-e65e959968c6\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") "
Sep 14 11:15:39.488929 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.488815    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sm5f\" (UniqueName: \"kubernetes.io/projected/504589a5-819e-4cfa-af69-e65e959968c6-kube-api-access-9sm5f\") pod \"504589a5-819e-4cfa-af69-e65e959968c6\" (UID: \"504589a5-819e-4cfa-af69-e65e959968c6\") "
Sep 14 11:15:39.489288 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.489049    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-home" (OuterVolumeSpecName: "home") pod "504589a5-819e-4cfa-af69-e65e959968c6" (UID: "504589a5-819e-4cfa-af69-e65e959968c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:15:39.489288 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.489182    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-home\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:39.489288 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.489261    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "504589a5-819e-4cfa-af69-e65e959968c6" (UID: "504589a5-819e-4cfa-af69-e65e959968c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:15:39.489977 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.489956    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-model-cache" (OuterVolumeSpecName: "model-cache") pod "504589a5-819e-4cfa-af69-e65e959968c6" (UID: "504589a5-819e-4cfa-af69-e65e959968c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:15:39.491257 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.491210    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-dshm" (OuterVolumeSpecName: "dshm") pod "504589a5-819e-4cfa-af69-e65e959968c6" (UID: "504589a5-819e-4cfa-af69-e65e959968c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:15:39.491257 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.491206    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/504589a5-819e-4cfa-af69-e65e959968c6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "504589a5-819e-4cfa-af69-e65e959968c6" (UID: "504589a5-819e-4cfa-af69-e65e959968c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:15:39.492060 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.491629    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504589a5-819e-4cfa-af69-e65e959968c6-kube-api-access-9sm5f" (OuterVolumeSpecName: "kube-api-access-9sm5f") pod "504589a5-819e-4cfa-af69-e65e959968c6" (UID: "504589a5-819e-4cfa-af69-e65e959968c6"). InnerVolumeSpecName "kube-api-access-9sm5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:15:39.566063 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.566023    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:39.590288 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.590249    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/504589a5-819e-4cfa-af69-e65e959968c6-tls-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:39.590288 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.590289    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sm5f\" (UniqueName: \"kubernetes.io/projected/504589a5-819e-4cfa-af69-e65e959968c6-kube-api-access-9sm5f\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:39.590489 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.590303    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-dshm\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:39.590489 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.590316    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-model-cache\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:39.590489 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.590329    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/504589a5-819e-4cfa-af69-e65e959968c6-tmp-dir\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:39.673407 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.673370    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:39.892709 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:39.892603    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:40.230766 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.230731    2576 generic.go:356] "Generic (PLEG): container finished" podID="504589a5-819e-4cfa-af69-e65e959968c6" containerID="0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20" exitCode=0
Sep 14 11:15:40.230958 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.230774    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"
Sep 14 11:15:40.230958 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.230804    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9" event={"ID":"504589a5-819e-4cfa-af69-e65e959968c6","Type":"ContainerDied","Data":"0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20"}
Sep 14 11:15:40.230958 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.230856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9" event={"ID":"504589a5-819e-4cfa-af69-e65e959968c6","Type":"ContainerDied","Data":"3453f7137269de1ae41e8b46185a891f2f8a0766627ca50f88381bb830f22684"}
Sep 14 11:15:40.230958 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.230875    2576 scope.go:117] "RemoveContainer" containerID="0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20"
Sep 14 11:15:40.240231 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.240213    2576 scope.go:117] "RemoveContainer" containerID="0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20"
Sep 14 11:15:40.240478 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:15:40.240462    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20\": container with ID starting with 0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20 not found: ID does not exist" containerID="0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20"
Sep 14 11:15:40.240522 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.240485    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20"} err="failed to get container status \"0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20\": rpc error: code = NotFound desc = could not find container \"0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20\": container with ID starting with 0f61a7ae79db0310a4f361e1f193c61529169ea2698a2d63967057e201bffb20 not found: ID does not exist"
Sep 14 11:15:40.348138 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.348107    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"]
Sep 14 11:15:40.384364 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.384332    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7984b1/premium-w0-7984b1-kserve-686876ff6c-np4r9"]
Sep 14 11:15:40.560843 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.560768    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ba4c739-59b6-4336-852f-1f491aa23fb4" path="/var/lib/kubelet/pods/4ba4c739-59b6-4336-852f-1f491aa23fb4/volumes"
Sep 14 11:15:40.561171 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.561159    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="504589a5-819e-4cfa-af69-e65e959968c6" path="/var/lib/kubelet/pods/504589a5-819e-4cfa-af69-e65e959968c6/volumes"
Sep 14 11:15:40.731668 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.731612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:40.873521 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:40.873436    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:41.090470 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:41.090436    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:42.438360 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:42.438326    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:42.540753 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:42.540718    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:42.665211 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:42.665183    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:43.195999 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:43.195970    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:43.306117 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:43.306081    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:43.858202 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:43.858167    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:44.922968 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:44.922913    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:46.030805 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:46.030772    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:47.475536 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:47.475498    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:48.129126 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:48.129094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:48.241677 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:48.241616    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:48.383091 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:48.383001    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:48.622508 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:48.622477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:49.926250 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:49.926215    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:50.962827 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:50.962779    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:52.258604 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:52.258563    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:53.311352 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.311270    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:53.345287 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.345255    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4" podUID="9f7e2639-1e4b-4e82-817d-e87c98546e59" containerName="main" containerID="cri-o://7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308" gracePeriod=45
Sep 14 11:15:53.603748 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.603724    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:15:53.741127 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741091    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-home\") pod \"9f7e2639-1e4b-4e82-817d-e87c98546e59\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") "
Sep 14 11:15:53.741300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741185    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-tmp-dir\") pod \"9f7e2639-1e4b-4e82-817d-e87c98546e59\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") "
Sep 14 11:15:53.741300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741215    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-model-cache\") pod \"9f7e2639-1e4b-4e82-817d-e87c98546e59\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") "
Sep 14 11:15:53.741300 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741248    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5ck8\" (UniqueName: \"kubernetes.io/projected/9f7e2639-1e4b-4e82-817d-e87c98546e59-kube-api-access-m5ck8\") pod \"9f7e2639-1e4b-4e82-817d-e87c98546e59\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") "
Sep 14 11:15:53.741453 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741350    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-home" (OuterVolumeSpecName: "home") pod "9f7e2639-1e4b-4e82-817d-e87c98546e59" (UID: "9f7e2639-1e4b-4e82-817d-e87c98546e59"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:15:53.741453 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741366    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-dshm\") pod \"9f7e2639-1e4b-4e82-817d-e87c98546e59\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") "
Sep 14 11:15:53.741453 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741392    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7e2639-1e4b-4e82-817d-e87c98546e59-tls-certs\") pod \"9f7e2639-1e4b-4e82-817d-e87c98546e59\" (UID: \"9f7e2639-1e4b-4e82-817d-e87c98546e59\") "
Sep 14 11:15:53.741453 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741420    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-model-cache" (OuterVolumeSpecName: "model-cache") pod "9f7e2639-1e4b-4e82-817d-e87c98546e59" (UID: "9f7e2639-1e4b-4e82-817d-e87c98546e59"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:15:53.741705 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741460    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9f7e2639-1e4b-4e82-817d-e87c98546e59" (UID: "9f7e2639-1e4b-4e82-817d-e87c98546e59"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:15:53.741766 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741706    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-home\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:53.741766 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741719    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-tmp-dir\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:53.741766 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.741730    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-model-cache\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:53.743588 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.743562    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7e2639-1e4b-4e82-817d-e87c98546e59-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9f7e2639-1e4b-4e82-817d-e87c98546e59" (UID: "9f7e2639-1e4b-4e82-817d-e87c98546e59"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:15:53.743718 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.743563    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-dshm" (OuterVolumeSpecName: "dshm") pod "9f7e2639-1e4b-4e82-817d-e87c98546e59" (UID: "9f7e2639-1e4b-4e82-817d-e87c98546e59"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:15:53.743718 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.743596    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7e2639-1e4b-4e82-817d-e87c98546e59-kube-api-access-m5ck8" (OuterVolumeSpecName: "kube-api-access-m5ck8") pod "9f7e2639-1e4b-4e82-817d-e87c98546e59" (UID: "9f7e2639-1e4b-4e82-817d-e87c98546e59"). InnerVolumeSpecName "kube-api-access-m5ck8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:15:53.843080 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.842990    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5ck8\" (UniqueName: \"kubernetes.io/projected/9f7e2639-1e4b-4e82-817d-e87c98546e59-kube-api-access-m5ck8\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:53.843080 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.843023    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f7e2639-1e4b-4e82-817d-e87c98546e59-dshm\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:53.843080 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:53.843033    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7e2639-1e4b-4e82-817d-e87c98546e59-tls-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:54.200029 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:54.199946    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:54.315168 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:54.315126    2576 generic.go:356] "Generic (PLEG): container finished" podID="9f7e2639-1e4b-4e82-817d-e87c98546e59" containerID="7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308" exitCode=0
Sep 14 11:15:54.315168 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:54.315174    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"
Sep 14 11:15:54.315634 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:54.315220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4" event={"ID":"9f7e2639-1e4b-4e82-817d-e87c98546e59","Type":"ContainerDied","Data":"7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308"}
Sep 14 11:15:54.315634 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:54.315263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4" event={"ID":"9f7e2639-1e4b-4e82-817d-e87c98546e59","Type":"ContainerDied","Data":"41c458ef290971f99ad16ac205bf090596935bf4c9755b5230ee29c8d3e616e5"}
Sep 14 11:15:54.315634 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:54.315279    2576 scope.go:117] "RemoveContainer" containerID="7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308"
Sep 14 11:15:54.325187 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:54.325170    2576 scope.go:117] "RemoveContainer" containerID="7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308"
Sep 14 11:15:54.325488 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:15:54.325464    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308\": container with ID starting with 7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308 not found: ID does not exist" containerID="7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308"
Sep 14 11:15:54.325559 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:54.325502    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308"} err="failed to get container status \"7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308\": rpc error: code = NotFound desc = could not find container \"7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308\": container with ID starting with 7e9c4ff7dc2741368899e875e921745416807eee7c41249ce1da1644a960c308 not found: ID does not exist"
Sep 14 11:15:54.346173 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:54.346146    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"]
Sep 14 11:15:54.352910 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:54.352886    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-4ebf73/premium-w4-4ebf73-kserve-6d6b84987f-kptb4"]
Sep 14 11:15:54.560534 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:54.560504    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f7e2639-1e4b-4e82-817d-e87c98546e59" path="/var/lib/kubelet/pods/9f7e2639-1e4b-4e82-817d-e87c98546e59/volumes"
Sep 14 11:15:55.289768 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:55.289724    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:55.401143 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:55.401110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:55.790122 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:55.790085    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:56.333826 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:56.333750    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:56.644609 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:56.644522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:56.855628 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:56.855594    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:57.725881 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:57.725844    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"]
Sep 14 11:15:57.726370 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:57.726112    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf" podUID="92436e7f-e068-4751-b85b-1a9a4044d849" containerName="maas-api" containerID="cri-o://a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279" gracePeriod=30
Sep 14 11:15:57.810479 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:57.810442    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:57.909086 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:57.909019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:58.002144 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.002116    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:15:58.080581 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.080502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:58.085930 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.085038    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lccvc\" (UniqueName: \"kubernetes.io/projected/92436e7f-e068-4751-b85b-1a9a4044d849-kube-api-access-lccvc\") pod \"92436e7f-e068-4751-b85b-1a9a4044d849\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") "
Sep 14 11:15:58.085930 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.085111    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-metrics-certs\") pod \"92436e7f-e068-4751-b85b-1a9a4044d849\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") "
Sep 14 11:15:58.085930 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.085154    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-maas-api-tls\") pod \"92436e7f-e068-4751-b85b-1a9a4044d849\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") "
Sep 14 11:15:58.085930 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.085216    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92436e7f-e068-4751-b85b-1a9a4044d849-openshift-service-ca\") pod \"92436e7f-e068-4751-b85b-1a9a4044d849\" (UID: \"92436e7f-e068-4751-b85b-1a9a4044d849\") "
Sep 14 11:15:58.088204 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.088144    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92436e7f-e068-4751-b85b-1a9a4044d849-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "92436e7f-e068-4751-b85b-1a9a4044d849" (UID: "92436e7f-e068-4751-b85b-1a9a4044d849"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:15:58.091578 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.091545    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92436e7f-e068-4751-b85b-1a9a4044d849-kube-api-access-lccvc" (OuterVolumeSpecName: "kube-api-access-lccvc") pod "92436e7f-e068-4751-b85b-1a9a4044d849" (UID: "92436e7f-e068-4751-b85b-1a9a4044d849"). InnerVolumeSpecName "kube-api-access-lccvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:15:58.094694 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.094513    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "92436e7f-e068-4751-b85b-1a9a4044d849" (UID: "92436e7f-e068-4751-b85b-1a9a4044d849"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:15:58.095567 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.095358    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "92436e7f-e068-4751-b85b-1a9a4044d849" (UID: "92436e7f-e068-4751-b85b-1a9a4044d849"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:15:58.186868 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.186832    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92436e7f-e068-4751-b85b-1a9a4044d849-openshift-service-ca\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:58.186868 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.186865    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lccvc\" (UniqueName: \"kubernetes.io/projected/92436e7f-e068-4751-b85b-1a9a4044d849-kube-api-access-lccvc\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:58.187114 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.186881    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-metrics-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:58.187114 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.186895    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92436e7f-e068-4751-b85b-1a9a4044d849-maas-api-tls\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:15:58.220780 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.220738    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:58.308919 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.308836    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:58.343585 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.343551    2576 generic.go:356] "Generic (PLEG): container finished" podID="92436e7f-e068-4751-b85b-1a9a4044d849" containerID="a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279" exitCode=0
Sep 14 11:15:58.343779 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.343613    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"
Sep 14 11:15:58.343779 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.343643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf" event={"ID":"92436e7f-e068-4751-b85b-1a9a4044d849","Type":"ContainerDied","Data":"a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279"}
Sep 14 11:15:58.343779 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.343730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf" event={"ID":"92436e7f-e068-4751-b85b-1a9a4044d849","Type":"ContainerDied","Data":"da8ee405888d57b77fb1dd526a3b88438c4d3a7c0add4d0cc11baf453cdd7263"}
Sep 14 11:15:58.343779 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.343764    2576 scope.go:117] "RemoveContainer" containerID="a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279"
Sep 14 11:15:58.352569 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.352555    2576 scope.go:117] "RemoveContainer" containerID="a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279"
Sep 14 11:15:58.352860 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:15:58.352843    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279\": container with ID starting with a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279 not found: ID does not exist" containerID="a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279"
Sep 14 11:15:58.352944 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.352866    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279"} err="failed to get container status \"a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279\": rpc error: code = NotFound desc = could not find container \"a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279\": container with ID starting with a432cb43ac82cfdc0607495ea2ea9e8920af6bd625014fd5ad926f876d67c279 not found: ID does not exist"
Sep 14 11:15:58.371762 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.371736    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"]
Sep 14 11:15:58.390496 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.390468    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4ebf73-66b7fc9758-dkckf"]
Sep 14 11:15:58.536072 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.536036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:58.566583 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:58.562782    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92436e7f-e068-4751-b85b-1a9a4044d849" path="/var/lib/kubelet/pods/92436e7f-e068-4751-b85b-1a9a4044d849/volumes"
Sep 14 11:15:59.494299 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:59.494263    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:59.661303 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:59.661267    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:15:59.796287 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:15:59.796205    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:00.769577 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:00.769541    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:01.388660 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:01.388613    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:01.603431 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:01.603393    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:02.321124 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:02.321076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:03.692009 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:03.691982    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:04.781463 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:04.781433    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:05.915030 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:05.914979    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:06.017083 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:06.017039    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:06.998031 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:06.997997    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:07.282028 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:07.281942    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:07.386093 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:07.386058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:07.552436 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:07.552324    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:07.664843 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:07.664808    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:07.830630 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:07.830532    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:07.961785 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:07.961743    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:08.115581 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.115488    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:08.161986 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.161956    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"]
Sep 14 11:16:08.162344 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162327    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92436e7f-e068-4751-b85b-1a9a4044d849" containerName="maas-api"
Sep 14 11:16:08.162393 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162345    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="92436e7f-e068-4751-b85b-1a9a4044d849" containerName="maas-api"
Sep 14 11:16:08.162393 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162359    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7e2639-1e4b-4e82-817d-e87c98546e59" containerName="main"
Sep 14 11:16:08.162393 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162366    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7e2639-1e4b-4e82-817d-e87c98546e59" containerName="main"
Sep 14 11:16:08.162393 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162378    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504589a5-819e-4cfa-af69-e65e959968c6" containerName="main"
Sep 14 11:16:08.162393 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162385    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="504589a5-819e-4cfa-af69-e65e959968c6" containerName="main"
Sep 14 11:16:08.162567 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162402    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba4c739-59b6-4336-852f-1f491aa23fb4" containerName="maas-api"
Sep 14 11:16:08.162567 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162408    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba4c739-59b6-4336-852f-1f491aa23fb4" containerName="maas-api"
Sep 14 11:16:08.162567 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162461    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ba4c739-59b6-4336-852f-1f491aa23fb4" containerName="maas-api"
Sep 14 11:16:08.162567 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162471    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="504589a5-819e-4cfa-af69-e65e959968c6" containerName="main"
Sep 14 11:16:08.162567 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162479    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7e2639-1e4b-4e82-817d-e87c98546e59" containerName="main"
Sep 14 11:16:08.162567 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.162486    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="92436e7f-e068-4751-b85b-1a9a4044d849" containerName="maas-api"
Sep 14 11:16:08.165644 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.165624    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:16:08.170275 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.170249    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-f8e582-dockercfg-lftq5\""
Sep 14 11:16:08.170410 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.170358    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-f8e582\""
Sep 14 11:16:08.188445 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.188418    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"]
Sep 14 11:16:08.285620 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.285573    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f060fc98-91ae-4ff8-8bad-e10456d559b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9\" (UID: \"f060fc98-91ae-4ff8-8bad-e10456d559b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:16:08.285822 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.285717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb6zx\" (UniqueName: \"kubernetes.io/projected/f060fc98-91ae-4ff8-8bad-e10456d559b8-kube-api-access-vb6zx\") pod \"payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9\" (UID: \"f060fc98-91ae-4ff8-8bad-e10456d559b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:16:08.386768 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.386674    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f060fc98-91ae-4ff8-8bad-e10456d559b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9\" (UID: \"f060fc98-91ae-4ff8-8bad-e10456d559b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:16:08.386768 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.386762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb6zx\" (UniqueName: \"kubernetes.io/projected/f060fc98-91ae-4ff8-8bad-e10456d559b8-kube-api-access-vb6zx\") pod \"payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9\" (UID: \"f060fc98-91ae-4ff8-8bad-e10456d559b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:16:08.387354 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.387327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f060fc98-91ae-4ff8-8bad-e10456d559b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9\" (UID: \"f060fc98-91ae-4ff8-8bad-e10456d559b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:16:08.403371 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.403341    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb6zx\" (UniqueName: \"kubernetes.io/projected/f060fc98-91ae-4ff8-8bad-e10456d559b8-kube-api-access-vb6zx\") pod \"payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9\" (UID: \"f060fc98-91ae-4ff8-8bad-e10456d559b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:16:08.477695 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.477634    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:16:08.755760 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.755710    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:08.815789 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:08.815762    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"]
Sep 14 11:16:08.817004 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:16:08.816978    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf060fc98_91ae_4ff8_8bad_e10456d559b8.slice/crio-119f71055a1b3adf2ebf67f3ca56bc5ef29b98f0de6734839adb7373765ae03d WatchSource:0}: Error finding container 119f71055a1b3adf2ebf67f3ca56bc5ef29b98f0de6734839adb7373765ae03d: Status 404 returned error can't find the container with id 119f71055a1b3adf2ebf67f3ca56bc5ef29b98f0de6734839adb7373765ae03d
Sep 14 11:16:09.406768 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:09.406719    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9" event={"ID":"f060fc98-91ae-4ff8-8bad-e10456d559b8","Type":"ContainerStarted","Data":"15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa"}
Sep 14 11:16:09.407268 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:09.406830    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9" event={"ID":"f060fc98-91ae-4ff8-8bad-e10456d559b8","Type":"ContainerStarted","Data":"119f71055a1b3adf2ebf67f3ca56bc5ef29b98f0de6734839adb7373765ae03d"}
Sep 14 11:16:09.407268 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:09.407093    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:16:09.442887 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:09.442831    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9" podStartSLOduration=1.442814314 podStartE2EDuration="1.442814314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:16:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:16:09.441053673 +0000 UTC m=+1629.421689180" watchObservedRunningTime="2026-09-14 11:16:09.442814314 +0000 UTC m=+1629.423449819"
Sep 14 11:16:10.456883 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:10.456837    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:11.668567 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:11.668523    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:13.008039 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:13.007991    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:16.840146 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:16.840050    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:16.935365 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:16.935327    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:17.184352 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:17.184246    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:18.460337 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:18.460235    2576 generic.go:356] "Generic (PLEG): container finished" podID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerID="c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9" exitCode=0
Sep 14 11:16:18.460337 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:18.460306    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" event={"ID":"5900dd06-ce41-4947-957f-c621b4b2f82d","Type":"ContainerDied","Data":"c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9"}
Sep 14 11:16:18.460870 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:18.460735    2576 scope.go:117] "RemoveContainer" containerID="c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9"
Sep 14 11:16:18.461898 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:18.461869    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:16:18.461959 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:18.461939    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:16:18.461998 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:18.461970    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:16:19.466939 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:19.466911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" event={"ID":"5900dd06-ce41-4947-957f-c621b4b2f82d","Type":"ContainerStarted","Data":"2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8"}
Sep 14 11:16:19.517059 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:19.517021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:20.249324 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:20.249287    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:16:20.250636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:20.250610    2576 patch_prober.go:28] interesting pod/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 14 11:16:20.250806 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:20.250672    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 14 11:16:20.414661 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:20.414610    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:16:21.249951 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:21.249918    2576 patch_prober.go:28] interesting pod/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 14 11:16:21.250420 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:21.249990    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 14 11:16:22.249692 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:22.249633    2576 patch_prober.go:28] interesting pod/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 14 11:16:22.249913 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:22.249714    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 14 11:16:22.745343 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:22.745310    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:23.250256 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:23.250222    2576 patch_prober.go:28] interesting pod/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 14 11:16:23.250506 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:23.250292    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 14 11:16:23.944277 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:23.944240    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:24.225112 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:24.225021    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:16:24.249757 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:24.249727    2576 patch_prober.go:28] interesting pod/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 14 11:16:24.249894 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:24.249783    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 14 11:16:25.253775 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:25.253737    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:16:25.254765 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:25.254747    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:16:28.706274 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:28.706239    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:30.558063 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:30.558026    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:31.884410 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:31.884358    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:32.798942 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:32.798885    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:33.923559 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:33.923526    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:34.737055 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:34.737021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:34.924470 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:34.924428    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:35.807982 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:35.807942    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:36.854067 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:36.854035    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:37.944440 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:37.944407    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:38.869093 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:38.869061    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:39.795869 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:39.795834    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:40.725008 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:40.724974    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:41.749147 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:41.749114    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:42.765276 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:42.765242    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:43.571081 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:43.571036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:44.643534 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:44.643503    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:53.263029 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:53.262994    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:53.431067 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:53.431019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:53.530225 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:53.530137    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:53.623082 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:53.623048    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:53.961549 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:53.961445    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:54.062090 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:54.062055    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:55.017020 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:55.016981    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:55.964413 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:55.964377    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:56.859746 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:56.859714    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:57.649886 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:57.649846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:16:58.458289 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:16:58.458245    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:00.711289 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:00.711240    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:00.810769 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:00.810736    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:00.956142 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:00.956101    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"]
Sep 14 11:17:00.956389 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:00.956363    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy" containerID="cri-o://2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8" gracePeriod=30
Sep 14 11:17:00.991257 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:00.991226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:01.623503 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:01.623461    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:02.591179 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:02.591131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:03.792269 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:03.792232    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:04.343163 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:04.343128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:05.478139 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:05.478110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:06.173088 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.173055    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:06.219126 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.219065    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:17:06.367208 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367168    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-credential-socket\") pod \"5900dd06-ce41-4947-957f-c621b4b2f82d\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") "
Sep 14 11:17:06.367409 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367250    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-podinfo\") pod \"5900dd06-ce41-4947-957f-c621b4b2f82d\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") "
Sep 14 11:17:06.367409 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367271    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb8hh\" (UniqueName: \"kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-kube-api-access-mb8hh\") pod \"5900dd06-ce41-4947-957f-c621b4b2f82d\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") "
Sep 14 11:17:06.367409 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367301    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-certs\") pod \"5900dd06-ce41-4947-957f-c621b4b2f82d\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") "
Sep 14 11:17:06.367409 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367364    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-envoy\") pod \"5900dd06-ce41-4947-957f-c621b4b2f82d\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") "
Sep 14 11:17:06.367409 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367397    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5900dd06-ce41-4947-957f-c621b4b2f82d-istiod-ca-cert\") pod \"5900dd06-ce41-4947-957f-c621b4b2f82d\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") "
Sep 14 11:17:06.367707 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367431    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-token\") pod \"5900dd06-ce41-4947-957f-c621b4b2f82d\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") "
Sep 14 11:17:06.367707 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367460    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-data\") pod \"5900dd06-ce41-4947-957f-c621b4b2f82d\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") "
Sep 14 11:17:06.367707 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-socket\") pod \"5900dd06-ce41-4947-957f-c621b4b2f82d\" (UID: \"5900dd06-ce41-4947-957f-c621b4b2f82d\") "
Sep 14 11:17:06.367707 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367540    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5900dd06-ce41-4947-957f-c621b4b2f82d" (UID: "5900dd06-ce41-4947-957f-c621b4b2f82d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:06.367916 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367783    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5900dd06-ce41-4947-957f-c621b4b2f82d" (UID: "5900dd06-ce41-4947-957f-c621b4b2f82d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:06.367916 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367798    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5900dd06-ce41-4947-957f-c621b4b2f82d" (UID: "5900dd06-ce41-4947-957f-c621b4b2f82d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:06.367916 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367893    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-credential-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:06.367916 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367906    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:06.368091 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367979    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-data" (OuterVolumeSpecName: "istio-data") pod "5900dd06-ce41-4947-957f-c621b4b2f82d" (UID: "5900dd06-ce41-4947-957f-c621b4b2f82d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:06.368091 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.367999    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5900dd06-ce41-4947-957f-c621b4b2f82d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5900dd06-ce41-4947-957f-c621b4b2f82d" (UID: "5900dd06-ce41-4947-957f-c621b4b2f82d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:17:06.369726 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.369700    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5900dd06-ce41-4947-957f-c621b4b2f82d" (UID: "5900dd06-ce41-4947-957f-c621b4b2f82d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:06.369905 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.369873    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-token" (OuterVolumeSpecName: "istio-token") pod "5900dd06-ce41-4947-957f-c621b4b2f82d" (UID: "5900dd06-ce41-4947-957f-c621b4b2f82d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:17:06.369995 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.369977    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-kube-api-access-mb8hh" (OuterVolumeSpecName: "kube-api-access-mb8hh") pod "5900dd06-ce41-4947-957f-c621b4b2f82d" (UID: "5900dd06-ce41-4947-957f-c621b4b2f82d"). InnerVolumeSpecName "kube-api-access-mb8hh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:17:06.370050 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.369992    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5900dd06-ce41-4947-957f-c621b4b2f82d" (UID: "5900dd06-ce41-4947-957f-c621b4b2f82d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 11:17:06.469473 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.469394    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-envoy\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:06.469473 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.469425    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5900dd06-ce41-4947-957f-c621b4b2f82d-istiod-ca-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:06.469473 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.469434    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:06.469473 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.469442    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-data\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:06.469473 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.469450    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5900dd06-ce41-4947-957f-c621b4b2f82d-workload-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:06.469473 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.469458    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5900dd06-ce41-4947-957f-c621b4b2f82d-istio-podinfo\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:06.469473 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.469467    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb8hh\" (UniqueName: \"kubernetes.io/projected/5900dd06-ce41-4947-957f-c621b4b2f82d-kube-api-access-mb8hh\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:06.726639 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.726553    2576 generic.go:356] "Generic (PLEG): container finished" podID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerID="2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8" exitCode=0
Sep 14 11:17:06.726639 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.726601    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"
Sep 14 11:17:06.727083 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.726638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" event={"ID":"5900dd06-ce41-4947-957f-c621b4b2f82d","Type":"ContainerDied","Data":"2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8"}
Sep 14 11:17:06.727083 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.726721    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb" event={"ID":"5900dd06-ce41-4947-957f-c621b4b2f82d","Type":"ContainerDied","Data":"e8ff365efef98aeb1f0e43ea19c4f628efdd8b99471d5ed6b0ab75300385eb5d"}
Sep 14 11:17:06.727083 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.726743    2576 scope.go:117] "RemoveContainer" containerID="2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8"
Sep 14 11:17:06.736124 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.736108    2576 scope.go:117] "RemoveContainer" containerID="c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9"
Sep 14 11:17:06.744103 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.744087    2576 scope.go:117] "RemoveContainer" containerID="2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8"
Sep 14 11:17:06.744362 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:17:06.744347    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8\": container with ID starting with 2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8 not found: ID does not exist" containerID="2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8"
Sep 14 11:17:06.744408 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.744369    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8"} err="failed to get container status \"2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8\": rpc error: code = NotFound desc = could not find container \"2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8\": container with ID starting with 2b57f6fc4a8c6e86f6ec7511db81675471277c98ee8c959d1e76b2c32176fdb8 not found: ID does not exist"
Sep 14 11:17:06.744408 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.744384    2576 scope.go:117] "RemoveContainer" containerID="c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9"
Sep 14 11:17:06.744628 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:17:06.744612    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9\": container with ID starting with c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9 not found: ID does not exist" containerID="c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9"
Sep 14 11:17:06.744689 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.744633    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9"} err="failed to get container status \"c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9\": rpc error: code = NotFound desc = could not find container \"c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9\": container with ID starting with c6e7886137f4cfec818b233201c700b0118677934de55d116c0c900bc67c50b9 not found: ID does not exist"
Sep 14 11:17:06.758698 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.758665    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"]
Sep 14 11:17:06.759918 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:06.759894    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb"]
Sep 14 11:17:07.217710 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:07.217675    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:08.560543 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:08.560507    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" path="/var/lib/kubelet/pods/5900dd06-ce41-4947-957f-c621b4b2f82d/volumes"
Sep 14 11:17:17.128749 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.128714    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:17.208473 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.208438    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"]
Sep 14 11:17:17.208722 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.208699    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9" podUID="f060fc98-91ae-4ff8-8bad-e10456d559b8" containerName="payload-pre-processing" containerID="cri-o://15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa" gracePeriod=30
Sep 14 11:17:17.262363 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.262319    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:17.365345 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.365308    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:17.477751 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.477708    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:17.499920 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.499894    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:17:17.569182 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.569154    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb6zx\" (UniqueName: \"kubernetes.io/projected/f060fc98-91ae-4ff8-8bad-e10456d559b8-kube-api-access-vb6zx\") pod \"f060fc98-91ae-4ff8-8bad-e10456d559b8\" (UID: \"f060fc98-91ae-4ff8-8bad-e10456d559b8\") "
Sep 14 11:17:17.569182 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.569184    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f060fc98-91ae-4ff8-8bad-e10456d559b8-plugins-config-volume\") pod \"f060fc98-91ae-4ff8-8bad-e10456d559b8\" (UID: \"f060fc98-91ae-4ff8-8bad-e10456d559b8\") "
Sep 14 11:17:17.569610 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.569582    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f060fc98-91ae-4ff8-8bad-e10456d559b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f060fc98-91ae-4ff8-8bad-e10456d559b8" (UID: "f060fc98-91ae-4ff8-8bad-e10456d559b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:17:17.571289 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.571263    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f060fc98-91ae-4ff8-8bad-e10456d559b8-kube-api-access-vb6zx" (OuterVolumeSpecName: "kube-api-access-vb6zx") pod "f060fc98-91ae-4ff8-8bad-e10456d559b8" (UID: "f060fc98-91ae-4ff8-8bad-e10456d559b8"). InnerVolumeSpecName "kube-api-access-vb6zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:17:17.670665 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.670553    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb6zx\" (UniqueName: \"kubernetes.io/projected/f060fc98-91ae-4ff8-8bad-e10456d559b8-kube-api-access-vb6zx\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:17.670665 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.670589    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f060fc98-91ae-4ff8-8bad-e10456d559b8-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:17.787108 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.787075    2576 generic.go:356] "Generic (PLEG): container finished" podID="f060fc98-91ae-4ff8-8bad-e10456d559b8" containerID="15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa" exitCode=0
Sep 14 11:17:17.787271 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.787116    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9" event={"ID":"f060fc98-91ae-4ff8-8bad-e10456d559b8","Type":"ContainerDied","Data":"15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa"}
Sep 14 11:17:17.787271 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.787125    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"
Sep 14 11:17:17.787271 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.787158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9" event={"ID":"f060fc98-91ae-4ff8-8bad-e10456d559b8","Type":"ContainerDied","Data":"119f71055a1b3adf2ebf67f3ca56bc5ef29b98f0de6734839adb7373765ae03d"}
Sep 14 11:17:17.787271 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.787179    2576 scope.go:117] "RemoveContainer" containerID="15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa"
Sep 14 11:17:17.796299 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.796281    2576 scope.go:117] "RemoveContainer" containerID="15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa"
Sep 14 11:17:17.796561 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:17:17.796545    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa\": container with ID starting with 15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa not found: ID does not exist" containerID="15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa"
Sep 14 11:17:17.796616 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.796567    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa"} err="failed to get container status \"15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa\": rpc error: code = NotFound desc = could not find container \"15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa\": container with ID starting with 15f699609889ccb2a1777b480935a0e23e24db68f29c3a5c7a02abae7c9a02aa not found: ID does not exist"
Sep 14 11:17:17.809220 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.809187    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"]
Sep 14 11:17:17.815255 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.815226    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9"]
Sep 14 11:17:17.828854 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.828806    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:17.969894 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:17.969792    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:18.560538 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:18.560501    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f060fc98-91ae-4ff8-8bad-e10456d559b8" path="/var/lib/kubelet/pods/f060fc98-91ae-4ff8-8bad-e10456d559b8/volumes"
Sep 14 11:17:18.919002 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:18.918909    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:19.908487 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:19.908429    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:20.186940 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:20.186835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:26.473011 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:26.472897    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:26.625348 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:26.625314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:27.472968 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:27.472931    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:27.531477 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:27.531447    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"]
Sep 14 11:17:27.565072 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:27.565036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:28.815260 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:28.815226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:28.939349 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:28.939318    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:29.085352 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:29.085272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:29.596259 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:29.596220    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:30.480221 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:30.480189    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:31.961727 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:31.961698    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:33.271638 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:33.271600    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:34.365891 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:34.365863    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:34.587192 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:34.587147    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:35.978166 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:35.978131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:40.253203 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.253171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:40.312689 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.303457    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"]
Sep 14 11:17:40.313267 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.313223    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw" podUID="df8b6d59-2a6b-4e4f-9ad6-9b9689f80396" containerName="payload-processing" containerID="cri-o://2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87" gracePeriod=30
Sep 14 11:17:40.326187 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.324608    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"]
Sep 14 11:17:40.327981 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.327924    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9" podUID="1d836414-fc27-4e4b-b545-b8f5e9dfa743" containerName="payload-pre-processing" containerID="cri-o://d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb" gracePeriod=30
Sep 14 11:17:40.351769 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.351741    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:40.462182 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.462152    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:40.569794 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.569761    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:40.628466 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.628363    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:17:40.631312 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.631281    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:17:40.662727 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.662699    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-plugins-config-volume\") pod \"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396\" (UID: \"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396\") "
Sep 14 11:17:40.662935 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.662759    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nl28\" (UniqueName: \"kubernetes.io/projected/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-kube-api-access-6nl28\") pod \"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396\" (UID: \"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396\") "
Sep 14 11:17:40.663101 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.663081    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "df8b6d59-2a6b-4e4f-9ad6-9b9689f80396" (UID: "df8b6d59-2a6b-4e4f-9ad6-9b9689f80396"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:17:40.665016 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.664987    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-kube-api-access-6nl28" (OuterVolumeSpecName: "kube-api-access-6nl28") pod "df8b6d59-2a6b-4e4f-9ad6-9b9689f80396" (UID: "df8b6d59-2a6b-4e4f-9ad6-9b9689f80396"). InnerVolumeSpecName "kube-api-access-6nl28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:17:40.763679 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.763634    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm777\" (UniqueName: \"kubernetes.io/projected/1d836414-fc27-4e4b-b545-b8f5e9dfa743-kube-api-access-gm777\") pod \"1d836414-fc27-4e4b-b545-b8f5e9dfa743\" (UID: \"1d836414-fc27-4e4b-b545-b8f5e9dfa743\") "
Sep 14 11:17:40.763882 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.763811    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d836414-fc27-4e4b-b545-b8f5e9dfa743-plugins-config-volume\") pod \"1d836414-fc27-4e4b-b545-b8f5e9dfa743\" (UID: \"1d836414-fc27-4e4b-b545-b8f5e9dfa743\") "
Sep 14 11:17:40.764123 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.764098    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:40.764225 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.764128    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nl28\" (UniqueName: \"kubernetes.io/projected/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396-kube-api-access-6nl28\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:40.764286 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.764231    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d836414-fc27-4e4b-b545-b8f5e9dfa743-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d836414-fc27-4e4b-b545-b8f5e9dfa743" (UID: "1d836414-fc27-4e4b-b545-b8f5e9dfa743"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:17:40.766400 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.766366    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d836414-fc27-4e4b-b545-b8f5e9dfa743-kube-api-access-gm777" (OuterVolumeSpecName: "kube-api-access-gm777") pod "1d836414-fc27-4e4b-b545-b8f5e9dfa743" (UID: "1d836414-fc27-4e4b-b545-b8f5e9dfa743"). InnerVolumeSpecName "kube-api-access-gm777". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:17:40.822467 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.822371    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:40.864943 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.864910    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d836414-fc27-4e4b-b545-b8f5e9dfa743-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:40.864943 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.864936    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm777\" (UniqueName: \"kubernetes.io/projected/1d836414-fc27-4e4b-b545-b8f5e9dfa743-kube-api-access-gm777\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:40.902696 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.902634    2576 generic.go:356] "Generic (PLEG): container finished" podID="1d836414-fc27-4e4b-b545-b8f5e9dfa743" containerID="d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb" exitCode=0
Sep 14 11:17:40.902696 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.902688    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"
Sep 14 11:17:40.902937 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.902721    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9" event={"ID":"1d836414-fc27-4e4b-b545-b8f5e9dfa743","Type":"ContainerDied","Data":"d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb"}
Sep 14 11:17:40.902937 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.902775    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9" event={"ID":"1d836414-fc27-4e4b-b545-b8f5e9dfa743","Type":"ContainerDied","Data":"db9a483b17e92fd625b672718d36ab1fb9cd8186f459c811fa564710c487cc98"}
Sep 14 11:17:40.902937 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.902798    2576 scope.go:117] "RemoveContainer" containerID="d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb"
Sep 14 11:17:40.904145 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.904117    2576 generic.go:356] "Generic (PLEG): container finished" podID="df8b6d59-2a6b-4e4f-9ad6-9b9689f80396" containerID="2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87" exitCode=0
Sep 14 11:17:40.904230 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.904155    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"
Sep 14 11:17:40.904230 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.904175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw" event={"ID":"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396","Type":"ContainerDied","Data":"2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87"}
Sep 14 11:17:40.904326 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.904240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw" event={"ID":"df8b6d59-2a6b-4e4f-9ad6-9b9689f80396","Type":"ContainerDied","Data":"8f09820de9a0757c4c000ddfd05b34f1f6164b719b9de5157f5001410a1a21f3"}
Sep 14 11:17:40.913801 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.913782    2576 scope.go:117] "RemoveContainer" containerID="d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb"
Sep 14 11:17:40.914089 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:17:40.914060    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb\": container with ID starting with d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb not found: ID does not exist" containerID="d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb"
Sep 14 11:17:40.914184 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.914102    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb"} err="failed to get container status \"d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb\": rpc error: code = NotFound desc = could not find container \"d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb\": container with ID starting with d34e643a900a1b321150d50af8e5c7d9794ef71bd3278ec5dea635240cf4acbb not found: ID does not exist"
Sep 14 11:17:40.914184 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.914125    2576 scope.go:117] "RemoveContainer" containerID="2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87"
Sep 14 11:17:40.923735 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.923714    2576 scope.go:117] "RemoveContainer" containerID="2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87"
Sep 14 11:17:40.923983 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:17:40.923964    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87\": container with ID starting with 2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87 not found: ID does not exist" containerID="2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87"
Sep 14 11:17:40.924058 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.923991    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87"} err="failed to get container status \"2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87\": rpc error: code = NotFound desc = could not find container \"2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87\": container with ID starting with 2118b5a3ef67f95c2ad46eb55012bc35562ff9c7267e9c62d4685c9fe775ca87 not found: ID does not exist"
Sep 14 11:17:40.948473 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.948435    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"]
Sep 14 11:17:40.964187 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.964163    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw"]
Sep 14 11:17:40.991605 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.991570    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"]
Sep 14 11:17:40.995711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:40.995682    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9"]
Sep 14 11:17:41.062868 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:41.062828    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:41.198328 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:41.198262    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:42.173895 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.173861    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:42.550711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.550671    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n" podUID="d8d99194-1bbb-42a7-983a-fa1f02e836f6" containerName="main" containerID="cri-o://cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225" gracePeriod=45
Sep 14 11:17:42.563444 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.561520    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d836414-fc27-4e4b-b545-b8f5e9dfa743" path="/var/lib/kubelet/pods/1d836414-fc27-4e4b-b545-b8f5e9dfa743/volumes"
Sep 14 11:17:42.563444 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.562054    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df8b6d59-2a6b-4e4f-9ad6-9b9689f80396" path="/var/lib/kubelet/pods/df8b6d59-2a6b-4e4f-9ad6-9b9689f80396/volumes"
Sep 14 11:17:42.805732 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.805669    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:17:42.883870 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.883765    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkc8z\" (UniqueName: \"kubernetes.io/projected/d8d99194-1bbb-42a7-983a-fa1f02e836f6-kube-api-access-dkc8z\") pod \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") "
Sep 14 11:17:42.884062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.883913    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-home\") pod \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") "
Sep 14 11:17:42.884062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.883949    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tls-certs\") pod \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") "
Sep 14 11:17:42.884062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.883996    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-dshm\") pod \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") "
Sep 14 11:17:42.884062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.884021    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-model-cache\") pod \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") "
Sep 14 11:17:42.884278 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.884061    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tmp-dir\") pod \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\" (UID: \"d8d99194-1bbb-42a7-983a-fa1f02e836f6\") "
Sep 14 11:17:42.884278 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.884182    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-home" (OuterVolumeSpecName: "home") pod "d8d99194-1bbb-42a7-983a-fa1f02e836f6" (UID: "d8d99194-1bbb-42a7-983a-fa1f02e836f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:42.884278 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.884251    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8d99194-1bbb-42a7-983a-fa1f02e836f6" (UID: "d8d99194-1bbb-42a7-983a-fa1f02e836f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:42.884404 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.884318    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8d99194-1bbb-42a7-983a-fa1f02e836f6" (UID: "d8d99194-1bbb-42a7-983a-fa1f02e836f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:42.884437 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.884413    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-home\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:42.884437 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.884425    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-model-cache\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:42.884437 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.884435    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tmp-dir\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:42.886140 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.886119    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-dshm" (OuterVolumeSpecName: "dshm") pod "d8d99194-1bbb-42a7-983a-fa1f02e836f6" (UID: "d8d99194-1bbb-42a7-983a-fa1f02e836f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:42.886334 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.886316    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8d99194-1bbb-42a7-983a-fa1f02e836f6" (UID: "d8d99194-1bbb-42a7-983a-fa1f02e836f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:17:42.886387 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.886342    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d99194-1bbb-42a7-983a-fa1f02e836f6-kube-api-access-dkc8z" (OuterVolumeSpecName: "kube-api-access-dkc8z") pod "d8d99194-1bbb-42a7-983a-fa1f02e836f6" (UID: "d8d99194-1bbb-42a7-983a-fa1f02e836f6"). InnerVolumeSpecName "kube-api-access-dkc8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:17:42.916866 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.916833    2576 generic.go:356] "Generic (PLEG): container finished" podID="d8d99194-1bbb-42a7-983a-fa1f02e836f6" containerID="cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225" exitCode=0
Sep 14 11:17:42.917046 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.916877    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"
Sep 14 11:17:42.917046 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.916883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n" event={"ID":"d8d99194-1bbb-42a7-983a-fa1f02e836f6","Type":"ContainerDied","Data":"cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225"}
Sep 14 11:17:42.917046 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.916924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n" event={"ID":"d8d99194-1bbb-42a7-983a-fa1f02e836f6","Type":"ContainerDied","Data":"2032bd63362ab034cb7d7c5e21999f12d18fdb4b0c06d7ceab64b316ed0b733f"}
Sep 14 11:17:42.917046 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.916941    2576 scope.go:117] "RemoveContainer" containerID="cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225"
Sep 14 11:17:42.926012 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.925996    2576 scope.go:117] "RemoveContainer" containerID="cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225"
Sep 14 11:17:42.926305 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:17:42.926288    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225\": container with ID starting with cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225 not found: ID does not exist" containerID="cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225"
Sep 14 11:17:42.926361 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.926313    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225"} err="failed to get container status \"cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225\": rpc error: code = NotFound desc = could not find container \"cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225\": container with ID starting with cad8ff7f027a864f5c2879375cd370579ddb2391a8c269fb04274080427a6225 not found: ID does not exist"
Sep 14 11:17:42.949801 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.949768    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"]
Sep 14 11:17:42.951608 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.951584    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/auth-test-model-0fb86d-kserve-7cf85cc8dc-wxq8n"]
Sep 14 11:17:42.985077 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.985043    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkc8z\" (UniqueName: \"kubernetes.io/projected/d8d99194-1bbb-42a7-983a-fa1f02e836f6-kube-api-access-dkc8z\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:42.985077 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.985070    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d99194-1bbb-42a7-983a-fa1f02e836f6-tls-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:42.985077 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:42.985080    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8d99194-1bbb-42a7-983a-fa1f02e836f6-dshm\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:43.259298 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:43.259269    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:44.056528 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:44.056494    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:44.560822 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:44.560789    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8d99194-1bbb-42a7-983a-fa1f02e836f6" path="/var/lib/kubelet/pods/d8d99194-1bbb-42a7-983a-fa1f02e836f6/volumes"
Sep 14 11:17:48.503414 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:48.503379    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:48.611196 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:48.611153    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:48.788681 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:48.788587    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"]
Sep 14 11:17:48.788831 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:48.788801    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy" containerID="cri-o://84f9dbcf86c155e5413ab01e4277079465426b0262e7b1a4d1a3eafbf980738a" gracePeriod=30
Sep 14 11:17:48.826610 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:48.826576    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:49.467188 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:49.467154    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:50.634282 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:50.634241    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:51.962924 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:51.962879    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:53.186271 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:53.186233    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:53.978711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:53.978681    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerID="84f9dbcf86c155e5413ab01e4277079465426b0262e7b1a4d1a3eafbf980738a" exitCode=0
Sep 14 11:17:53.978891 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:53.978731    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" event={"ID":"b3f11681-9cd2-4524-bc8e-cc2080496e90","Type":"ContainerDied","Data":"84f9dbcf86c155e5413ab01e4277079465426b0262e7b1a4d1a3eafbf980738a"}
Sep 14 11:17:53.978891 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:53.978803    2576 scope.go:117] "RemoveContainer" containerID="ffaf3d8f5ec8e7889f327eba59442be29aac695db0c6e1836d428d8e49c0d41d"
Sep 14 11:17:54.040897 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.040867    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:17:54.190144 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190050    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-certs\") pod \"b3f11681-9cd2-4524-bc8e-cc2080496e90\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") "
Sep 14 11:17:54.190144 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190135    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-credential-socket\") pod \"b3f11681-9cd2-4524-bc8e-cc2080496e90\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") "
Sep 14 11:17:54.190636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190158    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3f11681-9cd2-4524-bc8e-cc2080496e90-istiod-ca-cert\") pod \"b3f11681-9cd2-4524-bc8e-cc2080496e90\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") "
Sep 14 11:17:54.190636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190180    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-podinfo\") pod \"b3f11681-9cd2-4524-bc8e-cc2080496e90\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") "
Sep 14 11:17:54.190636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190243    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-socket\") pod \"b3f11681-9cd2-4524-bc8e-cc2080496e90\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") "
Sep 14 11:17:54.190636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190279    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6cct\" (UniqueName: \"kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-kube-api-access-c6cct\") pod \"b3f11681-9cd2-4524-bc8e-cc2080496e90\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") "
Sep 14 11:17:54.190636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190316    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-token\") pod \"b3f11681-9cd2-4524-bc8e-cc2080496e90\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") "
Sep 14 11:17:54.190636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190333    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3f11681-9cd2-4524-bc8e-cc2080496e90" (UID: "b3f11681-9cd2-4524-bc8e-cc2080496e90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:54.190636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190357    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-data\") pod \"b3f11681-9cd2-4524-bc8e-cc2080496e90\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") "
Sep 14 11:17:54.190636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190387    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-envoy\") pod \"b3f11681-9cd2-4524-bc8e-cc2080496e90\" (UID: \"b3f11681-9cd2-4524-bc8e-cc2080496e90\") "
Sep 14 11:17:54.190636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190449    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3f11681-9cd2-4524-bc8e-cc2080496e90" (UID: "b3f11681-9cd2-4524-bc8e-cc2080496e90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:54.190636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190617    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3f11681-9cd2-4524-bc8e-cc2080496e90" (UID: "b3f11681-9cd2-4524-bc8e-cc2080496e90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:54.191192 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190670    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3f11681-9cd2-4524-bc8e-cc2080496e90" (UID: "b3f11681-9cd2-4524-bc8e-cc2080496e90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:54.191192 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190695    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3f11681-9cd2-4524-bc8e-cc2080496e90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3f11681-9cd2-4524-bc8e-cc2080496e90" (UID: "b3f11681-9cd2-4524-bc8e-cc2080496e90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:17:54.191192 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190732    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-data\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:54.191192 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190751    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:54.191192 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.190765    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-credential-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:54.192623 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.192594    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3f11681-9cd2-4524-bc8e-cc2080496e90" (UID: "b3f11681-9cd2-4524-bc8e-cc2080496e90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:17:54.192623 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.192598    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3f11681-9cd2-4524-bc8e-cc2080496e90" (UID: "b3f11681-9cd2-4524-bc8e-cc2080496e90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:17:54.192794 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.192632    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3f11681-9cd2-4524-bc8e-cc2080496e90" (UID: "b3f11681-9cd2-4524-bc8e-cc2080496e90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 11:17:54.192794 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.192762    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-kube-api-access-c6cct" (OuterVolumeSpecName: "kube-api-access-c6cct") pod "b3f11681-9cd2-4524-bc8e-cc2080496e90" (UID: "b3f11681-9cd2-4524-bc8e-cc2080496e90"). InnerVolumeSpecName "kube-api-access-c6cct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:17:54.291532 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.291496    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3f11681-9cd2-4524-bc8e-cc2080496e90-istiod-ca-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:54.291532 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.291525    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-podinfo\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:54.291532 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.291534    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-workload-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:54.291841 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.291544    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6cct\" (UniqueName: \"kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-kube-api-access-c6cct\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:54.291841 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.291554    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:54.291841 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.291562    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3f11681-9cd2-4524-bc8e-cc2080496e90-istio-envoy\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:17:54.292808 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.292784    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:54.985072 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.985033    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"
Sep 14 11:17:54.985221 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.985041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh" event={"ID":"b3f11681-9cd2-4524-bc8e-cc2080496e90","Type":"ContainerDied","Data":"036bf25b50a46513c684f21c66dc976181353467dcb05ad546cc0e8154b76987"}
Sep 14 11:17:54.985221 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:54.985166    2576 scope.go:117] "RemoveContainer" containerID="84f9dbcf86c155e5413ab01e4277079465426b0262e7b1a4d1a3eafbf980738a"
Sep 14 11:17:55.010762 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:55.010732    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"]
Sep 14 11:17:55.019095 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:55.019062    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh"]
Sep 14 11:17:56.560968 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:56.560934    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" path="/var/lib/kubelet/pods/b3f11681-9cd2-4524-bc8e-cc2080496e90/volumes"
Sep 14 11:17:57.803143 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803109    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"]
Sep 14 11:17:57.803608 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803535    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df8b6d59-2a6b-4e4f-9ad6-9b9689f80396" containerName="payload-processing"
Sep 14 11:17:57.803608 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803553    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="df8b6d59-2a6b-4e4f-9ad6-9b9689f80396" containerName="payload-processing"
Sep 14 11:17:57.803608 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803571    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d99194-1bbb-42a7-983a-fa1f02e836f6" containerName="main"
Sep 14 11:17:57.803608 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803581    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d99194-1bbb-42a7-983a-fa1f02e836f6" containerName="main"
Sep 14 11:17:57.803608 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803591    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy"
Sep 14 11:17:57.803608 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803600    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy"
Sep 14 11:17:57.803608 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803609    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f060fc98-91ae-4ff8-8bad-e10456d559b8" containerName="payload-pre-processing"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803620    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f060fc98-91ae-4ff8-8bad-e10456d559b8" containerName="payload-pre-processing"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803638    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803660    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803670    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803675    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803689    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d836414-fc27-4e4b-b545-b8f5e9dfa743" containerName="payload-pre-processing"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803695    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d836414-fc27-4e4b-b545-b8f5e9dfa743" containerName="payload-pre-processing"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803769    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803778    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803785    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f060fc98-91ae-4ff8-8bad-e10456d559b8" containerName="payload-pre-processing"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803794    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d99194-1bbb-42a7-983a-fa1f02e836f6" containerName="main"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803803    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803811    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="df8b6d59-2a6b-4e4f-9ad6-9b9689f80396" containerName="payload-processing"
Sep 14 11:17:57.804064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.803819    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d836414-fc27-4e4b-b545-b8f5e9dfa743" containerName="payload-pre-processing"
Sep 14 11:17:57.808637 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.808617    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:57.813633 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.813603    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"sub-test-model-0fb86d-kserve-self-signed-certs\""
Sep 14 11:17:57.813795 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.813603    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"kube-root-ca.crt\""
Sep 14 11:17:57.813795 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.813694    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"default-dockercfg-dgnjk\""
Sep 14 11:17:57.818482 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.818464    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"openshift-service-ca.crt\""
Sep 14 11:17:57.835473 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.835442    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"]
Sep 14 11:17:57.863294 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.863268    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:57.925948 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.925915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-home\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:57.925948 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.925951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-model-cache\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:57.926180 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.926037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlqll\" (UniqueName: \"kubernetes.io/projected/46190973-c17c-4300-81e7-62e8056b7aad-kube-api-access-zlqll\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:57.926180 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.926060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-dshm\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:57.926180 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.926076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46190973-c17c-4300-81e7-62e8056b7aad-tls-certs\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:57.926180 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:57.926103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-tmp-dir\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.027359 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.027328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-home\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.027359 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.027361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-model-cache\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.027605 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.027425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqll\" (UniqueName: \"kubernetes.io/projected/46190973-c17c-4300-81e7-62e8056b7aad-kube-api-access-zlqll\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.027605 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.027450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-dshm\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.027605 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.027469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46190973-c17c-4300-81e7-62e8056b7aad-tls-certs\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.027777 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.027606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-tmp-dir\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.027846 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.027816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-home\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.027897 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.027867    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-model-cache\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.027961 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.027946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-tmp-dir\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.029798 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.029773    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-dshm\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.030073 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.030056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46190973-c17c-4300-81e7-62e8056b7aad-tls-certs\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.041387 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.041361    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlqll\" (UniqueName: \"kubernetes.io/projected/46190973-c17c-4300-81e7-62e8056b7aad-kube-api-access-zlqll\") pod \"sub-test-model-0fb86d-kserve-7594fbb699-rsthf\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.117583 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.117493    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:17:58.392475 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:58.392449    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"]
Sep 14 11:17:58.394451 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:17:58.394428    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46190973_c17c_4300_81e7_62e8056b7aad.slice/crio-8c00d4a53201955109efb0e1408b17371ccb050a2a67bfee016b394e3c32a61b WatchSource:0}: Error finding container 8c00d4a53201955109efb0e1408b17371ccb050a2a67bfee016b394e3c32a61b: Status 404 returned error can't find the container with id 8c00d4a53201955109efb0e1408b17371ccb050a2a67bfee016b394e3c32a61b
Sep 14 11:17:59.008216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:59.008180    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf" event={"ID":"46190973-c17c-4300-81e7-62e8056b7aad","Type":"ContainerStarted","Data":"3713fd3b0416c12234927fde830103bd231be17bbc2d94c549220c60ede20af9"}
Sep 14 11:17:59.008605 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:59.008227    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf" event={"ID":"46190973-c17c-4300-81e7-62e8056b7aad","Type":"ContainerStarted","Data":"8c00d4a53201955109efb0e1408b17371ccb050a2a67bfee016b394e3c32a61b"}
Sep 14 11:17:59.041127 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:59.041079    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf" podStartSLOduration=2.04106109 podStartE2EDuration="2.04106109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:17:59.040693007 +0000 UTC m=+1739.021328511" watchObservedRunningTime="2026-09-14 11:17:59.04106109 +0000 UTC m=+1739.021696644"
Sep 14 11:17:59.840373 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:59.840343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:17:59.844236 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:59.844214    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw"]
Sep 14 11:17:59.847934 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:59.847911    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-22b014-29823075-p4krw"]
Sep 14 11:17:59.883358 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:59.883328    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"]
Sep 14 11:17:59.883559 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:59.883534    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t" podUID="c287e963-5491-40b3-b564-b1f7b81233d5" containerName="payload-processing" containerID="cri-o://97b45fb17b46e6601a5024c015eee36bd5a5cd3a7c8adb345e04871df94c7a01" gracePeriod=30
Sep 14 11:17:59.971064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:17:59.971021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:00.016036 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.016007    2576 generic.go:356] "Generic (PLEG): container finished" podID="c287e963-5491-40b3-b564-b1f7b81233d5" containerID="97b45fb17b46e6601a5024c015eee36bd5a5cd3a7c8adb345e04871df94c7a01" exitCode=0
Sep 14 11:18:00.016408 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.016075    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t" event={"ID":"c287e963-5491-40b3-b564-b1f7b81233d5","Type":"ContainerDied","Data":"97b45fb17b46e6601a5024c015eee36bd5a5cd3a7c8adb345e04871df94c7a01"}
Sep 14 11:18:00.081983 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.081903    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:00.140690 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.140666    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:18:00.214260 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.214224    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:00.251067 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.251035    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c287e963-5491-40b3-b564-b1f7b81233d5-plugins-config-volume\") pod \"c287e963-5491-40b3-b564-b1f7b81233d5\" (UID: \"c287e963-5491-40b3-b564-b1f7b81233d5\") "
Sep 14 11:18:00.251263 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.251105    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz72s\" (UniqueName: \"kubernetes.io/projected/c287e963-5491-40b3-b564-b1f7b81233d5-kube-api-access-nz72s\") pod \"c287e963-5491-40b3-b564-b1f7b81233d5\" (UID: \"c287e963-5491-40b3-b564-b1f7b81233d5\") "
Sep 14 11:18:00.251449 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.251426    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c287e963-5491-40b3-b564-b1f7b81233d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c287e963-5491-40b3-b564-b1f7b81233d5" (UID: "c287e963-5491-40b3-b564-b1f7b81233d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:18:00.253273 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.253249    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c287e963-5491-40b3-b564-b1f7b81233d5-kube-api-access-nz72s" (OuterVolumeSpecName: "kube-api-access-nz72s") pod "c287e963-5491-40b3-b564-b1f7b81233d5" (UID: "c287e963-5491-40b3-b564-b1f7b81233d5"). InnerVolumeSpecName "kube-api-access-nz72s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:18:00.352048 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.352017    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c287e963-5491-40b3-b564-b1f7b81233d5-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:18:00.352048 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.352042    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz72s\" (UniqueName: \"kubernetes.io/projected/c287e963-5491-40b3-b564-b1f7b81233d5-kube-api-access-nz72s\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:18:00.558265 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.558230    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:00.559963 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.559933    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4677ce7b-dfab-4f42-8e9e-71432d6579da" path="/var/lib/kubelet/pods/4677ce7b-dfab-4f42-8e9e-71432d6579da/volumes"
Sep 14 11:18:00.709663 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.709623    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:00.722949 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:00.722917    2576 scope.go:117] "RemoveContainer" containerID="97b45fb17b46e6601a5024c015eee36bd5a5cd3a7c8adb345e04871df94c7a01"
Sep 14 11:18:01.020791 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:01.020751    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t" event={"ID":"c287e963-5491-40b3-b564-b1f7b81233d5","Type":"ContainerDied","Data":"35d8c2fa8f5fc6a8d37869bf81aa6e4376f78abed922974179419dabc99dd037"}
Sep 14 11:18:01.021232 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:01.020813    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"
Sep 14 11:18:01.066624 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:01.066589    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"]
Sep 14 11:18:01.072261 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:01.072235    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t"]
Sep 14 11:18:02.560184 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:02.560144    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c287e963-5491-40b3-b564-b1f7b81233d5" path="/var/lib/kubelet/pods/c287e963-5491-40b3-b564-b1f7b81233d5/volumes"
Sep 14 11:18:03.083112 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:03.083077    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:03.232514 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:03.232482    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:07.299346 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:07.299308    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:07.392819 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:07.392788    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:07.569181 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:07.569104    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:08.117848 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:08.117808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:18:08.118073 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:08.117954    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:18:08.130255 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:08.130224    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:18:09.069038 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:09.069013    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:18:43.152925 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:43.152894    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:44.075187 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:44.075151    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"]
Sep 14 11:18:44.092233 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:44.092203    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:50.854216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:50.854179    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:18:59.094105 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.094065    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf" podUID="46190973-c17c-4300-81e7-62e8056b7aad" containerName="main" containerID="cri-o://3713fd3b0416c12234927fde830103bd231be17bbc2d94c549220c60ede20af9" gracePeriod=45
Sep 14 11:18:59.299275 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.299243    2576 generic.go:356] "Generic (PLEG): container finished" podID="46190973-c17c-4300-81e7-62e8056b7aad" containerID="3713fd3b0416c12234927fde830103bd231be17bbc2d94c549220c60ede20af9" exitCode=0
Sep 14 11:18:59.299437 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.299328    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf" event={"ID":"46190973-c17c-4300-81e7-62e8056b7aad","Type":"ContainerDied","Data":"3713fd3b0416c12234927fde830103bd231be17bbc2d94c549220c60ede20af9"}
Sep 14 11:18:59.352057 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.352002    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:18:59.390107 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.390081    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-tmp-dir\") pod \"46190973-c17c-4300-81e7-62e8056b7aad\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") "
Sep 14 11:18:59.390263 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.390157    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-home\") pod \"46190973-c17c-4300-81e7-62e8056b7aad\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") "
Sep 14 11:18:59.390263 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.390224    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-model-cache\") pod \"46190973-c17c-4300-81e7-62e8056b7aad\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") "
Sep 14 11:18:59.390263 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.390251    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlqll\" (UniqueName: \"kubernetes.io/projected/46190973-c17c-4300-81e7-62e8056b7aad-kube-api-access-zlqll\") pod \"46190973-c17c-4300-81e7-62e8056b7aad\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") "
Sep 14 11:18:59.390417 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.390270    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-dshm\") pod \"46190973-c17c-4300-81e7-62e8056b7aad\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") "
Sep 14 11:18:59.390417 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.390288    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46190973-c17c-4300-81e7-62e8056b7aad-tls-certs\") pod \"46190973-c17c-4300-81e7-62e8056b7aad\" (UID: \"46190973-c17c-4300-81e7-62e8056b7aad\") "
Sep 14 11:18:59.390417 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.390371    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "46190973-c17c-4300-81e7-62e8056b7aad" (UID: "46190973-c17c-4300-81e7-62e8056b7aad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:18:59.390417 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.390396    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-home" (OuterVolumeSpecName: "home") pod "46190973-c17c-4300-81e7-62e8056b7aad" (UID: "46190973-c17c-4300-81e7-62e8056b7aad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:18:59.390627 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.390505    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-tmp-dir\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:18:59.390627 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.390553    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-home\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:18:59.390627 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.390609    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-model-cache" (OuterVolumeSpecName: "model-cache") pod "46190973-c17c-4300-81e7-62e8056b7aad" (UID: "46190973-c17c-4300-81e7-62e8056b7aad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:18:59.392484 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.392450    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46190973-c17c-4300-81e7-62e8056b7aad-kube-api-access-zlqll" (OuterVolumeSpecName: "kube-api-access-zlqll") pod "46190973-c17c-4300-81e7-62e8056b7aad" (UID: "46190973-c17c-4300-81e7-62e8056b7aad"). InnerVolumeSpecName "kube-api-access-zlqll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:18:59.392484 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.392456    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46190973-c17c-4300-81e7-62e8056b7aad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "46190973-c17c-4300-81e7-62e8056b7aad" (UID: "46190973-c17c-4300-81e7-62e8056b7aad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:18:59.392636 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.392510    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-dshm" (OuterVolumeSpecName: "dshm") pod "46190973-c17c-4300-81e7-62e8056b7aad" (UID: "46190973-c17c-4300-81e7-62e8056b7aad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:18:59.491192 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.491160    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-model-cache\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:18:59.491192 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.491186    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlqll\" (UniqueName: \"kubernetes.io/projected/46190973-c17c-4300-81e7-62e8056b7aad-kube-api-access-zlqll\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:18:59.491192 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.491196    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46190973-c17c-4300-81e7-62e8056b7aad-dshm\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:18:59.491411 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:18:59.491205    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46190973-c17c-4300-81e7-62e8056b7aad-tls-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:19:00.305310 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:00.305278    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"
Sep 14 11:19:00.305798 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:00.305316    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf" event={"ID":"46190973-c17c-4300-81e7-62e8056b7aad","Type":"ContainerDied","Data":"8c00d4a53201955109efb0e1408b17371ccb050a2a67bfee016b394e3c32a61b"}
Sep 14 11:19:00.305798 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:00.305368    2576 scope.go:117] "RemoveContainer" containerID="3713fd3b0416c12234927fde830103bd231be17bbc2d94c549220c60ede20af9"
Sep 14 11:19:00.328464 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:00.328439    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"]
Sep 14 11:19:00.338145 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:00.338120    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/sub-test-model-0fb86d-kserve-7594fbb699-rsthf"]
Sep 14 11:19:00.561931 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:00.561853    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46190973-c17c-4300-81e7-62e8056b7aad" path="/var/lib/kubelet/pods/46190973-c17c-4300-81e7-62e8056b7aad/volumes"
Sep 14 11:19:12.563000 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.562969    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"]
Sep 14 11:19:12.563515 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.563326    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy"
Sep 14 11:19:12.563515 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.563336    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5900dd06-ce41-4947-957f-c621b4b2f82d" containerName="istio-proxy"
Sep 14 11:19:12.563515 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.563348    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46190973-c17c-4300-81e7-62e8056b7aad" containerName="main"
Sep 14 11:19:12.563515 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.563354    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46190973-c17c-4300-81e7-62e8056b7aad" containerName="main"
Sep 14 11:19:12.563515 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.563381    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c287e963-5491-40b3-b564-b1f7b81233d5" containerName="payload-processing"
Sep 14 11:19:12.563515 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.563389    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c287e963-5491-40b3-b564-b1f7b81233d5" containerName="payload-processing"
Sep 14 11:19:12.563515 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.563459    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3f11681-9cd2-4524-bc8e-cc2080496e90" containerName="istio-proxy"
Sep 14 11:19:12.563515 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.563469    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c287e963-5491-40b3-b564-b1f7b81233d5" containerName="payload-processing"
Sep 14 11:19:12.563515 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.563477    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="46190973-c17c-4300-81e7-62e8056b7aad" containerName="main"
Sep 14 11:19:12.566483 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.566464    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.568833 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.568810    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"openshift-service-ca.crt\""
Sep 14 11:19:12.568952 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.568904    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"default-dockercfg-dgnjk\""
Sep 14 11:19:12.569877 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.569857    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"kube-root-ca.crt\""
Sep 14 11:19:12.570031 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.570014    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-0fb86d\"/\"rate-test-model-0fb86d-kserve-self-signed-certs\""
Sep 14 11:19:12.579998 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.579970    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"]
Sep 14 11:19:12.603972 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.603930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:19:12.611052 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.611018    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tmp-dir\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.611211 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.611059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldxcs\" (UniqueName: \"kubernetes.io/projected/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-kube-api-access-ldxcs\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.611211 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.611138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tls-certs\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.611211 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.611175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-model-cache\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.611211 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.611200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-dshm\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.611440 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.611270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-home\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.712472 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.712284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-dshm\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.712472 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.712376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-home\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.712472 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.712421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tmp-dir\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.712472 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.712451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldxcs\" (UniqueName: \"kubernetes.io/projected/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-kube-api-access-ldxcs\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.712914 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.712873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tls-certs\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.712971 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.712930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-model-cache\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.713142 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.713118    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-home\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.713481 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.713458    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tmp-dir\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.713717 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.713692    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-model-cache\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.715694 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.715617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-dshm\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.716395 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.716368    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tls-certs\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.721235 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.721211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldxcs\" (UniqueName: \"kubernetes.io/projected/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-kube-api-access-ldxcs\") pod \"rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") " pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:12.875905 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:12.875814    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:13.152473 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:13.152395    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"]
Sep 14 11:19:13.155238 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:19:13.155212    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4315e33f_ecc6_4db8_b9cc_dd3fe0e11fda.slice/crio-5d77b8e027451b0db5004730d7686d3295c52c9be997daab75b062bc3a7ef993 WatchSource:0}: Error finding container 5d77b8e027451b0db5004730d7686d3295c52c9be997daab75b062bc3a7ef993: Status 404 returned error can't find the container with id 5d77b8e027451b0db5004730d7686d3295c52c9be997daab75b062bc3a7ef993
Sep 14 11:19:13.366386 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:13.366349    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp" event={"ID":"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda","Type":"ContainerStarted","Data":"165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6"}
Sep 14 11:19:13.366577 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:13.366396    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp" event={"ID":"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda","Type":"ContainerStarted","Data":"5d77b8e027451b0db5004730d7686d3295c52c9be997daab75b062bc3a7ef993"}
Sep 14 11:19:13.388091 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:13.388030    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp" podStartSLOduration=1.388012776 podStartE2EDuration="1.388012776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:19:13.386257828 +0000 UTC m=+1813.366893333" watchObservedRunningTime="2026-09-14 11:19:13.388012776 +0000 UTC m=+1813.368648281"
Sep 14 11:19:22.876737 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:22.876682    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:22.876737 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:22.876755    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:22.889291 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:22.889269    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:23.423568 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:23.423535    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:19:52.620602 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:52.620567    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:19:53.552517 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:53.552479    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"]
Sep 14 11:19:53.892911 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:53.892830    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:19:54.000860 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.000826    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:19:54.315432 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.315396    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"]
Sep 14 11:19:54.319015 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.318997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.323819 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.323798    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-bf45e0-openshift-default-dockercfg-gdl2p\""
Sep 14 11:19:54.340919 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.340886    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"]
Sep 14 11:19:54.349123 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.349090    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:19:54.386706 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.386643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-socket\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.386873 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.386764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-data\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.386873 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.386836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-token\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.386873 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.386863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-certs\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.387000 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.386901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-envoy\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.387000 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.386922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istiod-ca-cert\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.387000 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.386975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptv5c\" (UniqueName: \"kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-kube-api-access-ptv5c\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.387000 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.386997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-credential-socket\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.387194 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.387012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-podinfo\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.487491 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.487452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-token\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.487491 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.487492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-certs\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.487791 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.487518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-envoy\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.487791 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.487535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istiod-ca-cert\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.487791 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.487566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptv5c\" (UniqueName: \"kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-kube-api-access-ptv5c\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.487791 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.487592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-credential-socket\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.487791 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.487610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-podinfo\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.487791 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.487636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-socket\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.487791 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.487759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-data\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.488162 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.488012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-certs\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.488162 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.488056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-credential-socket\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.488162 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.488092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-data\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.488274 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.488157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-socket\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.488566 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.488550    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istiod-ca-cert\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.490356 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.490333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-envoy\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.490574 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.490556    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-podinfo\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.503146 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.503114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptv5c\" (UniqueName: \"kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-kube-api-access-ptv5c\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.504052 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.504035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-token\") pod \"e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") " pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.523489 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.523464    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:19:54.630855 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.630759    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:54.920989 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.920963    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"]
Sep 14 11:19:54.923002 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:19:54.922979    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1dac43_37df_4ab1_b75f_71a951ef2d7e.slice/crio-623e5ab2a7d697f19be01d2209acbae9ce65209fd94cb088a67c5dd53ace2a0d WatchSource:0}: Error finding container 623e5ab2a7d697f19be01d2209acbae9ce65209fd94cb088a67c5dd53ace2a0d: Status 404 returned error can't find the container with id 623e5ab2a7d697f19be01d2209acbae9ce65209fd94cb088a67c5dd53ace2a0d
Sep 14 11:19:54.925160 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.925127    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:19:54.925254 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.925193    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:19:54.925254 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:54.925221    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:19:55.570128 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:55.570090    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" event={"ID":"4f1dac43-37df-4ab1-b75f-71a951ef2d7e","Type":"ContainerStarted","Data":"22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3"}
Sep 14 11:19:55.570339 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:55.570186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" event={"ID":"4f1dac43-37df-4ab1-b75f-71a951ef2d7e","Type":"ContainerStarted","Data":"623e5ab2a7d697f19be01d2209acbae9ce65209fd94cb088a67c5dd53ace2a0d"}
Sep 14 11:19:55.596485 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:55.596433    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" podStartSLOduration=1.596416646 podStartE2EDuration="1.596416646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:19:55.595038513 +0000 UTC m=+1855.575674017" watchObservedRunningTime="2026-09-14 11:19:55.596416646 +0000 UTC m=+1855.577052151"
Sep 14 11:19:55.631849 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:55.631811    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:55.636694 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:55.636670    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:56.577741 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:56.577144    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:56.578881 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:56.578852    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:19:57.048079 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:57.048038    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:19:57.709254 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:57.709215    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:19:57.806616 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:57.806558    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:19:57.989346 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:57.989314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:19:59.110579 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:19:59.110534    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:00.048794 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:00.048762    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:00.153118 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:00.153088    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:00.250165 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:00.250133    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:00.832413 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:00.832375    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:00.965996 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:00.965955    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:01.060125 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.060090    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"]
Sep 14 11:20:01.064214 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.064193    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:20:01.067502 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.067479    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-bf45e0\""
Sep 14 11:20:01.068377 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.068360    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-bf45e0-dockercfg-c7xhd\""
Sep 14 11:20:01.085725 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.085628    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"]
Sep 14 11:20:01.151926 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.151890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdj45\" (UniqueName: \"kubernetes.io/projected/3fa63a57-365d-4de7-95cb-3c45fb910138-kube-api-access-wdj45\") pod \"payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl\" (UID: \"3fa63a57-365d-4de7-95cb-3c45fb910138\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:20:01.152113 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.151957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fa63a57-365d-4de7-95cb-3c45fb910138-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl\" (UID: \"3fa63a57-365d-4de7-95cb-3c45fb910138\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:20:01.252884 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.252849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdj45\" (UniqueName: \"kubernetes.io/projected/3fa63a57-365d-4de7-95cb-3c45fb910138-kube-api-access-wdj45\") pod \"payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl\" (UID: \"3fa63a57-365d-4de7-95cb-3c45fb910138\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:20:01.253337 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.252914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fa63a57-365d-4de7-95cb-3c45fb910138-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl\" (UID: \"3fa63a57-365d-4de7-95cb-3c45fb910138\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:20:01.253681 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.253657    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fa63a57-365d-4de7-95cb-3c45fb910138-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl\" (UID: \"3fa63a57-365d-4de7-95cb-3c45fb910138\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:20:01.265606 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.265575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdj45\" (UniqueName: \"kubernetes.io/projected/3fa63a57-365d-4de7-95cb-3c45fb910138-kube-api-access-wdj45\") pod \"payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl\" (UID: \"3fa63a57-365d-4de7-95cb-3c45fb910138\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:20:01.375699 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.375593    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:20:01.655602 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:01.655574    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"]
Sep 14 11:20:01.658355 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:20:01.658330    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa63a57_365d_4de7_95cb_3c45fb910138.slice/crio-e13140bdc5ef477467cba53b05ad9bce8c5dfa4efd0f61a0188f7cc1535cebe2 WatchSource:0}: Error finding container e13140bdc5ef477467cba53b05ad9bce8c5dfa4efd0f61a0188f7cc1535cebe2: Status 404 returned error can't find the container with id e13140bdc5ef477467cba53b05ad9bce8c5dfa4efd0f61a0188f7cc1535cebe2
Sep 14 11:20:02.610260 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:02.610220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl" event={"ID":"3fa63a57-365d-4de7-95cb-3c45fb910138","Type":"ContainerStarted","Data":"252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e"}
Sep 14 11:20:02.610700 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:02.610288    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl" event={"ID":"3fa63a57-365d-4de7-95cb-3c45fb910138","Type":"ContainerStarted","Data":"e13140bdc5ef477467cba53b05ad9bce8c5dfa4efd0f61a0188f7cc1535cebe2"}
Sep 14 11:20:02.610700 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:02.610322    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:20:02.638976 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:02.638927    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl" podStartSLOduration=1.638910307 podStartE2EDuration="1.638910307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:20:02.63745007 +0000 UTC m=+1862.618085581" watchObservedRunningTime="2026-09-14 11:20:02.638910307 +0000 UTC m=+1862.619545812"
Sep 14 11:20:08.573254 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.573209    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp" podUID="4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" containerName="main" containerID="cri-o://165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6" gracePeriod=45
Sep 14 11:20:08.855439 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.855411    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:20:08.935493 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.935460    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-dshm\") pod \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") "
Sep 14 11:20:08.935688 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.935516    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tmp-dir\") pod \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") "
Sep 14 11:20:08.935688 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.935536    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-home\") pod \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") "
Sep 14 11:20:08.935688 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.935595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-model-cache\") pod \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") "
Sep 14 11:20:08.935688 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.935671    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldxcs\" (UniqueName: \"kubernetes.io/projected/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-kube-api-access-ldxcs\") pod \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") "
Sep 14 11:20:08.935889 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.935693    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tls-certs\") pod \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\" (UID: \"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda\") "
Sep 14 11:20:08.935889 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.935871    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" (UID: "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:20:08.935996 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.935895    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-home" (OuterVolumeSpecName: "home") pod "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" (UID: "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:20:08.935996 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.935974    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-model-cache" (OuterVolumeSpecName: "model-cache") pod "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" (UID: "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:20:08.937922 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.937867    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-dshm" (OuterVolumeSpecName: "dshm") pod "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" (UID: "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:20:08.937922 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.937897    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-kube-api-access-ldxcs" (OuterVolumeSpecName: "kube-api-access-ldxcs") pod "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" (UID: "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda"). InnerVolumeSpecName "kube-api-access-ldxcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:20:08.938110 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:08.937979    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" (UID: "4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:20:09.037308 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.037269    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-dshm\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:20:09.037308 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.037301    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tmp-dir\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:20:09.037308 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.037311    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-home\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:20:09.037308 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.037319    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-model-cache\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:20:09.037586 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.037329    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldxcs\" (UniqueName: \"kubernetes.io/projected/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-kube-api-access-ldxcs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:20:09.037586 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.037337    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda-tls-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:20:09.647411 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.647337    2576 generic.go:356] "Generic (PLEG): container finished" podID="4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" containerID="165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6" exitCode=0
Sep 14 11:20:09.647411 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.647385    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"
Sep 14 11:20:09.647845 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.647385    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp" event={"ID":"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda","Type":"ContainerDied","Data":"165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6"}
Sep 14 11:20:09.647845 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.647506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp" event={"ID":"4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda","Type":"ContainerDied","Data":"5d77b8e027451b0db5004730d7686d3295c52c9be997daab75b062bc3a7ef993"}
Sep 14 11:20:09.647845 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.647532    2576 scope.go:117] "RemoveContainer" containerID="165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6"
Sep 14 11:20:09.657106 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.657091    2576 scope.go:117] "RemoveContainer" containerID="165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6"
Sep 14 11:20:09.657382 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:20:09.657363    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6\": container with ID starting with 165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6 not found: ID does not exist" containerID="165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6"
Sep 14 11:20:09.657422 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.657391    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6"} err="failed to get container status \"165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6\": rpc error: code = NotFound desc = could not find container \"165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6\": container with ID starting with 165b8f96a9fd05b83be3dbc4e5df00474d1fa33b2e4a8c10bb18a457b85759a6 not found: ID does not exist"
Sep 14 11:20:09.671778 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.671746    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"]
Sep 14 11:20:09.677027 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:09.676994    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-0fb86d/rate-test-model-0fb86d-kserve-755cd7b5c9-zj7qp"]
Sep 14 11:20:10.560706 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:10.560673    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" path="/var/lib/kubelet/pods/4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda/volumes"
Sep 14 11:20:12.619835 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:12.619800    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 14 11:20:12.620232 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:12.619871    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 14 11:20:13.619865 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:13.619789    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:20:13.677400 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:13.677318    2576 generic.go:356] "Generic (PLEG): container finished" podID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerID="22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3" exitCode=0
Sep 14 11:20:13.677400 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:13.677385    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" event={"ID":"4f1dac43-37df-4ab1-b75f-71a951ef2d7e","Type":"ContainerDied","Data":"22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3"}
Sep 14 11:20:13.677902 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:13.677884    2576 scope.go:117] "RemoveContainer" containerID="22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3"
Sep 14 11:20:13.679062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:13.679029    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:20:13.679164 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:13.679096    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:20:13.679164 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:13.679130    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:20:14.687217 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:14.687175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" event={"ID":"4f1dac43-37df-4ab1-b75f-71a951ef2d7e","Type":"ContainerStarted","Data":"93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74"}
Sep 14 11:20:15.631727 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:15.631693    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:20:15.631966 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:15.631947    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 14 11:20:15.632015 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:15.631988    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 14 11:20:16.631203 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:16.631160    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 14 11:20:16.631711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:16.631229    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 14 11:20:17.632046 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:17.632010    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 14 11:20:17.632435 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:17.632064    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 14 11:20:18.183623 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:18.183584    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:18.631232 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:18.631185    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 14 11:20:18.631414 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:18.631252    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 14 11:20:19.631163 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:19.631130    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 14 11:20:19.631576 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:19.631185    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 14 11:20:20.634700 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:20.634671    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:20:20.635093 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:20.634940    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:20:20.635712 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:20.635695    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:20:22.536279 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:22.536246    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:22.636581 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:22.636552    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:23.192385 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:23.192305    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:23.347426 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:23.347392    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:23.626340 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:23.626307    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:23.784934 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:23.784902    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:24.212549 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:24.212519    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:25.086089 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:25.086055    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:26.824431 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:26.824396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:27.025048 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:27.025002    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:27.126349 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:27.126257    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:27.880242 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:27.880207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:28.933054 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:28.933020    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:30.087111 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.087080    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:30.184999 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.184929    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:30.314852 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.314803    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:30.616877 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.616837    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:30.715267 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.715239    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:30.747341 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.747308    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"]
Sep 14 11:20:30.747690 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.747675    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" containerName="main"
Sep 14 11:20:30.747690 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.747689    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" containerName="main"
Sep 14 11:20:30.747778 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.747761    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4315e33f-ecc6-4db8-b9cc-dd3fe0e11fda" containerName="main"
Sep 14 11:20:30.751936 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.751914    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:20:30.755155 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.755127    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-a521b5\""
Sep 14 11:20:30.767880 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.767856    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"]
Sep 14 11:20:30.834628 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.834595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqg6w\" (UniqueName: \"kubernetes.io/projected/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-kube-api-access-nqg6w\") pod \"payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc\" (UID: \"7661b2f3-f1ec-46fd-963c-3de26e9c01d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:20:30.834825 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.834682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc\" (UID: \"7661b2f3-f1ec-46fd-963c-3de26e9c01d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:20:30.935972 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.935879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqg6w\" (UniqueName: \"kubernetes.io/projected/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-kube-api-access-nqg6w\") pod \"payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc\" (UID: \"7661b2f3-f1ec-46fd-963c-3de26e9c01d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:20:30.935972 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.935942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc\" (UID: \"7661b2f3-f1ec-46fd-963c-3de26e9c01d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:20:30.936625 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.936602    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc\" (UID: \"7661b2f3-f1ec-46fd-963c-3de26e9c01d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:20:30.943855 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:30.943830    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqg6w\" (UniqueName: \"kubernetes.io/projected/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-kube-api-access-nqg6w\") pod \"payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc\" (UID: \"7661b2f3-f1ec-46fd-963c-3de26e9c01d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:20:31.063046 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:31.063007    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:20:31.345928 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:31.345905    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"]
Sep 14 11:20:31.347664 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:20:31.347621    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7661b2f3_f1ec_46fd_963c_3de26e9c01d8.slice/crio-42ac5645c6db520b2b0d1549fa5f255af7c3cd5999e5eeb82a0eb0e82d42f6bb WatchSource:0}: Error finding container 42ac5645c6db520b2b0d1549fa5f255af7c3cd5999e5eeb82a0eb0e82d42f6bb: Status 404 returned error can't find the container with id 42ac5645c6db520b2b0d1549fa5f255af7c3cd5999e5eeb82a0eb0e82d42f6bb
Sep 14 11:20:31.780237 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:31.780200    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc" event={"ID":"7661b2f3-f1ec-46fd-963c-3de26e9c01d8","Type":"ContainerStarted","Data":"5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c"}
Sep 14 11:20:31.780429 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:31.780253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc" event={"ID":"7661b2f3-f1ec-46fd-963c-3de26e9c01d8","Type":"ContainerStarted","Data":"42ac5645c6db520b2b0d1549fa5f255af7c3cd5999e5eeb82a0eb0e82d42f6bb"}
Sep 14 11:20:31.780429 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:31.780276    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:20:38.871072 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:38.871038    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:42.790569 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:42.790531    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:20:42.810275 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:42.810212    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc" podStartSLOduration=12.810196333 podStartE2EDuration="12.810196333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:20:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:20:31.79475564 +0000 UTC m=+1891.775391145" watchObservedRunningTime="2026-09-14 11:20:42.810196333 +0000 UTC m=+1902.790831837"
Sep 14 11:20:51.071626 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:51.071594    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:52.468875 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:52.468835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:53.474260 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:53.474225    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:54.361443 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:54.361408    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:55.055998 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:55.055958    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:55.863681 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:55.863625    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:20:57.087233 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:20:57.087174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:02.063312 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:02.063266    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sqxlk_0c0c7a81-3670-439a-947d-4135b8c3d634/payload-processing/0.log"
Sep 14 11:21:11.364842 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:11.364810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:12.611351 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:12.611312    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:36.986838 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:36.986798    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:41.266023 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:41.265987    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:43.031914 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:43.031884    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl_3fa63a57-365d-4de7-95cb-3c45fb910138/payload-processing/0.log"
Sep 14 11:21:43.154440 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:43.154406    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sqxlk_0c0c7a81-3670-439a-947d-4135b8c3d634/payload-processing/0.log"
Sep 14 11:21:43.548127 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:43.548091    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:43.833530 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:43.833433    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"]
Sep 14 11:21:43.839026 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:43.839002    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:43.841286 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:43.841264    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-d5e418-openshift-default-dockercfg-rlknx\""
Sep 14 11:21:43.848561 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:43.848533    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"]
Sep 14 11:21:43.857007 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:43.856977    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:44.020830 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.020795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-istio-token\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.020830 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.020834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bda01fbe-ca98-45f7-92cc-447576482055-istio-podinfo\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.021130 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.020864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-envoy\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.021130 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.020968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-socket\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.021130 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.021024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jfnq\" (UniqueName: \"kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-kube-api-access-4jfnq\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.021130 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.021052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-certs\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.021130 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.021089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-data\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.021317 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.021149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-credential-socket\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.021317 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.021189    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bda01fbe-ca98-45f7-92cc-447576482055-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.024313 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.024276    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:44.122552 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.122464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-envoy\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.122552 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.122513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-socket\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.122552 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.122539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jfnq\" (UniqueName: \"kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-kube-api-access-4jfnq\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.123163 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.122559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-certs\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.123163 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.122585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-data\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.123163 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.122613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-credential-socket\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.123163 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.122671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bda01fbe-ca98-45f7-92cc-447576482055-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.123163 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.122755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-istio-token\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.123163 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.122780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bda01fbe-ca98-45f7-92cc-447576482055-istio-podinfo\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.123163 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.123032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-certs\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.123163 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.123083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-socket\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.123493 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.123470    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-data\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.123542 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.123481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bda01fbe-ca98-45f7-92cc-447576482055-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.123542 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.123474    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-credential-socket\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.124893 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.124875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-envoy\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.125311 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.125280    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bda01fbe-ca98-45f7-92cc-447576482055-istio-podinfo\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.130631 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.130598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jfnq\" (UniqueName: \"kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-kube-api-access-4jfnq\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.130772 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.130639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-istio-token\") pod \"e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") " pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.152102 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.152075    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:44.430619 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.430594    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"]
Sep 14 11:21:44.432456 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:21:44.432429    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda01fbe_ca98_45f7_92cc_447576482055.slice/crio-99484e66c85680f21484577ef254b8ee6e78bdbb9122d81b9593e9cf903b6cc0 WatchSource:0}: Error finding container 99484e66c85680f21484577ef254b8ee6e78bdbb9122d81b9593e9cf903b6cc0: Status 404 returned error can't find the container with id 99484e66c85680f21484577ef254b8ee6e78bdbb9122d81b9593e9cf903b6cc0
Sep 14 11:21:44.435206 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.435171    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:21:44.435293 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.435239    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:21:44.435293 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:44.435265    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:21:45.140981 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:45.140950    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" event={"ID":"bda01fbe-ca98-45f7-92cc-447576482055","Type":"ContainerStarted","Data":"99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa"}
Sep 14 11:21:45.141389 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:45.141003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" event={"ID":"bda01fbe-ca98-45f7-92cc-447576482055","Type":"ContainerStarted","Data":"99484e66c85680f21484577ef254b8ee6e78bdbb9122d81b9593e9cf903b6cc0"}
Sep 14 11:21:45.153164 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:45.153145    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:45.158131 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:45.158102    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:45.162690 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:45.162618    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" podStartSLOduration=2.162601382 podStartE2EDuration="2.162601382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:21:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:21:45.161499952 +0000 UTC m=+1965.142135456" watchObservedRunningTime="2026-09-14 11:21:45.162601382 +0000 UTC m=+1965.143236891"
Sep 14 11:21:46.149515 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:46.149481    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:46.150597 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:46.150575    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:21:46.471278 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:46.471187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:47.117296 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:47.117242    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:47.276748 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:47.276713    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:47.716145 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:47.716109    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:49.206120 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:49.206081    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:50.478242 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:50.478208    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:51.260703 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:51.260656    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:52.008449 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.008417    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:52.090931 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.090889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:52.219248 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.219217    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:52.549763 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.549729    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:52.647055 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.647020    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:21:52.682431 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.682395    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"]
Sep 14 11:21:52.685969 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.685948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:21:52.688955 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.688934    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-d5e418\""
Sep 14 11:21:52.700443 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.698179    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28tq4\" (UniqueName: \"kubernetes.io/projected/52c818ab-154e-4889-97b8-0046a83be8ee-kube-api-access-28tq4\") pod \"payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj\" (UID: \"52c818ab-154e-4889-97b8-0046a83be8ee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:21:52.700443 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.698320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52c818ab-154e-4889-97b8-0046a83be8ee-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj\" (UID: \"52c818ab-154e-4889-97b8-0046a83be8ee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:21:52.701507 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.701478    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"]
Sep 14 11:21:52.799038 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.798999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28tq4\" (UniqueName: \"kubernetes.io/projected/52c818ab-154e-4889-97b8-0046a83be8ee-kube-api-access-28tq4\") pod \"payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj\" (UID: \"52c818ab-154e-4889-97b8-0046a83be8ee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:21:52.799219 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.799137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52c818ab-154e-4889-97b8-0046a83be8ee-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj\" (UID: \"52c818ab-154e-4889-97b8-0046a83be8ee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:21:52.799902 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.799847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52c818ab-154e-4889-97b8-0046a83be8ee-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj\" (UID: \"52c818ab-154e-4889-97b8-0046a83be8ee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:21:52.811810 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.811780    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28tq4\" (UniqueName: \"kubernetes.io/projected/52c818ab-154e-4889-97b8-0046a83be8ee-kube-api-access-28tq4\") pod \"payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj\" (UID: \"52c818ab-154e-4889-97b8-0046a83be8ee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:21:52.997953 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:52.997920    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:21:53.271432 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:53.271406    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"]
Sep 14 11:21:53.273814 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:21:53.273787    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c818ab_154e_4889_97b8_0046a83be8ee.slice/crio-6d4838bc3ca988b11c8bc7383924d73349fe879862ffdcccffb015be4f3a977d WatchSource:0}: Error finding container 6d4838bc3ca988b11c8bc7383924d73349fe879862ffdcccffb015be4f3a977d: Status 404 returned error can't find the container with id 6d4838bc3ca988b11c8bc7383924d73349fe879862ffdcccffb015be4f3a977d
Sep 14 11:21:54.190213 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:54.190173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj" event={"ID":"52c818ab-154e-4889-97b8-0046a83be8ee","Type":"ContainerStarted","Data":"73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f"}
Sep 14 11:21:54.190387 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:54.190236    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj" event={"ID":"52c818ab-154e-4889-97b8-0046a83be8ee","Type":"ContainerStarted","Data":"6d4838bc3ca988b11c8bc7383924d73349fe879862ffdcccffb015be4f3a977d"}
Sep 14 11:21:54.190387 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:54.190262    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:21:54.210126 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:21:54.210081    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj" podStartSLOduration=2.210068647 podStartE2EDuration="2.210068647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:21:54.208138549 +0000 UTC m=+1974.188774054" watchObservedRunningTime="2026-09-14 11:21:54.210068647 +0000 UTC m=+1974.190704151"
Sep 14 11:22:00.798086 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:00.798049    2576 scope.go:117] "RemoveContainer" containerID="aec64b0a55b582c9679b85a529a96a763fb578cf62640dd5c24459e7ea3f9d95"
Sep 14 11:22:04.266664 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:04.266613    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:04.341489 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:04.341455    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:05.197084 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:05.197054    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:22:06.253205 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:06.253175    2576 generic.go:356] "Generic (PLEG): container finished" podID="bda01fbe-ca98-45f7-92cc-447576482055" containerID="99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa" exitCode=0
Sep 14 11:22:06.253627 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:06.253223    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" event={"ID":"bda01fbe-ca98-45f7-92cc-447576482055","Type":"ContainerDied","Data":"99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa"}
Sep 14 11:22:06.253627 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:06.253580    2576 scope.go:117] "RemoveContainer" containerID="99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa"
Sep 14 11:22:06.254679 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:06.254634    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:22:06.254742 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:06.254716    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:22:06.254779 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:06.254752    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 14 11:22:07.260076 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:07.260037    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" event={"ID":"bda01fbe-ca98-45f7-92cc-447576482055","Type":"ContainerStarted","Data":"609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd"}
Sep 14 11:22:08.152629 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:08.152595    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:22:08.152900 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:08.152781    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 14 11:22:08.152900 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:08.152821    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 14 11:22:09.152477 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:09.152443    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 14 11:22:09.152891 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:09.152503    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 14 11:22:10.153090 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:10.153049    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 14 11:22:10.153500 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:10.153109    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 14 11:22:11.153443 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:11.153405    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 14 11:22:11.153867 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:11.153463    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 14 11:22:12.152991 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:12.152955    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 14 11:22:12.153174 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:12.153007    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 14 11:22:12.826313 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:12.826282    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:12.886685 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:12.886636    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:13.156432 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:13.156355    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:22:13.156634 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:13.156610    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:22:13.157351 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:13.157332    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:22:15.179073 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:15.179040    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:16.202673 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:16.202619    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:17.243853 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:17.243771    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:17.582887 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:17.582786    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:19.334704 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:19.334664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:20.515888 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:20.515833    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:21.498663 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:21.498622    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:22.376460 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:22.376419    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:23.668277 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:23.668206    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:24.912411 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:24.912375    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:28.806146 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:28.806116    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:29.610951 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:29.610921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:29.678715 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:29.678686    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"]
Sep 14 11:22:29.678917 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:29.678893    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj" podUID="52c818ab-154e-4889-97b8-0046a83be8ee" containerName="payload-processing" containerID="cri-o://73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f" gracePeriod=30
Sep 14 11:22:29.741064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:29.741025    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:29.881226 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:29.881139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:29.942666 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:29.942627    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:22:29.954563 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:29.954541    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52c818ab-154e-4889-97b8-0046a83be8ee-plugins-config-volume\") pod \"52c818ab-154e-4889-97b8-0046a83be8ee\" (UID: \"52c818ab-154e-4889-97b8-0046a83be8ee\") "
Sep 14 11:22:29.954708 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:29.954595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28tq4\" (UniqueName: \"kubernetes.io/projected/52c818ab-154e-4889-97b8-0046a83be8ee-kube-api-access-28tq4\") pod \"52c818ab-154e-4889-97b8-0046a83be8ee\" (UID: \"52c818ab-154e-4889-97b8-0046a83be8ee\") "
Sep 14 11:22:29.954962 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:29.954937    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52c818ab-154e-4889-97b8-0046a83be8ee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "52c818ab-154e-4889-97b8-0046a83be8ee" (UID: "52c818ab-154e-4889-97b8-0046a83be8ee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:22:29.956623 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:29.956603    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52c818ab-154e-4889-97b8-0046a83be8ee-kube-api-access-28tq4" (OuterVolumeSpecName: "kube-api-access-28tq4") pod "52c818ab-154e-4889-97b8-0046a83be8ee" (UID: "52c818ab-154e-4889-97b8-0046a83be8ee"). InnerVolumeSpecName "kube-api-access-28tq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:22:29.998558 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:29.998528    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:30.055816 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.055780    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52c818ab-154e-4889-97b8-0046a83be8ee-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:30.055816 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.055811    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28tq4\" (UniqueName: \"kubernetes.io/projected/52c818ab-154e-4889-97b8-0046a83be8ee-kube-api-access-28tq4\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:30.117534 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.117503    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:30.384068 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.384034    2576 generic.go:356] "Generic (PLEG): container finished" podID="52c818ab-154e-4889-97b8-0046a83be8ee" containerID="73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f" exitCode=0
Sep 14 11:22:30.384246 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.384080    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"
Sep 14 11:22:30.384246 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.384126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj" event={"ID":"52c818ab-154e-4889-97b8-0046a83be8ee","Type":"ContainerDied","Data":"73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f"}
Sep 14 11:22:30.384246 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.384211    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj" event={"ID":"52c818ab-154e-4889-97b8-0046a83be8ee","Type":"ContainerDied","Data":"6d4838bc3ca988b11c8bc7383924d73349fe879862ffdcccffb015be4f3a977d"}
Sep 14 11:22:30.384246 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.384238    2576 scope.go:117] "RemoveContainer" containerID="73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f"
Sep 14 11:22:30.393762 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.393737    2576 scope.go:117] "RemoveContainer" containerID="73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f"
Sep 14 11:22:30.394043 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:22:30.394024    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f\": container with ID starting with 73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f not found: ID does not exist" containerID="73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f"
Sep 14 11:22:30.394106 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.394087    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f"} err="failed to get container status \"73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f\": rpc error: code = NotFound desc = could not find container \"73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f\": container with ID starting with 73659eccb6558e3a8ff13c1e7dc4b3d6c17e5642ba9b017511adde3849e0238f not found: ID does not exist"
Sep 14 11:22:30.433266 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.433235    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"]
Sep 14 11:22:30.441760 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.441731    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj"]
Sep 14 11:22:30.537954 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.537916    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:30.560503 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.560464    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52c818ab-154e-4889-97b8-0046a83be8ee" path="/var/lib/kubelet/pods/52c818ab-154e-4889-97b8-0046a83be8ee/volumes"
Sep 14 11:22:30.662745 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:30.662667    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:31.789545 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:31.789515    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:32.695556 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:32.695524    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:33.806980 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:33.806944    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:34.710053 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:34.710013    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:37.313728 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:37.313695    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:37.437482 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:37.437454    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:37.666306 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:37.666227    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"]
Sep 14 11:22:37.666466 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:37.666446    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy" containerID="cri-o://609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd" gracePeriod=30
Sep 14 11:22:37.759239 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:37.759210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:41.534865 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:41.534829    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:42.496544 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.496513    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:42.927923 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.927897    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:22:42.984046 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984015    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-envoy\") pod \"bda01fbe-ca98-45f7-92cc-447576482055\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") "
Sep 14 11:22:42.984230 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984069    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-istio-token\") pod \"bda01fbe-ca98-45f7-92cc-447576482055\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") "
Sep 14 11:22:42.984230 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984104    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bda01fbe-ca98-45f7-92cc-447576482055-istio-podinfo\") pod \"bda01fbe-ca98-45f7-92cc-447576482055\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") "
Sep 14 11:22:42.984230 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984132    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-data\") pod \"bda01fbe-ca98-45f7-92cc-447576482055\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") "
Sep 14 11:22:42.984230 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984160    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jfnq\" (UniqueName: \"kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-kube-api-access-4jfnq\") pod \"bda01fbe-ca98-45f7-92cc-447576482055\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") "
Sep 14 11:22:42.984230 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984195    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-certs\") pod \"bda01fbe-ca98-45f7-92cc-447576482055\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") "
Sep 14 11:22:42.984500 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984242    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-credential-socket\") pod \"bda01fbe-ca98-45f7-92cc-447576482055\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") "
Sep 14 11:22:42.984500 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984274    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-socket\") pod \"bda01fbe-ca98-45f7-92cc-447576482055\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") "
Sep 14 11:22:42.984500 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984308    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bda01fbe-ca98-45f7-92cc-447576482055-istiod-ca-cert\") pod \"bda01fbe-ca98-45f7-92cc-447576482055\" (UID: \"bda01fbe-ca98-45f7-92cc-447576482055\") "
Sep 14 11:22:42.984500 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984465    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-data" (OuterVolumeSpecName: "istio-data") pod "bda01fbe-ca98-45f7-92cc-447576482055" (UID: "bda01fbe-ca98-45f7-92cc-447576482055"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:22:42.984729 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984706    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-data\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:42.984811 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984763    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bda01fbe-ca98-45f7-92cc-447576482055-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bda01fbe-ca98-45f7-92cc-447576482055" (UID: "bda01fbe-ca98-45f7-92cc-447576482055"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:22:42.984933 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984913    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bda01fbe-ca98-45f7-92cc-447576482055" (UID: "bda01fbe-ca98-45f7-92cc-447576482055"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:22:42.985000 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984930    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bda01fbe-ca98-45f7-92cc-447576482055" (UID: "bda01fbe-ca98-45f7-92cc-447576482055"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:22:42.985000 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.984978    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bda01fbe-ca98-45f7-92cc-447576482055" (UID: "bda01fbe-ca98-45f7-92cc-447576482055"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:22:42.986812 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.986779    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bda01fbe-ca98-45f7-92cc-447576482055-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bda01fbe-ca98-45f7-92cc-447576482055" (UID: "bda01fbe-ca98-45f7-92cc-447576482055"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 11:22:42.986950 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.986850    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bda01fbe-ca98-45f7-92cc-447576482055" (UID: "bda01fbe-ca98-45f7-92cc-447576482055"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:22:42.986950 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.986871    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-kube-api-access-4jfnq" (OuterVolumeSpecName: "kube-api-access-4jfnq") pod "bda01fbe-ca98-45f7-92cc-447576482055" (UID: "bda01fbe-ca98-45f7-92cc-447576482055"). InnerVolumeSpecName "kube-api-access-4jfnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:22:42.986950 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:42.986917    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-istio-token" (OuterVolumeSpecName: "istio-token") pod "bda01fbe-ca98-45f7-92cc-447576482055" (UID: "bda01fbe-ca98-45f7-92cc-447576482055"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:22:43.085399 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.085318    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:43.085399 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.085345    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bda01fbe-ca98-45f7-92cc-447576482055-istio-podinfo\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:43.085399 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.085356    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jfnq\" (UniqueName: \"kubernetes.io/projected/bda01fbe-ca98-45f7-92cc-447576482055-kube-api-access-4jfnq\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:43.085399 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.085371    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:43.085399 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.085383    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-credential-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:43.085399 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.085392    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-workload-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:43.085399 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.085402    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bda01fbe-ca98-45f7-92cc-447576482055-istiod-ca-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:43.085777 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.085410    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bda01fbe-ca98-45f7-92cc-447576482055-istio-envoy\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:43.452643 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.452551    2576 generic.go:356] "Generic (PLEG): container finished" podID="bda01fbe-ca98-45f7-92cc-447576482055" containerID="609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd" exitCode=0
Sep 14 11:22:43.452643 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.452604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" event={"ID":"bda01fbe-ca98-45f7-92cc-447576482055","Type":"ContainerDied","Data":"609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd"}
Sep 14 11:22:43.452854 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.452671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc" event={"ID":"bda01fbe-ca98-45f7-92cc-447576482055","Type":"ContainerDied","Data":"99484e66c85680f21484577ef254b8ee6e78bdbb9122d81b9593e9cf903b6cc0"}
Sep 14 11:22:43.452854 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.452690    2576 scope.go:117] "RemoveContainer" containerID="609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd"
Sep 14 11:22:43.452854 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.452604    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"
Sep 14 11:22:43.461748 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.461728    2576 scope.go:117] "RemoveContainer" containerID="99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa"
Sep 14 11:22:43.469932 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.469909    2576 scope.go:117] "RemoveContainer" containerID="609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd"
Sep 14 11:22:43.470270 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:22:43.470236    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd\": container with ID starting with 609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd not found: ID does not exist" containerID="609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd"
Sep 14 11:22:43.470369 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.470277    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd"} err="failed to get container status \"609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd\": rpc error: code = NotFound desc = could not find container \"609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd\": container with ID starting with 609284f5d82095379ea632666ccf9bf89b620a6883d3617e5b5d443076fe66fd not found: ID does not exist"
Sep 14 11:22:43.470369 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.470294    2576 scope.go:117] "RemoveContainer" containerID="99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa"
Sep 14 11:22:43.470557 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:22:43.470537    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa\": container with ID starting with 99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa not found: ID does not exist" containerID="99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa"
Sep 14 11:22:43.470627 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.470561    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa"} err="failed to get container status \"99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa\": rpc error: code = NotFound desc = could not find container \"99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa\": container with ID starting with 99d6a3c7c3be24410c218bbd28f8b8e1bc28c1b09f36c46c6d4fa021bd52bfaa not found: ID does not exist"
Sep 14 11:22:43.511867 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.511837    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"]
Sep 14 11:22:43.513529 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.513507    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc"]
Sep 14 11:22:43.601230 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:43.601192    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:44.560920 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:44.560883    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bda01fbe-ca98-45f7-92cc-447576482055" path="/var/lib/kubelet/pods/bda01fbe-ca98-45f7-92cc-447576482055/volumes"
Sep 14 11:22:44.590727 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:44.590698    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:45.529694 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:45.529634    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:46.527848 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:46.527810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:57.031983 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.031945    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:57.074913 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.074880    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"]
Sep 14 11:22:57.075159 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.075134    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl" podUID="3fa63a57-365d-4de7-95cb-3c45fb910138" containerName="payload-processing" containerID="cri-o://252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e" gracePeriod=30
Sep 14 11:22:57.173859 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.173826    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:57.285594 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.285480    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:57.349615 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.349585    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:22:57.362728 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.362703    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:57.519158 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.519129    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fa63a57-365d-4de7-95cb-3c45fb910138-plugins-config-volume\") pod \"3fa63a57-365d-4de7-95cb-3c45fb910138\" (UID: \"3fa63a57-365d-4de7-95cb-3c45fb910138\") "
Sep 14 11:22:57.519319 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.519192    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdj45\" (UniqueName: \"kubernetes.io/projected/3fa63a57-365d-4de7-95cb-3c45fb910138-kube-api-access-wdj45\") pod \"3fa63a57-365d-4de7-95cb-3c45fb910138\" (UID: \"3fa63a57-365d-4de7-95cb-3c45fb910138\") "
Sep 14 11:22:57.519472 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.519449    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fa63a57-365d-4de7-95cb-3c45fb910138-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3fa63a57-365d-4de7-95cb-3c45fb910138" (UID: "3fa63a57-365d-4de7-95cb-3c45fb910138"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:22:57.521299 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.521264    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa63a57-365d-4de7-95cb-3c45fb910138-kube-api-access-wdj45" (OuterVolumeSpecName: "kube-api-access-wdj45") pod "3fa63a57-365d-4de7-95cb-3c45fb910138" (UID: "3fa63a57-365d-4de7-95cb-3c45fb910138"). InnerVolumeSpecName "kube-api-access-wdj45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:22:57.525221 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.525191    2576 generic.go:356] "Generic (PLEG): container finished" podID="3fa63a57-365d-4de7-95cb-3c45fb910138" containerID="252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e" exitCode=0
Sep 14 11:22:57.525321 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.525233    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"
Sep 14 11:22:57.525321 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.525260    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl" event={"ID":"3fa63a57-365d-4de7-95cb-3c45fb910138","Type":"ContainerDied","Data":"252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e"}
Sep 14 11:22:57.525321 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.525311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl" event={"ID":"3fa63a57-365d-4de7-95cb-3c45fb910138","Type":"ContainerDied","Data":"e13140bdc5ef477467cba53b05ad9bce8c5dfa4efd0f61a0188f7cc1535cebe2"}
Sep 14 11:22:57.525428 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.525342    2576 scope.go:117] "RemoveContainer" containerID="252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e"
Sep 14 11:22:57.533690 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.533671    2576 scope.go:117] "RemoveContainer" containerID="252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e"
Sep 14 11:22:57.533980 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:22:57.533962    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e\": container with ID starting with 252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e not found: ID does not exist" containerID="252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e"
Sep 14 11:22:57.534035 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.533987    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e"} err="failed to get container status \"252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e\": rpc error: code = NotFound desc = could not find container \"252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e\": container with ID starting with 252c1098f61fc746391fcb08deec76bc0adaf5c678824bb9950c942cbe9ee76e not found: ID does not exist"
Sep 14 11:22:57.578585 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.578518    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"]
Sep 14 11:22:57.590583 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.590559    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl"]
Sep 14 11:22:57.620319 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.620286    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fa63a57-365d-4de7-95cb-3c45fb910138-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:57.620426 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.620321    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdj45\" (UniqueName: \"kubernetes.io/projected/3fa63a57-365d-4de7-95cb-3c45fb910138-kube-api-access-wdj45\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:22:57.868556 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:57.868469    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:58.095715 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:58.095680    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:22:58.565397 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:58.565366    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fa63a57-365d-4de7-95cb-3c45fb910138" path="/var/lib/kubelet/pods/3fa63a57-365d-4de7-95cb-3c45fb910138/volumes"
Sep 14 11:22:59.198011 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:22:59.197977    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:23:00.015509 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:23:00.015453    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:23:01.033117 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:23:01.033082    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:23:02.825493 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:23:02.825457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:23:40.674098 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:23:40.674006    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:23:41.239381 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:23:41.239340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:23:47.277793 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:23:47.277754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:11.986471 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:11.986429    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:12.091403 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:12.091374    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:12.259365 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:12.259280    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"]
Sep 14 11:24:12.259558 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:12.259533    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy" containerID="cri-o://93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74" gracePeriod=30
Sep 14 11:24:12.286748 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:12.286717    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:13.711627 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:13.711595    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:14.803285 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:14.803241    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:15.858192 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:15.858146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:16.743566 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:16.743469    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:17.508946 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.508924    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:24:17.639423 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639310    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-certs\") pod \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") "
Sep 14 11:24:17.639423 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639380    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-token\") pod \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") "
Sep 14 11:24:17.639423 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639408    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istiod-ca-cert\") pod \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") "
Sep 14 11:24:17.639423 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639426    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-credential-socket\") pod \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") "
Sep 14 11:24:17.639815 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639449    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-podinfo\") pod \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") "
Sep 14 11:24:17.639815 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639490    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptv5c\" (UniqueName: \"kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-kube-api-access-ptv5c\") pod \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") "
Sep 14 11:24:17.639815 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639584    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-envoy\") pod \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") "
Sep 14 11:24:17.639815 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639631    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-data\") pod \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") "
Sep 14 11:24:17.639815 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639641    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f1dac43-37df-4ab1-b75f-71a951ef2d7e" (UID: "4f1dac43-37df-4ab1-b75f-71a951ef2d7e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:24:17.639815 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639698    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-socket\") pod \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\" (UID: \"4f1dac43-37df-4ab1-b75f-71a951ef2d7e\") "
Sep 14 11:24:17.639815 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639792    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f1dac43-37df-4ab1-b75f-71a951ef2d7e" (UID: "4f1dac43-37df-4ab1-b75f-71a951ef2d7e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:24:17.640183 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.639894    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f1dac43-37df-4ab1-b75f-71a951ef2d7e" (UID: "4f1dac43-37df-4ab1-b75f-71a951ef2d7e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:24:17.640183 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.640010    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f1dac43-37df-4ab1-b75f-71a951ef2d7e" (UID: "4f1dac43-37df-4ab1-b75f-71a951ef2d7e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:24:17.640183 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.640042    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:24:17.640183 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.640060    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istiod-ca-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:24:17.640183 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.640073    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-credential-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:24:17.640388 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.640209    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f1dac43-37df-4ab1-b75f-71a951ef2d7e" (UID: "4f1dac43-37df-4ab1-b75f-71a951ef2d7e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:24:17.641825 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.641803    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f1dac43-37df-4ab1-b75f-71a951ef2d7e" (UID: "4f1dac43-37df-4ab1-b75f-71a951ef2d7e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:24:17.641921 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.641856    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f1dac43-37df-4ab1-b75f-71a951ef2d7e" (UID: "4f1dac43-37df-4ab1-b75f-71a951ef2d7e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:24:17.642063 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.642046    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f1dac43-37df-4ab1-b75f-71a951ef2d7e" (UID: "4f1dac43-37df-4ab1-b75f-71a951ef2d7e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 11:24:17.642109 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.642050    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-kube-api-access-ptv5c" (OuterVolumeSpecName: "kube-api-access-ptv5c") pod "4f1dac43-37df-4ab1-b75f-71a951ef2d7e" (UID: "4f1dac43-37df-4ab1-b75f-71a951ef2d7e"). InnerVolumeSpecName "kube-api-access-ptv5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:24:17.741191 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.741141    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:24:17.741191 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.741186    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-podinfo\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:24:17.741191 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.741196    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptv5c\" (UniqueName: \"kubernetes.io/projected/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-kube-api-access-ptv5c\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:24:17.741191 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.741205    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-envoy\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:24:17.741472 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.741214    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-istio-data\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:24:17.741472 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.741221    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1dac43-37df-4ab1-b75f-71a951ef2d7e-workload-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:24:17.908711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.908607    2576 generic.go:356] "Generic (PLEG): container finished" podID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerID="93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74" exitCode=0
Sep 14 11:24:17.908711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.908668    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"
Sep 14 11:24:17.908711 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.908684    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" event={"ID":"4f1dac43-37df-4ab1-b75f-71a951ef2d7e","Type":"ContainerDied","Data":"93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74"}
Sep 14 11:24:17.908975 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.908725    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz" event={"ID":"4f1dac43-37df-4ab1-b75f-71a951ef2d7e","Type":"ContainerDied","Data":"623e5ab2a7d697f19be01d2209acbae9ce65209fd94cb088a67c5dd53ace2a0d"}
Sep 14 11:24:17.908975 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.908754    2576 scope.go:117] "RemoveContainer" containerID="93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74"
Sep 14 11:24:17.918001 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.917982    2576 scope.go:117] "RemoveContainer" containerID="22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3"
Sep 14 11:24:17.925969 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.925945    2576 scope.go:117] "RemoveContainer" containerID="93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74"
Sep 14 11:24:17.926248 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:24:17.926227    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74\": container with ID starting with 93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74 not found: ID does not exist" containerID="93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74"
Sep 14 11:24:17.926304 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.926257    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74"} err="failed to get container status \"93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74\": rpc error: code = NotFound desc = could not find container \"93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74\": container with ID starting with 93b371681e4ebc18079f60cf3dad46ed91b586b8727235f80bc862accbb40e74 not found: ID does not exist"
Sep 14 11:24:17.926304 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.926274    2576 scope.go:117] "RemoveContainer" containerID="22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3"
Sep 14 11:24:17.926579 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:24:17.926556    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3\": container with ID starting with 22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3 not found: ID does not exist" containerID="22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3"
Sep 14 11:24:17.926635 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.926590    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3"} err="failed to get container status \"22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3\": rpc error: code = NotFound desc = could not find container \"22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3\": container with ID starting with 22d1cd8b65d690d25f1fbc283f206eb5b49ff1b3286a5906ce0289641c6ef1d3 not found: ID does not exist"
Sep 14 11:24:17.942946 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.942918    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"]
Sep 14 11:24:17.953940 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:17.953916    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz"]
Sep 14 11:24:18.560496 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:18.560464    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" path="/var/lib/kubelet/pods/4f1dac43-37df-4ab1-b75f-71a951ef2d7e/volumes"
Sep 14 11:24:23.269102 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.269070    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:23.349466 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.349436    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"]
Sep 14 11:24:23.349739 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.349698    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc" podUID="7661b2f3-f1ec-46fd-963c-3de26e9c01d8" containerName="payload-pre-processing" containerID="cri-o://5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c" gracePeriod=30
Sep 14 11:24:23.394199 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.394173    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:23.511994 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.511954    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:23.607092 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.607064    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:24:23.640784 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.640751    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:23.694278 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.694243    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqg6w\" (UniqueName: \"kubernetes.io/projected/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-kube-api-access-nqg6w\") pod \"7661b2f3-f1ec-46fd-963c-3de26e9c01d8\" (UID: \"7661b2f3-f1ec-46fd-963c-3de26e9c01d8\") "
Sep 14 11:24:23.694457 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.694351    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-plugins-config-volume\") pod \"7661b2f3-f1ec-46fd-963c-3de26e9c01d8\" (UID: \"7661b2f3-f1ec-46fd-963c-3de26e9c01d8\") "
Sep 14 11:24:23.694737 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.694716    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7661b2f3-f1ec-46fd-963c-3de26e9c01d8" (UID: "7661b2f3-f1ec-46fd-963c-3de26e9c01d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:24:23.696280 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.696259    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-kube-api-access-nqg6w" (OuterVolumeSpecName: "kube-api-access-nqg6w") pod "7661b2f3-f1ec-46fd-963c-3de26e9c01d8" (UID: "7661b2f3-f1ec-46fd-963c-3de26e9c01d8"). InnerVolumeSpecName "kube-api-access-nqg6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:24:23.753816 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.753775    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:23.796062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.796034    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqg6w\" (UniqueName: \"kubernetes.io/projected/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-kube-api-access-nqg6w\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:24:23.796062 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.796058    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7661b2f3-f1ec-46fd-963c-3de26e9c01d8-plugins-config-volume\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:24:23.940908 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.940815    2576 generic.go:356] "Generic (PLEG): container finished" podID="7661b2f3-f1ec-46fd-963c-3de26e9c01d8" containerID="5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c" exitCode=0
Sep 14 11:24:23.940908 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.940855    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"
Sep 14 11:24:23.941152 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.940905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc" event={"ID":"7661b2f3-f1ec-46fd-963c-3de26e9c01d8","Type":"ContainerDied","Data":"5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c"}
Sep 14 11:24:23.941152 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.940961    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc" event={"ID":"7661b2f3-f1ec-46fd-963c-3de26e9c01d8","Type":"ContainerDied","Data":"42ac5645c6db520b2b0d1549fa5f255af7c3cd5999e5eeb82a0eb0e82d42f6bb"}
Sep 14 11:24:23.941152 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.940996    2576 scope.go:117] "RemoveContainer" containerID="5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c"
Sep 14 11:24:23.949689 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.949670    2576 scope.go:117] "RemoveContainer" containerID="5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c"
Sep 14 11:24:23.949959 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:24:23.949938    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c\": container with ID starting with 5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c not found: ID does not exist" containerID="5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c"
Sep 14 11:24:23.950036 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.949966    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c"} err="failed to get container status \"5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c\": rpc error: code = NotFound desc = could not find container \"5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c\": container with ID starting with 5fff1c0d8670bf9d42d8f8bca4d83b0be123bc48809f1525f819eefb9244059c not found: ID does not exist"
Sep 14 11:24:23.977710 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.977634    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"]
Sep 14 11:24:23.979429 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:23.979410    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc"]
Sep 14 11:24:24.091193 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:24.091161    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:24.205539 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:24.205457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:24.560914 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:24.560885    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7661b2f3-f1ec-46fd-963c-3de26e9c01d8" path="/var/lib/kubelet/pods/7661b2f3-f1ec-46fd-963c-3de26e9c01d8/volumes"
Sep 14 11:24:25.218578 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:25.218547    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:26.933286 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:26.933255    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:31.254400 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:31.254366    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:31.382211 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:31.382173    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:31.589450 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:31.589367    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:32.152119 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:32.152083    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:33.571296 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:33.571265    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:34.734015 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:34.733979    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:35.582202 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:35.582177    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:42.634256 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:42.634221    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:42.729227 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:42.729197    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:42.829058 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:42.829016    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:43.027801 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:43.027768    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:43.200331 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:43.200296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:43.324642 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:43.324557    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:43.449787 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:43.449749    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:44.294765 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:44.294731    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:49.814567 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:49.814538    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:49.898186 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:49.898152    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:50.148820 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:50.148738    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:50.833479 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:50.833447    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:51.755190 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:51.755157    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:24:52.589453 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:24:52.589418    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:25:01.344802 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:01.344771    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:25:01.358788 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:01.358762    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7"]
Sep 14 11:25:01.365608 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:01.365574    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-0fb86d-29823075-rqmx7"]
Sep 14 11:25:02.560079 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:02.560046    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2176b516-9e24-4492-8503-5f60a8f4d5e0" path="/var/lib/kubelet/pods/2176b516-9e24-4492-8503-5f60a8f4d5e0/volumes"
Sep 14 11:25:03.537855 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:03.537806    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:25:08.330395 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:08.330357    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:25:08.488290 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:08.488258    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:25:08.737137 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:08.737099    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"]
Sep 14 11:25:08.737376 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:08.737332    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy" containerID="cri-o://2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19" gracePeriod=30
Sep 14 11:25:08.823168 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:08.823137    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:25:08.978409 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:08.978368    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 11:25:08.978572 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:08.978425    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 11:25:11.678395 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:11.678356    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-785cb4f769-2th6n"]
Sep 14 11:25:11.678870 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:11.678601    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-785cb4f769-2th6n" podUID="fd91e556-008b-4c2e-bf8f-1dc99e23c7b8" containerName="manager" containerID="cri-o://b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f" gracePeriod=30
Sep 14 11:25:11.932345 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:11.932281    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 11:25:12.011539 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.011510    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-webhook-cert\") pod \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") "
Sep 14 11:25:12.011728 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.011601    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwr4h\" (UniqueName: \"kubernetes.io/projected/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-kube-api-access-bwr4h\") pod \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") "
Sep 14 11:25:12.011728 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.011637    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-metrics-certs\") pod \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\" (UID: \"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8\") "
Sep 14 11:25:12.013704 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.013668    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fd91e556-008b-4c2e-bf8f-1dc99e23c7b8" (UID: "fd91e556-008b-4c2e-bf8f-1dc99e23c7b8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:25:12.013704 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.013694    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fd91e556-008b-4c2e-bf8f-1dc99e23c7b8" (UID: "fd91e556-008b-4c2e-bf8f-1dc99e23c7b8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:25:12.013860 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.013762    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-kube-api-access-bwr4h" (OuterVolumeSpecName: "kube-api-access-bwr4h") pod "fd91e556-008b-4c2e-bf8f-1dc99e23c7b8" (UID: "fd91e556-008b-4c2e-bf8f-1dc99e23c7b8"). InnerVolumeSpecName "kube-api-access-bwr4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:25:12.112916 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.112881    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-metrics-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:12.112916 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.112909    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-webhook-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:12.112916 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.112918    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwr4h\" (UniqueName: \"kubernetes.io/projected/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8-kube-api-access-bwr4h\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:12.166572 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.166536    2576 generic.go:356] "Generic (PLEG): container finished" podID="fd91e556-008b-4c2e-bf8f-1dc99e23c7b8" containerID="b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f" exitCode=0
Sep 14 11:25:12.166755 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.166586    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785cb4f769-2th6n"
Sep 14 11:25:12.166755 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.166587    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785cb4f769-2th6n" event={"ID":"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8","Type":"ContainerDied","Data":"b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f"}
Sep 14 11:25:12.166755 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.166711    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785cb4f769-2th6n" event={"ID":"fd91e556-008b-4c2e-bf8f-1dc99e23c7b8","Type":"ContainerDied","Data":"ce034a4672ed14999ef2b39e3b7f28f3500e78b65db4a0ab7323096b6b9e6de6"}
Sep 14 11:25:12.166755 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.166742    2576 scope.go:117] "RemoveContainer" containerID="b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f"
Sep 14 11:25:12.176351 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.176335    2576 scope.go:117] "RemoveContainer" containerID="b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f"
Sep 14 11:25:12.176633 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:25:12.176614    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f\": container with ID starting with b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f not found: ID does not exist" containerID="b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f"
Sep 14 11:25:12.176799 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.176641    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f"} err="failed to get container status \"b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f\": rpc error: code = NotFound desc = could not find container \"b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f\": container with ID starting with b3f88086b9bece456ed5698944bab0a587440352233a24bcc8c91096e0e90a4f not found: ID does not exist"
Sep 14 11:25:12.188347 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.188296    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-785cb4f769-2th6n"]
Sep 14 11:25:12.193584 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.193565    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-785cb4f769-2th6n"]
Sep 14 11:25:12.560612 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:12.560577    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd91e556-008b-4c2e-bf8f-1dc99e23c7b8" path="/var/lib/kubelet/pods/fd91e556-008b-4c2e-bf8f-1dc99e23c7b8/volumes"
Sep 14 11:25:13.993601 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:13.993567    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:25:14.128767 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.128631    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-token\") pod \"819b83de-1486-41f9-a3bd-3947fe445ea6\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") "
Sep 14 11:25:14.128767 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.128732    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-envoy\") pod \"819b83de-1486-41f9-a3bd-3947fe445ea6\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") "
Sep 14 11:25:14.129012 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.128778    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-certs\") pod \"819b83de-1486-41f9-a3bd-3947fe445ea6\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") "
Sep 14 11:25:14.129012 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.128805    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-data\") pod \"819b83de-1486-41f9-a3bd-3947fe445ea6\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") "
Sep 14 11:25:14.129012 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.128848    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/819b83de-1486-41f9-a3bd-3947fe445ea6-istiod-ca-cert\") pod \"819b83de-1486-41f9-a3bd-3947fe445ea6\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") "
Sep 14 11:25:14.129012 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.128876    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-credential-socket\") pod \"819b83de-1486-41f9-a3bd-3947fe445ea6\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") "
Sep 14 11:25:14.129012 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.128912    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z7t8\" (UniqueName: \"kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-kube-api-access-5z7t8\") pod \"819b83de-1486-41f9-a3bd-3947fe445ea6\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") "
Sep 14 11:25:14.129012 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.128964    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-podinfo\") pod \"819b83de-1486-41f9-a3bd-3947fe445ea6\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") "
Sep 14 11:25:14.129012 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.128994    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-socket\") pod \"819b83de-1486-41f9-a3bd-3947fe445ea6\" (UID: \"819b83de-1486-41f9-a3bd-3947fe445ea6\") "
Sep 14 11:25:14.129411 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.129327    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819b83de-1486-41f9-a3bd-3947fe445ea6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "819b83de-1486-41f9-a3bd-3947fe445ea6" (UID: "819b83de-1486-41f9-a3bd-3947fe445ea6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:25:14.129508 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.129481    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "819b83de-1486-41f9-a3bd-3947fe445ea6" (UID: "819b83de-1486-41f9-a3bd-3947fe445ea6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:25:14.129737 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.129635    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-data" (OuterVolumeSpecName: "istio-data") pod "819b83de-1486-41f9-a3bd-3947fe445ea6" (UID: "819b83de-1486-41f9-a3bd-3947fe445ea6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:25:14.129737 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.129684    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "819b83de-1486-41f9-a3bd-3947fe445ea6" (UID: "819b83de-1486-41f9-a3bd-3947fe445ea6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:25:14.129982 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.129895    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "819b83de-1486-41f9-a3bd-3947fe445ea6" (UID: "819b83de-1486-41f9-a3bd-3947fe445ea6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:25:14.131139 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.131110    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-token" (OuterVolumeSpecName: "istio-token") pod "819b83de-1486-41f9-a3bd-3947fe445ea6" (UID: "819b83de-1486-41f9-a3bd-3947fe445ea6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:25:14.132064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.132030    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-kube-api-access-5z7t8" (OuterVolumeSpecName: "kube-api-access-5z7t8") pod "819b83de-1486-41f9-a3bd-3947fe445ea6" (UID: "819b83de-1486-41f9-a3bd-3947fe445ea6"). InnerVolumeSpecName "kube-api-access-5z7t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:25:14.132064 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.132042    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "819b83de-1486-41f9-a3bd-3947fe445ea6" (UID: "819b83de-1486-41f9-a3bd-3947fe445ea6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 11:25:14.132225 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.132163    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "819b83de-1486-41f9-a3bd-3947fe445ea6" (UID: "819b83de-1486-41f9-a3bd-3947fe445ea6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:25:14.180036 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.180000    2576 generic.go:356] "Generic (PLEG): container finished" podID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerID="2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19" exitCode=0
Sep 14 11:25:14.180216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.180048    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"
Sep 14 11:25:14.180216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.180074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" event={"ID":"819b83de-1486-41f9-a3bd-3947fe445ea6","Type":"ContainerDied","Data":"2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19"}
Sep 14 11:25:14.180216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.180130    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9" event={"ID":"819b83de-1486-41f9-a3bd-3947fe445ea6","Type":"ContainerDied","Data":"57bc37de07484e760bdf56e2aad2e4aff420688cb673d5cdaf7cb5b138a4b0cf"}
Sep 14 11:25:14.180216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.180163    2576 scope.go:117] "RemoveContainer" containerID="2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19"
Sep 14 11:25:14.192195 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.192173    2576 scope.go:117] "RemoveContainer" containerID="d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad"
Sep 14 11:25:14.202739 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.202712    2576 scope.go:117] "RemoveContainer" containerID="2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19"
Sep 14 11:25:14.203105 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:25:14.203077    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19\": container with ID starting with 2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19 not found: ID does not exist" containerID="2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19"
Sep 14 11:25:14.203218 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.203116    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19"} err="failed to get container status \"2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19\": rpc error: code = NotFound desc = could not find container \"2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19\": container with ID starting with 2c06c645ef6453aaab355853a918a0f06ed0723b2680a2989ee28275443c6a19 not found: ID does not exist"
Sep 14 11:25:14.203218 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.203141    2576 scope.go:117] "RemoveContainer" containerID="d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad"
Sep 14 11:25:14.203490 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:25:14.203463    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad\": container with ID starting with d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad not found: ID does not exist" containerID="d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad"
Sep 14 11:25:14.203574 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.203498    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad"} err="failed to get container status \"d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad\": rpc error: code = NotFound desc = could not find container \"d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad\": container with ID starting with d24104dc949e90d7f7a3b2b923cca84873baa7a7b9b3c58553bc78a3419691ad not found: ID does not exist"
Sep 14 11:25:14.204232 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.204209    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"]
Sep 14 11:25:14.210087 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.210063    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9"]
Sep 14 11:25:14.230413 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.230384    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-token\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:14.230512 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.230418    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-envoy\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:14.230512 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.230433    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:14.230512 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.230446    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-data\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:14.230512 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.230459    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/819b83de-1486-41f9-a3bd-3947fe445ea6-istiod-ca-cert\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:14.230512 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.230472    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-credential-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:14.230512 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.230487    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z7t8\" (UniqueName: \"kubernetes.io/projected/819b83de-1486-41f9-a3bd-3947fe445ea6-kube-api-access-5z7t8\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:14.230512 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.230501    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/819b83de-1486-41f9-a3bd-3947fe445ea6-istio-podinfo\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:14.230790 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.230514    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/819b83de-1486-41f9-a3bd-3947fe445ea6-workload-socket\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:25:14.560389 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:14.560353    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" path="/var/lib/kubelet/pods/819b83de-1486-41f9-a3bd-3947fe445ea6/volumes"
Sep 14 11:25:49.240367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:49.240329    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:25:50.429837 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:25:50.429775    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:26:00.863658 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:26:00.863625    2576 scope.go:117] "RemoveContainer" containerID="8b8e29c97c39a840a1a914af456771fc02a460a8e7c4459e5d2309fe6611a87e"
Sep 14 11:26:01.700164 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:26:01.700131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:26:01.763874 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:26:01.763846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:26:38.492418 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:26:38.492338    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:26:39.962137 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:26:39.962105    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:28:54.233459 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:28:54.233424    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:28:54.296922 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:28:54.296893    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:29:03.193333 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:29:03.193295    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:29:33.867918 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:29:33.867830    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:29:43.061714 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:29:43.061671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:29:57.858332 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:29:57.858299    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:29:59.761251 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:29:59.761213    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:30:30.664877 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.664841    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"]
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665170    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665180    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665192    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665198    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665206    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7661b2f3-f1ec-46fd-963c-3de26e9c01d8" containerName="payload-pre-processing"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665211    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7661b2f3-f1ec-46fd-963c-3de26e9c01d8" containerName="payload-pre-processing"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665221    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa63a57-365d-4de7-95cb-3c45fb910138" containerName="payload-processing"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665226    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa63a57-365d-4de7-95cb-3c45fb910138" containerName="payload-processing"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665233    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665239    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665245    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c818ab-154e-4889-97b8-0046a83be8ee" containerName="payload-processing"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665250    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c818ab-154e-4889-97b8-0046a83be8ee" containerName="payload-processing"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665258    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665264    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665273    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd91e556-008b-4c2e-bf8f-1dc99e23c7b8" containerName="manager"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665278    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd91e556-008b-4c2e-bf8f-1dc99e23c7b8" containerName="manager"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665283    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665290    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665296    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665301    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665348    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd91e556-008b-4c2e-bf8f-1dc99e23c7b8" containerName="manager"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665355    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa63a57-365d-4de7-95cb-3c45fb910138" containerName="payload-processing"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665360    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7661b2f3-f1ec-46fd-963c-3de26e9c01d8" containerName="payload-pre-processing"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665366    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665372    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda01fbe-ca98-45f7-92cc-447576482055" containerName="istio-proxy"
Sep 14 11:30:30.665367 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665378    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy"
Sep 14 11:30:30.666255 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665383    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="819b83de-1486-41f9-a3bd-3947fe445ea6" containerName="istio-proxy"
Sep 14 11:30:30.666255 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665389    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy"
Sep 14 11:30:30.666255 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665395    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f1dac43-37df-4ab1-b75f-71a951ef2d7e" containerName="istio-proxy"
Sep 14 11:30:30.666255 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.665400    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="52c818ab-154e-4889-97b8-0046a83be8ee" containerName="payload-processing"
Sep 14 11:30:30.668236 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.668221    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.679969 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.679945    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"]
Sep 14 11:30:30.721563 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.721529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3300d76-fcad-4069-8425-25036729b47c-openshift-service-ca\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.721563 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.721572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3300d76-fcad-4069-8425-25036729b47c-metrics-certs\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.721800 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.721596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thn26\" (UniqueName: \"kubernetes.io/projected/b3300d76-fcad-4069-8425-25036729b47c-kube-api-access-thn26\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.721800 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.721616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3300d76-fcad-4069-8425-25036729b47c-maas-api-tls\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.822558 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.822524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3300d76-fcad-4069-8425-25036729b47c-openshift-service-ca\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.822778 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.822565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3300d76-fcad-4069-8425-25036729b47c-metrics-certs\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.822778 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.822595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thn26\" (UniqueName: \"kubernetes.io/projected/b3300d76-fcad-4069-8425-25036729b47c-kube-api-access-thn26\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.822778 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.822626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3300d76-fcad-4069-8425-25036729b47c-maas-api-tls\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.823247 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.823214    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3300d76-fcad-4069-8425-25036729b47c-openshift-service-ca\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.825143 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.825116    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3300d76-fcad-4069-8425-25036729b47c-metrics-certs\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.825306 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.825284    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3300d76-fcad-4069-8425-25036729b47c-maas-api-tls\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.833449 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.833426    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thn26\" (UniqueName: \"kubernetes.io/projected/b3300d76-fcad-4069-8425-25036729b47c-kube-api-access-thn26\") pod \"maas-api-6ffbf7464d-2vm2t\" (UID: \"b3300d76-fcad-4069-8425-25036729b47c\") " pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:30.978358 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:30.978277    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:31.258018 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:31.257990    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"]
Sep 14 11:30:31.259923 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:30:31.259895    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3300d76_fcad_4069_8425_25036729b47c.slice/crio-f0527b6fd38c4359fa3a6d3d84072e6f30de8cc3273bd8d4ec02d9ceed8cc5e6 WatchSource:0}: Error finding container f0527b6fd38c4359fa3a6d3d84072e6f30de8cc3273bd8d4ec02d9ceed8cc5e6: Status 404 returned error can't find the container with id f0527b6fd38c4359fa3a6d3d84072e6f30de8cc3273bd8d4ec02d9ceed8cc5e6
Sep 14 11:30:31.261120 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:31.261102    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 11:30:31.617287 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:31.617207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t" event={"ID":"b3300d76-fcad-4069-8425-25036729b47c","Type":"ContainerStarted","Data":"f0527b6fd38c4359fa3a6d3d84072e6f30de8cc3273bd8d4ec02d9ceed8cc5e6"}
Sep 14 11:30:32.624217 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:32.624185    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t" event={"ID":"b3300d76-fcad-4069-8425-25036729b47c","Type":"ContainerStarted","Data":"d81cd3ef64a515b6b597699b9251f1427790d5a1e48f972f94f8d6fc0bcb3cc6"}
Sep 14 11:30:32.624580 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:32.624303    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:32.652763 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:32.652713    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t" podStartSLOduration=1.757496562 podStartE2EDuration="2.652697443s" totalImagesPullingTime="895.200881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:30:32.65142539 +0000 UTC m=+2492.632060894" watchObservedRunningTime="2026-09-14 11:30:32.652697443 +0000 UTC m=+2492.633332948"
Sep 14 11:30:38.634975 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:38.634945    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6ffbf7464d-2vm2t"
Sep 14 11:30:38.718039 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:38.718008    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"]
Sep 14 11:30:38.718239 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:38.718217    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt" podUID="c3d036d8-7f93-468b-a873-a830cb285a07" containerName="maas-api" containerID="cri-o://c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044" gracePeriod=30
Sep 14 11:30:39.963613 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:39.963587    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:30:40.099723 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.099611    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3d036d8-7f93-468b-a873-a830cb285a07-openshift-service-ca\") pod \"c3d036d8-7f93-468b-a873-a830cb285a07\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") "
Sep 14 11:30:40.099723 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.099692    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-maas-api-tls\") pod \"c3d036d8-7f93-468b-a873-a830cb285a07\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") "
Sep 14 11:30:40.099723 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.099710    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-metrics-certs\") pod \"c3d036d8-7f93-468b-a873-a830cb285a07\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") "
Sep 14 11:30:40.100010 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.099731    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlnn8\" (UniqueName: \"kubernetes.io/projected/c3d036d8-7f93-468b-a873-a830cb285a07-kube-api-access-qlnn8\") pod \"c3d036d8-7f93-468b-a873-a830cb285a07\" (UID: \"c3d036d8-7f93-468b-a873-a830cb285a07\") "
Sep 14 11:30:40.100010 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.099944    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d036d8-7f93-468b-a873-a830cb285a07-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3d036d8-7f93-468b-a873-a830cb285a07" (UID: "c3d036d8-7f93-468b-a873-a830cb285a07"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:30:40.101886 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.101855    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c3d036d8-7f93-468b-a873-a830cb285a07" (UID: "c3d036d8-7f93-468b-a873-a830cb285a07"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:30:40.101886 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.101870    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3d036d8-7f93-468b-a873-a830cb285a07" (UID: "c3d036d8-7f93-468b-a873-a830cb285a07"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:30:40.102034 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.101927    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d036d8-7f93-468b-a873-a830cb285a07-kube-api-access-qlnn8" (OuterVolumeSpecName: "kube-api-access-qlnn8") pod "c3d036d8-7f93-468b-a873-a830cb285a07" (UID: "c3d036d8-7f93-468b-a873-a830cb285a07"). InnerVolumeSpecName "kube-api-access-qlnn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:30:40.200991 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.200956    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlnn8\" (UniqueName: \"kubernetes.io/projected/c3d036d8-7f93-468b-a873-a830cb285a07-kube-api-access-qlnn8\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:30:40.200991 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.200985    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3d036d8-7f93-468b-a873-a830cb285a07-openshift-service-ca\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:30:40.200991 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.200997    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-maas-api-tls\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:30:40.201216 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.201009    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d036d8-7f93-468b-a873-a830cb285a07-metrics-certs\") on node \"ip-10-0-142-201.ec2.internal\" DevicePath \"\""
Sep 14 11:30:40.663142 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.663108    2576 generic.go:356] "Generic (PLEG): container finished" podID="c3d036d8-7f93-468b-a873-a830cb285a07" containerID="c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044" exitCode=0
Sep 14 11:30:40.663304 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.663154    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"
Sep 14 11:30:40.663304 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.663194    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt" event={"ID":"c3d036d8-7f93-468b-a873-a830cb285a07","Type":"ContainerDied","Data":"c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044"}
Sep 14 11:30:40.663304 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.663247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67455dc876-xx7qt" event={"ID":"c3d036d8-7f93-468b-a873-a830cb285a07","Type":"ContainerDied","Data":"24d50632449ecaf649b75ba3307bddbfae31792f33152f1c0f66cdd5d71899ac"}
Sep 14 11:30:40.663304 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.663268    2576 scope.go:117] "RemoveContainer" containerID="c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044"
Sep 14 11:30:40.671482 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.671464    2576 scope.go:117] "RemoveContainer" containerID="c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044"
Sep 14 11:30:40.671758 ip-10-0-142-201 kubenswrapper[2576]: E0914 11:30:40.671742    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044\": container with ID starting with c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044 not found: ID does not exist" containerID="c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044"
Sep 14 11:30:40.671807 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.671764    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044"} err="failed to get container status \"c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044\": rpc error: code = NotFound desc = could not find container \"c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044\": container with ID starting with c6e3675a2973325957ae85db9bea6ae3cfaa234759e79a37715ac5c21980e044 not found: ID does not exist"
Sep 14 11:30:40.680810 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.680790    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"]
Sep 14 11:30:40.688686 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:40.688666    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-67455dc876-xx7qt"]
Sep 14 11:30:42.560137 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:42.560106    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3d036d8-7f93-468b-a873-a830cb285a07" path="/var/lib/kubelet/pods/c3d036d8-7f93-468b-a873-a830cb285a07/volumes"
Sep 14 11:30:52.597389 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:52.597355    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6df64bcf75-5m2cg_f759d0a8-d3cf-408b-b4b7-9aae02466530/authorino/0.log"
Sep 14 11:30:57.718315 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:57.718237    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-78g92_d1f93ddc-dd8e-4e72-a814-9e25c19c4fee/manager/0.log"
Sep 14 11:30:57.824826 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:57.824798    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vvfzx_3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b/manager/0.log"
Sep 14 11:30:58.529039 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:58.529014    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6d976668-prjcm_618b3422-5e84-4d75-a43b-0ebca9152fba/copy-manifests/0.log"
Sep 14 11:30:58.541317 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:58.541291    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6d976668-prjcm_618b3422-5e84-4d75-a43b-0ebca9152fba/manager/0.log"
Sep 14 11:30:58.861259 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:30:58.861177    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6ffbf7464d-2vm2t_b3300d76-fcad-4069-8425-25036729b47c/maas-api/0.log"
Sep 14 11:31:00.029190 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:00.029161    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6df64bcf75-5m2cg_f759d0a8-d3cf-408b-b4b7-9aae02466530/authorino/0.log"
Sep 14 11:31:00.138970 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:00.138941    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-sddzr_e01163d9-fb22-410a-afe7-1aeb94e81fe8/manager/0.log"
Sep 14 11:31:01.149381 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:01.149350    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cr4vl_61962eb0-8148-421e-92d1-dd63e2c7d0ff/discovery/0.log"
Sep 14 11:31:01.370629 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:01.370595    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-848c99f856-pl4cb_0016e46a-a640-498f-9a78-1c89d1624d90/kube-auth-proxy/0.log"
Sep 14 11:31:01.482773 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:01.482746    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-82wsv_48062ff1-770b-4639-a806-4c17831a46cf/istio-proxy/1.log"
Sep 14 11:31:01.713195 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:01.713112    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sqxlk_0c0c7a81-3670-439a-947d-4135b8c3d634/payload-processing/0.log"
Sep 14 11:31:01.822501 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:01.822471    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c77589b76-877mb_6d9f801b-600f-42a8-9d5d-445a14046fee/router/0.log"
Sep 14 11:31:02.144796 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:02.144766    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-x4ffs_94c5ee8e-de33-45f7-9fc9-2f6e07c7d455/main/0.log"
Sep 14 11:31:02.360992 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:02.360964    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-ldg69_c82c23e6-4fc5-4e20-a232-751f10102828/main/0.log"
Sep 14 11:31:02.693884 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:02.693857    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dmncv_5bd55f8d-edd9-4045-aad9-1d00b62743ac/main/0.log"
Sep 14 11:31:08.137397 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:08.137354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:31:09.510119 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:09.510087    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log" limit=1024
Sep 14 11:31:11.091696 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:11.091664    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zmdnx_32bf6cd3-707a-4ad0-9294-9198e4a4765f/global-pull-secret-syncer/0.log"
Sep 14 11:31:11.148001 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:11.147969    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gpp5n_a6cb1687-fe61-4d47-b31c-adb35652867a/konnectivity-agent/0.log"
Sep 14 11:31:11.287370 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:11.287344    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-201.ec2.internal_3bdffdae562a11beaff0a15fcd57b726/haproxy/0.log"
Sep 14 11:31:15.768254 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:15.768211    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6df64bcf75-5m2cg_f759d0a8-d3cf-408b-b4b7-9aae02466530/authorino/0.log"
Sep 14 11:31:15.807000 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:15.806975    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-sddzr_e01163d9-fb22-410a-afe7-1aeb94e81fe8/manager/0.log"
Sep 14 11:31:17.850598 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:17.850569    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-82vsv_22de75a9-e790-4a0d-ba3b-60e0df51314a/node-exporter/0.log"
Sep 14 11:31:17.875154 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:17.875129    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-82vsv_22de75a9-e790-4a0d-ba3b-60e0df51314a/kube-rbac-proxy/0.log"
Sep 14 11:31:17.894969 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:17.894950    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-82vsv_22de75a9-e790-4a0d-ba3b-60e0df51314a/init-textfile/0.log"
Sep 14 11:31:18.085910 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:18.085882    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-29bg7_86d341e2-9862-43b8-86bf-3cde751558a1/kube-rbac-proxy-main/0.log"
Sep 14 11:31:18.117230 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:18.117157    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-29bg7_86d341e2-9862-43b8-86bf-3cde751558a1/kube-rbac-proxy-self/0.log"
Sep 14 11:31:18.138546 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:18.138522    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-29bg7_86d341e2-9862-43b8-86bf-3cde751558a1/openshift-state-metrics/0.log"
Sep 14 11:31:21.062395 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.062362    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"]
Sep 14 11:31:21.062947 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.062925    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d036d8-7f93-468b-a873-a830cb285a07" containerName="maas-api"
Sep 14 11:31:21.063041 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.062949    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d036d8-7f93-468b-a873-a830cb285a07" containerName="maas-api"
Sep 14 11:31:21.063096 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.063049    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d036d8-7f93-468b-a873-a830cb285a07" containerName="maas-api"
Sep 14 11:31:21.066104 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.066085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.068120 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.068101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lp9t4\"/\"default-dockercfg-4h7ts\""
Sep 14 11:31:21.068209 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.068102    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lp9t4\"/\"openshift-service-ca.crt\""
Sep 14 11:31:21.068802 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.068783    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lp9t4\"/\"kube-root-ca.crt\""
Sep 14 11:31:21.072078 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.072053    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"]
Sep 14 11:31:21.158385 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.158352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-sys\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.158564 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.158393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72hg6\" (UniqueName: \"kubernetes.io/projected/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-kube-api-access-72hg6\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.158564 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.158412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-podres\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.158564 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.158514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-lib-modules\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.158732 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.158565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-proc\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.259313 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.259275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-proc\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.259313 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.259310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-sys\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.259522 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.259333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72hg6\" (UniqueName: \"kubernetes.io/projected/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-kube-api-access-72hg6\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.259522 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.259392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-podres\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.259522 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.259410    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-sys\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.259522 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.259410    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-proc\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.259522 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.259493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-lib-modules\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.259522 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.259513    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-podres\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.259807 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.259612    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-lib-modules\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.267947 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.267926    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72hg6\" (UniqueName: \"kubernetes.io/projected/fd2ad922-3ebd-43c6-91bf-cf6dead0b99a-kube-api-access-72hg6\") pod \"perf-node-gather-daemonset-47zpk\" (UID: \"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a\") " pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.376436 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.376370    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.645935 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.645707    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"]
Sep 14 11:31:21.648520 ip-10-0-142-201 kubenswrapper[2576]: W0914 11:31:21.648486    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfd2ad922_3ebd_43c6_91bf_cf6dead0b99a.slice/crio-67e45201041df0558d4fc26ba4187a98ac14ffaebb41320bc738985ac29236a4 WatchSource:0}: Error finding container 67e45201041df0558d4fc26ba4187a98ac14ffaebb41320bc738985ac29236a4: Status 404 returned error can't find the container with id 67e45201041df0558d4fc26ba4187a98ac14ffaebb41320bc738985ac29236a4
Sep 14 11:31:21.853749 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.853716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk" event={"ID":"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a","Type":"ContainerStarted","Data":"0a2d8710f6bbcaf85817913276933e4d5ac6383d09144e4efef89a412addfb9c"}
Sep 14 11:31:21.853946 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.853764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk" event={"ID":"fd2ad922-3ebd-43c6-91bf-cf6dead0b99a","Type":"ContainerStarted","Data":"67e45201041df0558d4fc26ba4187a98ac14ffaebb41320bc738985ac29236a4"}
Sep 14 11:31:21.853946 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.853860    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:21.870154 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:21.870102    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk" podStartSLOduration=0.87008797 podStartE2EDuration="870.08797ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 11:31:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:31:21.868213687 +0000 UTC m=+2541.848849192" watchObservedRunningTime="2026-09-14 11:31:21.87008797 +0000 UTC m=+2541.850723495"
Sep 14 11:31:23.286466 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:23.286439    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bc6ks_863a44cf-93fa-49b1-a3a5-4a6986517c3c/dns/0.log"
Sep 14 11:31:23.306576 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:23.306557    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bc6ks_863a44cf-93fa-49b1-a3a5-4a6986517c3c/kube-rbac-proxy/0.log"
Sep 14 11:31:23.477038 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:23.477007    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vfwxz_14abef7b-782a-46a1-9554-ef292563452d/dns-node-resolver/0.log"
Sep 14 11:31:24.019247 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:24.019218    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8xmsc_3bfa1deb-57c8-400d-9176-6d688b7e54b0/node-ca/0.log"
Sep 14 11:31:25.371447 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:25.371379    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cr4vl_61962eb0-8148-421e-92d1-dd63e2c7d0ff/discovery/0.log"
Sep 14 11:31:25.415760 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:25.415735    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-848c99f856-pl4cb_0016e46a-a640-498f-9a78-1c89d1624d90/kube-auth-proxy/0.log"
Sep 14 11:31:25.446414 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:25.446390    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-82wsv_48062ff1-770b-4639-a806-4c17831a46cf/istio-proxy/0.log"
Sep 14 11:31:25.449138 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:25.449118    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-82wsv_48062ff1-770b-4639-a806-4c17831a46cf/istio-proxy/1.log"
Sep 14 11:31:25.517193 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:25.517159    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sqxlk_0c0c7a81-3670-439a-947d-4135b8c3d634/payload-processing/0.log"
Sep 14 11:31:25.541756 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:25.541738    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c77589b76-877mb_6d9f801b-600f-42a8-9d5d-445a14046fee/router/0.log"
Sep 14 11:31:26.418758 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:26.418731    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nspvt_bc4843e8-0d13-489e-9138-cf85eb6a4678/serve-healthcheck-canary/0.log"
Sep 14 11:31:27.039056 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:27.039025    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p5tmq_17df435e-cf4f-4b0b-8731-6a4757e6f0db/kube-rbac-proxy/0.log"
Sep 14 11:31:27.059478 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:27.059453    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p5tmq_17df435e-cf4f-4b0b-8731-6a4757e6f0db/exporter/0.log"
Sep 14 11:31:27.079220 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:27.079199    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p5tmq_17df435e-cf4f-4b0b-8731-6a4757e6f0db/extractor/0.log"
Sep 14 11:31:27.868282 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:27.868257    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lp9t4/perf-node-gather-daemonset-47zpk"
Sep 14 11:31:29.140781 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:29.140754    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-78g92_d1f93ddc-dd8e-4e72-a814-9e25c19c4fee/manager/0.log"
Sep 14 11:31:29.371816 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:29.371782    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vvfzx_3897ecbc-c6ff-4ed7-bad7-15dbd3e0778b/manager/0.log"
Sep 14 11:31:29.760289 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:29.760256    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6d976668-prjcm_618b3422-5e84-4d75-a43b-0ebca9152fba/manager/0.log"
Sep 14 11:31:29.777227 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:29.777198    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6d976668-prjcm_618b3422-5e84-4d75-a43b-0ebca9152fba/copy-manifests/0.log"
Sep 14 11:31:32.220409 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:32.220333    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cr4vl_61962eb0-8148-421e-92d1-dd63e2c7d0ff/discovery/0.log"
Sep 14 11:31:32.247499 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:32.247474    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-848c99f856-pl4cb_0016e46a-a640-498f-9a78-1c89d1624d90/kube-auth-proxy/0.log"
Sep 14 11:31:32.268267 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:32.268244    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-82wsv_48062ff1-770b-4639-a806-4c17831a46cf/istio-proxy/0.log"
Sep 14 11:31:32.270996 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:32.270967    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-82wsv_48062ff1-770b-4639-a806-4c17831a46cf/istio-proxy/1.log"
Sep 14 11:31:32.310676 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:32.310643    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sqxlk_0c0c7a81-3670-439a-947d-4135b8c3d634/payload-processing/0.log"
Sep 14 11:31:32.329606 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:32.329587    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c77589b76-877mb_6d9f801b-600f-42a8-9d5d-445a14046fee/router/0.log"
Sep 14 11:31:34.245307 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:34.245274    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cr4vl_61962eb0-8148-421e-92d1-dd63e2c7d0ff/discovery/0.log"
Sep 14 11:31:34.278985 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:34.278947    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-848c99f856-pl4cb_0016e46a-a640-498f-9a78-1c89d1624d90/kube-auth-proxy/0.log"
Sep 14 11:31:34.299325 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:34.299301    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-82wsv_48062ff1-770b-4639-a806-4c17831a46cf/istio-proxy/0.log"
Sep 14 11:31:34.301542 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:34.301523    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-82wsv_48062ff1-770b-4639-a806-4c17831a46cf/istio-proxy/1.log"
Sep 14 11:31:34.350512 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:34.350489    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sqxlk_0c0c7a81-3670-439a-947d-4135b8c3d634/payload-processing/0.log"
Sep 14 11:31:34.366761 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:34.366707    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c77589b76-877mb_6d9f801b-600f-42a8-9d5d-445a14046fee/router/0.log"
Sep 14 11:31:36.427983 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:36.427956    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-qgtp2_dfab5228-0991-4a92-a5c8-c09ffa676ae4/migrator/0.log"
Sep 14 11:31:36.448990 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:36.448962    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-qgtp2_dfab5228-0991-4a92-a5c8-c09ffa676ae4/graceful-termination/0.log"
Sep 14 11:31:37.892164 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:37.892138    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9rc9_0217b90e-9602-4158-85d4-c39a2e2cb2d2/kube-multus-additional-cni-plugins/0.log"
Sep 14 11:31:37.911479 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:37.911449    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9rc9_0217b90e-9602-4158-85d4-c39a2e2cb2d2/egress-router-binary-copy/0.log"
Sep 14 11:31:37.930944 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:37.930921    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9rc9_0217b90e-9602-4158-85d4-c39a2e2cb2d2/cni-plugins/0.log"
Sep 14 11:31:37.957785 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:37.957765    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9rc9_0217b90e-9602-4158-85d4-c39a2e2cb2d2/bond-cni-plugin/0.log"
Sep 14 11:31:37.977516 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:37.977500    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9rc9_0217b90e-9602-4158-85d4-c39a2e2cb2d2/routeoverride-cni/0.log"
Sep 14 11:31:37.997063 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:37.997044    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9rc9_0217b90e-9602-4158-85d4-c39a2e2cb2d2/whereabouts-cni-bincopy/0.log"
Sep 14 11:31:38.015285 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:38.015269    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9rc9_0217b90e-9602-4158-85d4-c39a2e2cb2d2/whereabouts-cni/0.log"
Sep 14 11:31:38.199480 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:38.199411    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q2sr2_14dd0dea-9be0-4ab4-afc5-3061709d60cb/kube-multus/0.log"
Sep 14 11:31:38.343629 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:38.343603    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mxgs8_2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08/network-metrics-daemon/0.log"
Sep 14 11:31:38.360891 ip-10-0-142-201 kubenswrapper[2576]: I0914 11:31:38.360873    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mxgs8_2803d6ba-6e75-43c3-9a6d-bfeaef6a9d08/kube-rbac-proxy/0.log"