Sep 17 00:30:07.441284 ip-10-0-128-98 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 00:30:07.893015 ip-10-0-128-98 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 00:30:07.893015 ip-10-0-128-98 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 00:30:07.893015 ip-10-0-128-98 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 00:30:07.893015 ip-10-0-128-98 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 00:30:07.893015 ip-10-0-128-98 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 00:30:07.895044 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.894944    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 00:30:07.898788 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898761    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:30:07.898788 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898782    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:30:07.898788 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898788    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:30:07.898788 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898793    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898797    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898802    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898806    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898810    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898814    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898817    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898821    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898824    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898829    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898833    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898837    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898841    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898845    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898848    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898852    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898856    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898859    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898863    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898867    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:30:07.899060 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898871    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898875    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898879    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898882    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898886    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898891    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898895    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898899    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898903    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898908    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898912    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898916    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898920    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898924    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898930    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898935    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898939    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898944    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898947    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898952    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:30:07.899888 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898976    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898980    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898985    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898989    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898993    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.898997    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899001    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899008    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899014    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899020    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899025    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899029    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899034    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899038    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899042    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899047    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899051    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899055    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899059    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:30:07.900779 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899063    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899066    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899070    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899075    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899079    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899083    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899087    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899092    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899096    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899103    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899107    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899111    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899115    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899120    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899124    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899130    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899137    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899145    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899150    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:30:07.901487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899154    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899159    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899166    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899171    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899175    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899179    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899184    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899188    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899192    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899197    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899201    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899205    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899208    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899213    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899217    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899221    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899225    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.899229    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900425    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:30:07.902112 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900435    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900444    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900450    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900454    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900459    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900463    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900467    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900471    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900475    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900479    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900483    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900487    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900491    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900495    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900499    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900503    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900509    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900513    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900517    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:30:07.902986 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900521    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900525    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900529    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900533    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900537    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900541    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900545    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900549    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900553    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900557    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900561    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900565    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900569    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900573    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900577    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900582    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900586    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900590    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900594    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900598    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:30:07.903873 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900602    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900607    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900610    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900615    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900619    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900623    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900628    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900631    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900636    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900639    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900646    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900651    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900655    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900659    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900663    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900668    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900672    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900676    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900680    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900685    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:30:07.904487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900689    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900693    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900697    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900702    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900706    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900710    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900715    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900719    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900723    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900727    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900733    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900739    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900744    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900749    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900754    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900758    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900762    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900767    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900771    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:30:07.905083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900775    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900779    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900783    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900789    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900794    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900798    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900802    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900806    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900810    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900814    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900818    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900822    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900826    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900831    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900835    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900839    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900844    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900848    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900851    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.900859    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:30:07.905577 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902011    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902021    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902026    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902031    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902037    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902041    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902046    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902052    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902057    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902061    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902066    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902071    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902075    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902079    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902084    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902092    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902097    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902102    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902106    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:30:07.906244 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902109    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902116    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902122    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902126    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902133    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902138    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902144    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902148    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902153    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902157    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902161    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902166    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902170    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902174    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902178    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902182    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902187    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902191    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902195    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:30:07.906768 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902199    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902203    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902207    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902211    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902216    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902220    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902225    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902229    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902235    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902242    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902246    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902251    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902255    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902259    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902263    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902267    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902272    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902276    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902280    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902284    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:30:07.907271 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902288    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902292    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902297    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902301    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902305    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902309    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902313    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902317    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902322    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902326    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902333    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902337    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902341    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902345    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902349    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902353    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902357    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902361    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902366    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902370    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:30:07.907842 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902374    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902379    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902383    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902388    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902393    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902397    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902402    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902405    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902410    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902413    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902417    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902421    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902427    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902434    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902438    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902442    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902446    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902450    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902454    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902458    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:30:07.908387 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.902462    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902560    2576 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902612    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902622    2576 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902630    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902637    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902642    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902649    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902656    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902662    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902666    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902672    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902678    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902684    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902689    2576 flags.go:64] FLAG: --cgroup-root=""
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902694    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902699    2576 flags.go:64] FLAG: --client-ca-file=""
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902705    2576 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902709    2576 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902716    2576 flags.go:64] FLAG: --cluster-domain=""
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902721    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902726    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902731    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902736    2576 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 00:30:07.908887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902742    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902750    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902755    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902760    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902765    2576 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902769    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902774    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902779    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902784    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902790    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902795    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902800    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902804    2576 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902809    2576 flags.go:64] FLAG: --enable-server="true"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902813    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902820    2576 flags.go:64] FLAG: --event-burst="100"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902825    2576 flags.go:64] FLAG: --event-qps="50"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902830    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902835    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902839    2576 flags.go:64] FLAG: --eviction-hard=""
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902846    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902852    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902857    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902861    2576 flags.go:64] FLAG: --eviction-soft=""
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902867    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 00:30:07.909480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902872    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902877    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902882    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902887    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902892    2576 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902896    2576 flags.go:64] FLAG: --feature-gates=""
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902903    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902907    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902914    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902919    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902923    2576 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902929    2576 flags.go:64] FLAG: --help="false"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902933    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-98.ec2.internal"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902938    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902943    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902948    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902973    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902980    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902984    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902988    2576 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902992    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.902997    2576 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903001    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903006    2576 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 00:30:07.910158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903011    2576 flags.go:64] FLAG: --kube-reserved=""
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903015    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903020    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903025    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903031    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903036    2576 flags.go:64] FLAG: --lock-file=""
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903040    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903045    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903050    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903058    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903064    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903069    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903074    2576 flags.go:64] FLAG: --logging-format="text"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903078    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903084    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903088    2576 flags.go:64] FLAG: --manifest-url=""
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903095    2576 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903101    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903106    2576 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903113    2576 flags.go:64] FLAG: --max-pods="110"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903118    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903123    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903127    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903132    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903137    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 00:30:07.910828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903142    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903146    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903158    2576 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903163    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903167    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903172    2576 flags.go:64] FLAG: --pod-cidr=""
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903177    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903184    2576 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903189    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903194    2576 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903199    2576 flags.go:64] FLAG: --port="10250"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903206    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903210    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bee6da3dce2f3fb6"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903216    2576 flags.go:64] FLAG: --qos-reserved=""
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903220    2576 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903225    2576 flags.go:64] FLAG: --register-node="true"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903229    2576 flags.go:64] FLAG: --register-with-taints=""
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903235    2576 flags.go:64] FLAG: --registry-burst="10"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903242    2576 flags.go:64] FLAG: --registry-qps="5"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903247    2576 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903251    2576 flags.go:64] FLAG: --reserved-memory=""
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903257    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903262    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903267    2576 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903274    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 00:30:07.911530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903279    2576 flags.go:64] FLAG: --runonce="false"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903284    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903289    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903294    2576 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903298    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903303    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903307    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903312    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903317    2576 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903321    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903326    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903331    2576 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903335    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903340    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903344    2576 flags.go:64] FLAG: --system-cgroups=""
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903349    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903357    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903362    2576 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903368    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903375    2576 flags.go:64] FLAG: --tls-min-version=""
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903379    2576 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903384    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903389    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903393    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903398    2576 flags.go:64] FLAG: --v="2"
Sep 17 00:30:07.912172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903404    2576 flags.go:64] FLAG: --version="false"
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903412    2576 flags.go:64] FLAG: --vmodule=""
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903417    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.903423    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903616    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903622    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903629    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903633    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903638    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903642    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903646    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903651    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903656    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903659    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903663    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903667    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903671    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903676    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903681    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903685    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:30:07.912776 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903700    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903707    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903712    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903719    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903723    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903729    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903733    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903737    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903741    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903745    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903749    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903754    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903758    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903762    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903767    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903772    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903776    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903780    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903787    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:30:07.913284 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903791    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903795    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903799    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903804    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903808    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903812    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903816    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903821    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903824    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903829    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903834    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903840    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903844    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903849    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903853    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903857    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903861    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903864    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903870    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903873    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:30:07.913757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903877    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903881    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903885    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903888    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903892    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903896    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903900    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903904    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903909    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903914    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903919    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903924    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903928    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903932    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903936    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903941    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903944    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903949    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903953    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903975    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:30:07.914275 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903979    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903984    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903988    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903992    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.903996    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904001    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904007    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904013    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904018    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904022    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904027    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904032    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904036    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904040    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904044    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904048    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904052    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904056    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904061    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:30:07.914764 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904064    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904069    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904074    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904078    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.904085    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.904673    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.911935    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.911950    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.912789    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.912799    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912859    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912865    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912868    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912871    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912874    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:30:07.915259 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912877    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912880    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912883    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912886    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912888    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912891    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912894    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912897    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912900    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912903    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912905    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912907    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912910    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912913    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912915    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912918    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912920    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912923    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912926    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912929    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:30:07.915632 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912931    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912934    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912936    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912939    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912941    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912944    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912946    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912949    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912951    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912968    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912971    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912974    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912976    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912980    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912984    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912987    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912990    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912992    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912995    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:30:07.916191 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.912997    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913000    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913002    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913005    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913007    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913011    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913013    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913016    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913018    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913021    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913023    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913026    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913028    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913032    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913034    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913037    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913039    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913042    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913045    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913047    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:30:07.916657 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913050    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913052    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913054    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913057    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913059    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913062    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913064    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913067    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913069    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913071    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913074    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913079    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913082    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913085    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913088    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913091    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913093    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913096    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913099    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:30:07.917170 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913101    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913104    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913106    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913109    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913111    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913113    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913116    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913119    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913123    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913127    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913129    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913132    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913134    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913137    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913139    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:30:07.917621 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913142    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.913147    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913254    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913259    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913263    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913266    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913268    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913271    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913273    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913276    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913279    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913281    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913284    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913286    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:30:07.918003 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913289    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913292    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913294    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913297    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913300    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913302    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913304    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913307    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913309    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913312    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913315    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913318    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913320    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913323    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913325    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913327    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913330    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913332    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913335    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913337    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:30:07.918357 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913340    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913344    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913347    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913350    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913353    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913356    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913359    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913362    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913364    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913367    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913369    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913372    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913374    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913377    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913379    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913382    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913384    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913386    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913389    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913391    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:30:07.918870 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913394    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913397    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913399    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913402    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913405    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913407    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913409    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913412    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913414    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913417    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913419    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913421    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913424    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913426    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913428    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913431    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913433    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913436    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913438    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913440    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:30:07.919375 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913443    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913445    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913447    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913450    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913453    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913455    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913459    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913461    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913464    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913466    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913468    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913471    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913473    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913475    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913478    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913481    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913483    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913486    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913488    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913491    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:30:07.919911 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913493    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913496    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913498    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913501    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913503    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913506    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:07.913508    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.913513    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.913615    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.915577    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.916734    2576 server.go:1019] "Starting client certificate rotation"
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.916831    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.916877    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 00:30:07.920408 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.920050    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 00:30:07.923814 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.923605    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 00:30:07.934535 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.934510    2576 log.go:25] "Validated CRI v1 runtime API"
Sep 17 00:30:07.938673 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.938650    2576 log.go:25] "Validated CRI v1 image API"
Sep 17 00:30:07.940053 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.940022    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 00:30:07.943534 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.943513    2576 fs.go:135] Filesystem UUIDs: map[0bc4a7f9-37a2-447f-9801-253cbf380ae2:/dev/nvme0n1p3 4a6d770c-a18f-4f90-a7f7-f6fe39c2c6ab:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 17 00:30:07.943611 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.943533    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 00:30:07.946270 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.946253    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 00:30:07.950236 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.950120    2576 manager.go:216] Machine: {Timestamp:2026-09-17 00:30:07.948853262 +0000 UTC m=+0.376311176 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101603 MemoryCapacity:32812146688 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2584f050642669a98684e01f21978b SystemUUID:ec2584f0-5064-2669-a986-84e01f21978b BootID:e6273b80-bd0a-4266-9706-8138afc7f00a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406073344 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cb:5b:78:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cb:5b:78:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:ff:61:c2:81:b6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812146688 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 00:30:07.950236 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.950234    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 00:30:07.950355 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.950312    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 00:30:07.953403 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.953381    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 00:30:07.953541 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.953405    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-98.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 00:30:07.954270 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.954260    2576 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 00:30:07.954309 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.954273    2576 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 00:30:07.954309 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.954281    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 00:30:07.954992 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.954982    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 00:30:07.955760 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.955750    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 00:30:07.959609 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.959598    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 00:30:07.959727 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.959717    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 00:30:07.959765 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.959748    2576 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 00:30:07.959765 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.959763    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 00:30:07.959825 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.959777    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 00:30:07.959825 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.959788    2576 kubelet.go:398] "Adding apiserver pod source"
Sep 17 00:30:07.959825 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.959801    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 00:30:07.960232 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.960218    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 00:30:07.960328 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.960246    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 00:30:07.965242 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.965210    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 00:30:07.965336 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.965321    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp7wh"
Sep 17 00:30:07.967180 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.967160    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 00:30:07.967260 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.967202    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 00:30:07.969199 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969185    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 00:30:07.969286 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969209    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 00:30:07.969286 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969218    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 00:30:07.969286 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969227    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 00:30:07.969286 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969239    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 00:30:07.969286 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969247    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 00:30:07.969286 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969266    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 00:30:07.969286 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969273    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 00:30:07.969503 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969292    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 00:30:07.969503 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969300    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 00:30:07.969503 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969313    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 00:30:07.969503 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969321    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 00:30:07.969982 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969971    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 00:30:07.970039 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.969985    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 00:30:07.972323 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.972178    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp7wh"
Sep 17 00:30:07.973757 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.973716    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-98.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 00:30:07.973757 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:07.973747    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 00:30:07.973899 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.973765    2576 server.go:1268] "Started kubelet"
Sep 17 00:30:07.973899 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:07.973797    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 00:30:07.973899 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.973836    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 00:30:07.973899 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.973836    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 00:30:07.973899 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.973880    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 00:30:07.977006 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.976985    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 00:30:07.977677 ip-10-0-128-98 systemd[1]: Started Kubernetes Kubelet.
Sep 17 00:30:07.979271 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:07.979249    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 00:30:07.980785 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.980759    2576 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 00:30:07.983408 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:07.982255    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-98.ec2.internal.18d5f445e488f0e4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-98.ec2.internal,UID:ip-10-0-128-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-98.ec2.internal,},FirstTimestamp:2026-09-17 00:30:07.973740772 +0000 UTC m=+0.401198686,LastTimestamp:2026-09-17 00:30:07.973740772 +0000 UTC m=+0.401198686,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-98.ec2.internal,}"
Sep 17 00:30:07.985133 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.985114    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 00:30:07.985773 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.985756    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 00:30:07.985946 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:07.985927    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:07.986378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986359    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 00:30:07.986378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986369    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 00:30:07.986378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986378    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 00:30:07.986545 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986479    2576 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 00:30:07.986545 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986488    2576 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 00:30:07.986545 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986517    2576 factory.go:55] Registering systemd factory
Sep 17 00:30:07.986545 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986533    2576 factory.go:223] Registration of the systemd container factory successfully
Sep 17 00:30:07.986769 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986757    2576 factory.go:153] Registering CRI-O factory
Sep 17 00:30:07.986804 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986773    2576 factory.go:223] Registration of the crio container factory successfully
Sep 17 00:30:07.986834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986809    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 00:30:07.986834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986821    2576 factory.go:103] Registering Raw factory
Sep 17 00:30:07.986834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.986831    2576 manager.go:1196] Started watching for new ooms in manager
Sep 17 00:30:07.987213 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.987200    2576 manager.go:349] Starting recovery of all containers
Sep 17 00:30:07.995334 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.995308    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:30:07.997624 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:07.997602    2576 manager.go:354] Recovery completed
Sep 17 00:30:07.997718 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:07.997640    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-98.ec2.internal\" not found" node="ip-10-0-128-98.ec2.internal"
Sep 17 00:30:07.999467 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:07.999448    2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 17 00:30:08.002781 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.002769    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:30:08.004736 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.004723    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:30:08.004789 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.004749    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:30:08.004789 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.004763    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:30:08.005394 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.005378    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 00:30:08.005394 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.005392    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 00:30:08.005534 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.005402    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:30:08.005534 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.005412    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 00:30:08.006355 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.006337    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:30:08.006408 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.006371    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:30:08.006408 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.006386    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:30:08.007677 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.007664    2576 policy_none.go:49] "None policy: Start"
Sep 17 00:30:08.007761 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.007682    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 00:30:08.007761 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.007704    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 00:30:08.009715 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.009702    2576 policy_none.go:47] "Start"
Sep 17 00:30:08.047587 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.047570    2576 manager.go:337] "Starting Device Plugin manager"
Sep 17 00:30:08.065696 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.047620    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 00:30:08.065696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.047631    2576 server.go:87] "Starting device plugin registration server"
Sep 17 00:30:08.065696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.048002    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 00:30:08.065696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.048013    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 00:30:08.065696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.048125    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 00:30:08.065696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.048211    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 00:30:08.065696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.048220    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 00:30:08.065696 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.048712    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 00:30:08.065696 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.048757    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:08.133227 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.133192    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 00:30:08.134481 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.134465    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 00:30:08.134564 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.134524    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 00:30:08.134564 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.134558    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 00:30:08.134661 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.134607    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 00:30:08.136659 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.136638    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:30:08.148618 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.148603    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:30:08.149606 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.149592    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:30:08.149695 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.149626    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:30:08.149695 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.149642    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:30:08.149695 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.149674    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.155024 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.155008    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.155121 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.155032    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-98.ec2.internal\": node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:08.168835 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.168817    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:08.234866 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.234826    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-98.ec2.internal"]
Sep 17 00:30:08.235035 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.234920    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:30:08.236509 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.236492    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:30:08.236598 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.236524    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:30:08.236598 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.236536    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:30:08.238863 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.238850    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:30:08.239043 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.239030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.239085 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.239059    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:30:08.239630 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.239612    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:30:08.239727 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.239641    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:30:08.239727 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.239651    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:30:08.239727 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.239619    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:30:08.239727 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.239723    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:30:08.239850 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.239734    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:30:08.242007 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.241993    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.242063 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.242023    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:30:08.242722 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.242705    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:30:08.242816 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.242733    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:30:08.242816 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.242747    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:30:08.263509 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.263491    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-98.ec2.internal\" not found" node="ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.267934 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.267918    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-98.ec2.internal\" not found" node="ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.268914 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.268901    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:08.288465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.288438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db7cd5fe2b3fbb28de2fb060564fe5f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal\" (UID: \"db7cd5fe2b3fbb28de2fb060564fe5f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.288465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.288464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee2bbf241d4d47d45cb8a3bfac597f7f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-98.ec2.internal\" (UID: \"ee2bbf241d4d47d45cb8a3bfac597f7f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.288601 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.288483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db7cd5fe2b3fbb28de2fb060564fe5f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal\" (UID: \"db7cd5fe2b3fbb28de2fb060564fe5f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.369337 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.369307    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:08.388610 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.388585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db7cd5fe2b3fbb28de2fb060564fe5f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal\" (UID: \"db7cd5fe2b3fbb28de2fb060564fe5f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.388680 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.388625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db7cd5fe2b3fbb28de2fb060564fe5f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal\" (UID: \"db7cd5fe2b3fbb28de2fb060564fe5f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.388680 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.388634    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db7cd5fe2b3fbb28de2fb060564fe5f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal\" (UID: \"db7cd5fe2b3fbb28de2fb060564fe5f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.388680 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.388645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee2bbf241d4d47d45cb8a3bfac597f7f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-98.ec2.internal\" (UID: \"ee2bbf241d4d47d45cb8a3bfac597f7f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.388680 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.388675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee2bbf241d4d47d45cb8a3bfac597f7f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-98.ec2.internal\" (UID: \"ee2bbf241d4d47d45cb8a3bfac597f7f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.388797 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.388707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db7cd5fe2b3fbb28de2fb060564fe5f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal\" (UID: \"db7cd5fe2b3fbb28de2fb060564fe5f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.470078 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.469999    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:08.565559 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.565523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.571107 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.570363    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:08.571107 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.570395    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:08.670952 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.670903    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:08.771488 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.771406    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:08.862755 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.862721    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:30:08.871513 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.871487    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:08.916887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.916861    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 00:30:08.917328 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.917013    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 00:30:08.917328 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.917035    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 00:30:08.917328 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.917046    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 00:30:08.972452 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:08.972424    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:08.977751 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.977727    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 00:25:07 +0000 UTC" deadline="2028-04-16 11:07:58.305623888 +0000 UTC"
Sep 17 00:30:08.977817 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:08.977752    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13858h37m49.327874873s"
Sep 17 00:30:09.072912 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:09.072811    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-98.ec2.internal\" not found"
Sep 17 00:30:09.129790 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.129764    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:30:09.186187 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.186161    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:09.195883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.195867    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 00:30:09.196786 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.196773    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-98.ec2.internal"
Sep 17 00:30:09.202036 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.202019    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 00:30:09.261213 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:09.261174    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2bbf241d4d47d45cb8a3bfac597f7f.slice/crio-0d023ed7d14095bae1201686293e82c0de4f9effc5472c0e3e725d59273c57ed WatchSource:0}: Error finding container 0d023ed7d14095bae1201686293e82c0de4f9effc5472c0e3e725d59273c57ed: Status 404 returned error can't find the container with id 0d023ed7d14095bae1201686293e82c0de4f9effc5472c0e3e725d59273c57ed
Sep 17 00:30:09.266358 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.266342    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:30:09.486692 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:09.486669    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7cd5fe2b3fbb28de2fb060564fe5f8.slice/crio-a1f9b86f47dacb240f3df345f4b147b31fae9a1ed84cef73441b3274cb77da5c WatchSource:0}: Error finding container a1f9b86f47dacb240f3df345f4b147b31fae9a1ed84cef73441b3274cb77da5c: Status 404 returned error can't find the container with id a1f9b86f47dacb240f3df345f4b147b31fae9a1ed84cef73441b3274cb77da5c
Sep 17 00:30:09.742783 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.742677    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:30:09.759153 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.759124    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:30:09.961073 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.961044    2576 apiserver.go:52] "Watching apiserver"
Sep 17 00:30:09.967704 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.967681    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 00:30:09.968510 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.968200    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-xm8jp","openshift-multus/network-metrics-daemon-hf4kw","openshift-network-diagnostics/network-check-target-sr855","kube-system/kube-apiserver-proxy-ip-10-0-128-98.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dbmwm","openshift-image-registry/node-ca-xv89m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal","openshift-multus/multus-additional-cni-plugins-2m9vh","openshift-network-operator/iptables-alerter-qlp7k","openshift-ovn-kubernetes/ovnkube-node-x5qvl","kube-system/global-pull-secret-syncer-drkmn","kube-system/konnectivity-agent-z65fg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7","openshift-dns/node-resolver-b6lfq"]
Sep 17 00:30:09.971350 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.970662    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:09.973169 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.973149    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m68w8\""
Sep 17 00:30:09.973435 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.973417    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 00:30:09.973591 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.973561    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 00:30:09.973654 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.973592    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 00:30:09.976052 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.976023    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:09.976392 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:09.976158    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:09.976392 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.976310    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:09.976548 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:09.976389    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:09.980396 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.979885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.981555 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.981534    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.982255 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.981909    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 00:30:09.982255 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.981988    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 00:30:09.982255 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.982138    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 00:30:09.982255 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.982162    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 00:30:09.982439 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.982356    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bdws5\""
Sep 17 00:30:09.983681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.983664    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xv89m"
Sep 17 00:30:09.984094 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.984077    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 00:30:09.984232 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.984221    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:30:09.984486 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.984474    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wh4r5\""
Sep 17 00:30:09.985496 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.985477    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 00:30:09.985609 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.985588    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 00:30:09.985703 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.985694    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 00:30:09.986146 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.985873    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tqndc\""
Sep 17 00:30:09.986146 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.985892    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b6lfq"
Sep 17 00:30:09.986146 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.985894    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 00:30:09.987879 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.987860    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 00:30:09.988004 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.987947    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 00:30:09.988052 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.987861    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n4jsj\""
Sep 17 00:30:09.988247 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.988228    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:09.990277 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.990261    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lvf5v\""
Sep 17 00:30:09.990397 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.990379    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 00:30:09.990459 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.990420    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 00:30:09.991252 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.991235    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlp7k"
Sep 17 00:30:09.993797 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.993758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:09.994397 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.994380    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 00:30:09.994489 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.994401    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 00:30:09.994583 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.994568    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:30:09.994668 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.994597    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tmsdl\""
Sep 17 00:30:09.995686 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.995670    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 00:30:09.996031 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996017    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:09.996117 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:09.996082    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:09.996357 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996319    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996624    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-var-lib-cni-bin\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-conf-dir\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b09882e1-0cd9-4fbe-941a-fa217471afbb-system-cni-dir\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-modprobe-d\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14b03180-1da9-4fe4-8df1-564bc4fecfcf-tmp\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fba316c-30a0-4da6-b8fb-cc90962a2984-host\") pod \"node-ca-xv89m\" (UID: \"1fba316c-30a0-4da6-b8fb-cc90962a2984\") " pod="openshift-image-registry/node-ca-xv89m"
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996848    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgws8\" (UniqueName: \"kubernetes.io/projected/1fba316c-30a0-4da6-b8fb-cc90962a2984-kube-api-access-lgws8\") pod \"node-ca-xv89m\" (UID: \"1fba316c-30a0-4da6-b8fb-cc90962a2984\") " pod="openshift-image-registry/node-ca-xv89m"
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996872    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b-tmp-dir\") pod \"node-resolver-b6lfq\" (UID: \"a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b\") " pod="openshift-dns/node-resolver-b6lfq"
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.996985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb7v2\" (UniqueName: \"kubernetes.io/projected/b09882e1-0cd9-4fbe-941a-fa217471afbb-kube-api-access-wb7v2\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:09.997008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-socket-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch8qd\" (UniqueName: \"kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd\") pod \"network-check-target-sr855\" (UID: \"59c0329b-9905-4051-b603-fc4d3d17873c\") " pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997067    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-var-lib-cni-multus\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-hostroot\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-kubernetes\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997166    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-lib-modules\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b09882e1-0cd9-4fbe-941a-fa217471afbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-device-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pvnr\" (UniqueName: \"kubernetes.io/projected/0ce8bade-b989-4083-a84c-f0502f829fcd-kube-api-access-9pvnr\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997337    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-daemon-config\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997371    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-sysctl-conf\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997392    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-systemd\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997405    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-run\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1fba316c-30a0-4da6-b8fb-cc90962a2984-serviceca\") pod \"node-ca-xv89m\" (UID: \"1fba316c-30a0-4da6-b8fb-cc90962a2984\") " pod="openshift-image-registry/node-ca-xv89m"
Sep 17 00:30:09.997540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997419    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-47w5m\""
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-sys-fs\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-socket-dir-parent\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-run-k8s-cni-cncf-io\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-etc-kubernetes\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-sysconfig\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b-hosts-file\") pod \"node-resolver-b6lfq\" (UID: \"a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b\") " pod="openshift-dns/node-resolver-b6lfq"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b09882e1-0cd9-4fbe-941a-fa217471afbb-cnibin\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-system-cni-dir\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-var-lib-kubelet\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbgmv\" (UniqueName: \"kubernetes.io/projected/14b03180-1da9-4fe4-8df1-564bc4fecfcf-kube-api-access-sbgmv\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997748    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b09882e1-0cd9-4fbe-941a-fa217471afbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b09882e1-0cd9-4fbe-941a-fa217471afbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs2qk\" (UniqueName: \"kubernetes.io/projected/f3834b70-3e64-4873-ab8e-b551c9504f6d-kube-api-access-cs2qk\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-cnibin\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.998297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sgd8\" (UniqueName: \"kubernetes.io/projected/138ffd91-a273-46b4-bd1a-b59abe010b48-kube-api-access-8sgd8\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997867    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-sysctl-d\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-sys\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-var-lib-kubelet\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.997947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-host\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.998002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-tuned\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.998026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b09882e1-0cd9-4fbe-941a-fa217471afbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.998047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-cni-dir\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.998060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-run-netns\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.998072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-run-multus-certs\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.998087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm5bm\" (UniqueName: \"kubernetes.io/projected/a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b-kube-api-access-fm5bm\") pod \"node-resolver-b6lfq\" (UID: \"a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b\") " pod="openshift-dns/node-resolver-b6lfq"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.998133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-registration-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.998158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/138ffd91-a273-46b4-bd1a-b59abe010b48-cni-binary-copy\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.998527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:09.999058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:09.998759    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 00:30:10.000447 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.000428    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 00:30:10.000575 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.000558    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 00:30:10.000662 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.000648    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kt69v\""
Sep 17 00:30:10.015870 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.015851    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9tp9d"
Sep 17 00:30:10.022977 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.022944    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9tp9d"
Sep 17 00:30:10.087206 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.087176    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 00:30:10.098556 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.098532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:10.098732 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.098563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-log-socket\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.098732 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.098579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-cni-bin\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.098732 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.098596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b09882e1-0cd9-4fbe-941a-fa217471afbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.098732 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.098622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-device-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.098732 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.098706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-device-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.099064 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.098750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-sysctl-conf\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.099064 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.098774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-run\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.099064 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.098778    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:10.099064 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.098813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1fba316c-30a0-4da6-b8fb-cc90962a2984-serviceca\") pod \"node-ca-xv89m\" (UID: \"1fba316c-30a0-4da6-b8fb-cc90962a2984\") " pod="openshift-image-registry/node-ca-xv89m"
Sep 17 00:30:10.099064 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.098834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-run-ovn\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.099064 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.098872    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs podName:f3834b70-3e64-4873-ab8e-b551c9504f6d nodeName:}" failed. No retries permitted until 2026-09-17 00:30:10.598831892 +0000 UTC m=+3.026289806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs") pod "network-metrics-daemon-hf4kw" (UID: "f3834b70-3e64-4873-ab8e-b551c9504f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:10.099317 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1fba316c-30a0-4da6-b8fb-cc90962a2984-serviceca\") pod \"node-ca-xv89m\" (UID: \"1fba316c-30a0-4da6-b8fb-cc90962a2984\") " pod="openshift-image-registry/node-ca-xv89m"
Sep 17 00:30:10.099394 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099374    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b09882e1-0cd9-4fbe-941a-fa217471afbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.099533 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099518    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-sysctl-conf\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.099586 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.099586 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-socket-dir-parent\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.099694 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-etc-kubernetes\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.099694 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099600    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-run\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.099694 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099611    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b09882e1-0cd9-4fbe-941a-fa217471afbb-cnibin\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.099694 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099646    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b09882e1-0cd9-4fbe-941a-fa217471afbb-cnibin\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.099694 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b09882e1-0cd9-4fbe-941a-fa217471afbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.099694 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d028a8f3-fd72-4b0d-80cf-5b42b0d344bd-agent-certs\") pod \"konnectivity-agent-z65fg\" (UID: \"d028a8f3-fd72-4b0d-80cf-5b42b0d344bd\") " pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:10.099694 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099686    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-socket-dir-parent\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.100071 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbgmv\" (UniqueName: \"kubernetes.io/projected/14b03180-1da9-4fe4-8df1-564bc4fecfcf-kube-api-access-sbgmv\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.100071 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-var-lib-openvswitch\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.100071 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-run-ovn-kubernetes\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.100071 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-cnibin\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.100071 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.099783    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.100071 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100028    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-cnibin\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.100071 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100033    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-etc-kubernetes\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.100071 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-host\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100108    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbf8371a-4deb-4395-8f22-e52aea021f62-env-overrides\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100124    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b09882e1-0cd9-4fbe-941a-fa217471afbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100135    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbf8371a-4deb-4395-8f22-e52aea021f62-ovn-node-metrics-cert\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-host\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-cni-dir\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-run-netns\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-run-multus-certs\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm5bm\" (UniqueName: \"kubernetes.io/projected/a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b-kube-api-access-fm5bm\") pod \"node-resolver-b6lfq\" (UID: \"a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b\") " pod="openshift-dns/node-resolver-b6lfq"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100264    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-run-multus-certs\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100272    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-run-netns\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-slash\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-cni-netd\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100351    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-cni-dir\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55972c67-d658-4505-9eae-4c41003b146f-iptables-alerter-script\") pod \"iptables-alerter-qlp7k\" (UID: \"55972c67-d658-4505-9eae-4c41003b146f\") " pod="openshift-network-operator/iptables-alerter-qlp7k"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-run-netns\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-dbus\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:10.100452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d028a8f3-fd72-4b0d-80cf-5b42b0d344bd-konnectivity-ca\") pod \"konnectivity-agent-z65fg\" (UID: \"d028a8f3-fd72-4b0d-80cf-5b42b0d344bd\") " pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14b03180-1da9-4fe4-8df1-564bc4fecfcf-tmp\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b-tmp-dir\") pod \"node-resolver-b6lfq\" (UID: \"a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b\") " pod="openshift-dns/node-resolver-b6lfq"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-run-openvswitch\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26jwm\" (UniqueName: \"kubernetes.io/projected/bbf8371a-4deb-4395-8f22-e52aea021f62-kube-api-access-26jwm\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-socket-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8qd\" (UniqueName: \"kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd\") pod \"network-check-target-sr855\" (UID: \"59c0329b-9905-4051-b603-fc4d3d17873c\") " pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-var-lib-cni-multus\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-hostroot\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-kubernetes\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100653    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-socket-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100683    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-hostroot\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100696    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-var-lib-cni-multus\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-kubernetes\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-lib-modules\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b09882e1-0cd9-4fbe-941a-fa217471afbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100793    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b-tmp-dir\") pod \"node-resolver-b6lfq\" (UID: \"a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b\") " pod="openshift-dns/node-resolver-b6lfq"
Sep 17 00:30:10.101226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pvnr\" (UniqueName: \"kubernetes.io/projected/0ce8bade-b989-4083-a84c-f0502f829fcd-kube-api-access-9pvnr\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-daemon-config\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-lib-modules\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b09882e1-0cd9-4fbe-941a-fa217471afbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-systemd\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-kubelet-config\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.100987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-sys-fs\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-systemd\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101003    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-run-k8s-cni-cncf-io\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-run-k8s-cni-cncf-io\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-sysconfig\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101066    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b-hosts-file\") pod \"node-resolver-b6lfq\" (UID: \"a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b\") " pod="openshift-dns/node-resolver-b6lfq"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-sys-fs\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101093    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-sysconfig\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b-hosts-file\") pod \"node-resolver-b6lfq\" (UID: \"a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b\") " pod="openshift-dns/node-resolver-b6lfq"
Sep 17 00:30:10.101883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b09882e1-0cd9-4fbe-941a-fa217471afbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbf8371a-4deb-4395-8f22-e52aea021f62-ovnkube-script-lib\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-system-cni-dir\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-var-lib-kubelet\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs2qk\" (UniqueName: \"kubernetes.io/projected/f3834b70-3e64-4873-ab8e-b551c9504f6d-kube-api-access-cs2qk\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55972c67-d658-4505-9eae-4c41003b146f-host-slash\") pod \"iptables-alerter-qlp7k\" (UID: \"55972c67-d658-4505-9eae-4c41003b146f\") " pod="openshift-network-operator/iptables-alerter-qlp7k"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101286    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-system-cni-dir\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sgd8\" (UniqueName: \"kubernetes.io/projected/138ffd91-a273-46b4-bd1a-b59abe010b48-kube-api-access-8sgd8\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-sysctl-d\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-sys\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-var-lib-kubelet\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-tuned\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-node-log\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-daemon-config\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-etc-openvswitch\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:10.102692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-registration-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/138ffd91-a273-46b4-bd1a-b59abe010b48-cni-binary-copy\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-var-lib-cni-bin\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-var-lib-kubelet\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101585    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-host-var-lib-cni-bin\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-conf-dir\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101613    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/138ffd91-a273-46b4-bd1a-b59abe010b48-multus-conf-dir\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b09882e1-0cd9-4fbe-941a-fa217471afbb-system-cni-dir\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-run-systemd\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101668    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbf8371a-4deb-4395-8f22-e52aea021f62-ovnkube-config\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101672    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b09882e1-0cd9-4fbe-941a-fa217471afbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-modprobe-d\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fba316c-30a0-4da6-b8fb-cc90962a2984-host\") pod \"node-ca-xv89m\" (UID: \"1fba316c-30a0-4da6-b8fb-cc90962a2984\") " pod="openshift-image-registry/node-ca-xv89m"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgws8\" (UniqueName: \"kubernetes.io/projected/1fba316c-30a0-4da6-b8fb-cc90962a2984-kube-api-access-lgws8\") pod \"node-ca-xv89m\" (UID: \"1fba316c-30a0-4da6-b8fb-cc90962a2984\") " pod="openshift-image-registry/node-ca-xv89m"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb7v2\" (UniqueName: \"kubernetes.io/projected/b09882e1-0cd9-4fbe-941a-fa217471afbb-kube-api-access-wb7v2\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b09882e1-0cd9-4fbe-941a-fa217471afbb-system-cni-dir\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fba316c-30a0-4da6-b8fb-cc90962a2984-host\") pod \"node-ca-xv89m\" (UID: \"1fba316c-30a0-4da6-b8fb-cc90962a2984\") " pod="openshift-image-registry/node-ca-xv89m"
Sep 17 00:30:10.103530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-kubelet\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.104389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101813    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ce8bade-b989-4083-a84c-f0502f829fcd-registration-dir\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.104389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-sysctl-d\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.104389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101837    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-systemd-units\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.104389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101877    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-sys\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.104389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-modprobe-d\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.104389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101984    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wndm\" (UniqueName: \"kubernetes.io/projected/55972c67-d658-4505-9eae-4c41003b146f-kube-api-access-5wndm\") pod \"iptables-alerter-qlp7k\" (UID: \"55972c67-d658-4505-9eae-4c41003b146f\") " pod="openshift-network-operator/iptables-alerter-qlp7k"
Sep 17 00:30:10.104389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.101990    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14b03180-1da9-4fe4-8df1-564bc4fecfcf-var-lib-kubelet\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.104389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.102232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/138ffd91-a273-46b4-bd1a-b59abe010b48-cni-binary-copy\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.105208 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.105188    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/14b03180-1da9-4fe4-8df1-564bc4fecfcf-etc-tuned\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.106179 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.106139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14b03180-1da9-4fe4-8df1-564bc4fecfcf-tmp\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.107401 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.107380    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:30:10.107490 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.107407    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:30:10.107490 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.107420    2576 projected.go:196] Error preparing data for projected volume kube-api-access-ch8qd for pod openshift-network-diagnostics/network-check-target-sr855: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:10.107490 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.107486    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd podName:59c0329b-9905-4051-b603-fc4d3d17873c nodeName:}" failed. No retries permitted until 2026-09-17 00:30:10.607469628 +0000 UTC m=+3.034927531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ch8qd" (UniqueName: "kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd") pod "network-check-target-sr855" (UID: "59c0329b-9905-4051-b603-fc4d3d17873c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:10.108591 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.108145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbgmv\" (UniqueName: \"kubernetes.io/projected/14b03180-1da9-4fe4-8df1-564bc4fecfcf-kube-api-access-sbgmv\") pod \"tuned-dbmwm\" (UID: \"14b03180-1da9-4fe4-8df1-564bc4fecfcf\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.109548 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.109521    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm5bm\" (UniqueName: \"kubernetes.io/projected/a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b-kube-api-access-fm5bm\") pod \"node-resolver-b6lfq\" (UID: \"a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b\") " pod="openshift-dns/node-resolver-b6lfq"
Sep 17 00:30:10.109971 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.109939    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pvnr\" (UniqueName: \"kubernetes.io/projected/0ce8bade-b989-4083-a84c-f0502f829fcd-kube-api-access-9pvnr\") pod \"aws-ebs-csi-driver-node-76cf7\" (UID: \"0ce8bade-b989-4083-a84c-f0502f829fcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.110782 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.110732    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgws8\" (UniqueName: \"kubernetes.io/projected/1fba316c-30a0-4da6-b8fb-cc90962a2984-kube-api-access-lgws8\") pod \"node-ca-xv89m\" (UID: \"1fba316c-30a0-4da6-b8fb-cc90962a2984\") " pod="openshift-image-registry/node-ca-xv89m"
Sep 17 00:30:10.111453 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.111429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs2qk\" (UniqueName: \"kubernetes.io/projected/f3834b70-3e64-4873-ab8e-b551c9504f6d-kube-api-access-cs2qk\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:10.112748 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.112723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sgd8\" (UniqueName: \"kubernetes.io/projected/138ffd91-a273-46b4-bd1a-b59abe010b48-kube-api-access-8sgd8\") pod \"multus-xm8jp\" (UID: \"138ffd91-a273-46b4-bd1a-b59abe010b48\") " pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.113277 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.113256    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb7v2\" (UniqueName: \"kubernetes.io/projected/b09882e1-0cd9-4fbe-941a-fa217471afbb-kube-api-access-wb7v2\") pod \"multus-additional-cni-plugins-2m9vh\" (UID: \"b09882e1-0cd9-4fbe-941a-fa217471afbb\") " pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.140022 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.139981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal" event={"ID":"db7cd5fe2b3fbb28de2fb060564fe5f8","Type":"ContainerStarted","Data":"a1f9b86f47dacb240f3df345f4b147b31fae9a1ed84cef73441b3274cb77da5c"}
Sep 17 00:30:10.141029 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.140998    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-98.ec2.internal" event={"ID":"ee2bbf241d4d47d45cb8a3bfac597f7f","Type":"ContainerStarted","Data":"0d023ed7d14095bae1201686293e82c0de4f9effc5472c0e3e725d59273c57ed"}
Sep 17 00:30:10.202329 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-kubelet-config\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:10.202508 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbf8371a-4deb-4395-8f22-e52aea021f62-ovnkube-script-lib\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.202508 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.202508 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55972c67-d658-4505-9eae-4c41003b146f-host-slash\") pod \"iptables-alerter-qlp7k\" (UID: \"55972c67-d658-4505-9eae-4c41003b146f\") " pod="openshift-network-operator/iptables-alerter-qlp7k"
Sep 17 00:30:10.202508 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-node-log\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.202508 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.202508 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-kubelet-config\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:10.202508 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-etc-openvswitch\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.202508 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202493    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-node-log\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.202508 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:10.202779 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-run-systemd\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.202779 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202532    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-etc-openvswitch\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.202779 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-run-systemd\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.202779 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbf8371a-4deb-4395-8f22-e52aea021f62-ovnkube-config\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.202779 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.202613    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:10.202779 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202638    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-kubelet\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.202779 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.202675    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret podName:c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3 nodeName:}" failed. No retries permitted until 2026-09-17 00:30:10.702656598 +0000 UTC m=+3.130114513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret") pod "global-pull-secret-syncer-drkmn" (UID: "c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:10.203011 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-kubelet\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203011 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-systemd-units\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203011 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wndm\" (UniqueName: \"kubernetes.io/projected/55972c67-d658-4505-9eae-4c41003b146f-kube-api-access-5wndm\") pod \"iptables-alerter-qlp7k\" (UID: \"55972c67-d658-4505-9eae-4c41003b146f\") " pod="openshift-network-operator/iptables-alerter-qlp7k"
Sep 17 00:30:10.203011 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202938    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbf8371a-4deb-4395-8f22-e52aea021f62-ovnkube-script-lib\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203011 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.202953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-log-socket\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203011 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-cni-bin\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203191 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203015    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-log-socket\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203191 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203060    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-cni-bin\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203191 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203066    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-systemd-units\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203191 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-run-ovn\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203191 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55972c67-d658-4505-9eae-4c41003b146f-host-slash\") pod \"iptables-alerter-qlp7k\" (UID: \"55972c67-d658-4505-9eae-4c41003b146f\") " pod="openshift-network-operator/iptables-alerter-qlp7k"
Sep 17 00:30:10.203191 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d028a8f3-fd72-4b0d-80cf-5b42b0d344bd-agent-certs\") pod \"konnectivity-agent-z65fg\" (UID: \"d028a8f3-fd72-4b0d-80cf-5b42b0d344bd\") " pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:10.203191 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-var-lib-openvswitch\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203191 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-run-ovn\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203191 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-run-ovn-kubernetes\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203191 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbf8371a-4deb-4395-8f22-e52aea021f62-ovnkube-config\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-var-lib-openvswitch\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203199    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-run-ovn-kubernetes\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbf8371a-4deb-4395-8f22-e52aea021f62-env-overrides\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbf8371a-4deb-4395-8f22-e52aea021f62-ovn-node-metrics-cert\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-slash\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-cni-netd\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55972c67-d658-4505-9eae-4c41003b146f-iptables-alerter-script\") pod \"iptables-alerter-qlp7k\" (UID: \"55972c67-d658-4505-9eae-4c41003b146f\") " pod="openshift-network-operator/iptables-alerter-qlp7k"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-run-netns\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-dbus\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d028a8f3-fd72-4b0d-80cf-5b42b0d344bd-konnectivity-ca\") pod \"konnectivity-agent-z65fg\" (UID: \"d028a8f3-fd72-4b0d-80cf-5b42b0d344bd\") " pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-run-openvswitch\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.203465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26jwm\" (UniqueName: \"kubernetes.io/projected/bbf8371a-4deb-4395-8f22-e52aea021f62-kube-api-access-26jwm\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.204199 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203499    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbf8371a-4deb-4395-8f22-e52aea021f62-env-overrides\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.204199 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-slash\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.204199 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203614    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-cni-netd\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.204199 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.203775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-dbus\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:10.204199 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.204049    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55972c67-d658-4505-9eae-4c41003b146f-iptables-alerter-script\") pod \"iptables-alerter-qlp7k\" (UID: \"55972c67-d658-4505-9eae-4c41003b146f\") " pod="openshift-network-operator/iptables-alerter-qlp7k"
Sep 17 00:30:10.204199 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.204067    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-run-openvswitch\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.204199 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.204125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbf8371a-4deb-4395-8f22-e52aea021f62-host-run-netns\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.204531 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.204296    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d028a8f3-fd72-4b0d-80cf-5b42b0d344bd-konnectivity-ca\") pod \"konnectivity-agent-z65fg\" (UID: \"d028a8f3-fd72-4b0d-80cf-5b42b0d344bd\") " pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:10.206019 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.205996    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d028a8f3-fd72-4b0d-80cf-5b42b0d344bd-agent-certs\") pod \"konnectivity-agent-z65fg\" (UID: \"d028a8f3-fd72-4b0d-80cf-5b42b0d344bd\") " pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:10.206434 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.206416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbf8371a-4deb-4395-8f22-e52aea021f62-ovn-node-metrics-cert\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.212678 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.212655    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wndm\" (UniqueName: \"kubernetes.io/projected/55972c67-d658-4505-9eae-4c41003b146f-kube-api-access-5wndm\") pod \"iptables-alerter-qlp7k\" (UID: \"55972c67-d658-4505-9eae-4c41003b146f\") " pod="openshift-network-operator/iptables-alerter-qlp7k"
Sep 17 00:30:10.213576 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.213551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26jwm\" (UniqueName: \"kubernetes.io/projected/bbf8371a-4deb-4395-8f22-e52aea021f62-kube-api-access-26jwm\") pod \"ovnkube-node-x5qvl\" (UID: \"bbf8371a-4deb-4395-8f22-e52aea021f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.287619 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.287543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7"
Sep 17 00:30:10.294033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.294003    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xm8jp"
Sep 17 00:30:10.302836 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.302812    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dbmwm"
Sep 17 00:30:10.307837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.307818    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xv89m"
Sep 17 00:30:10.315477 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.315450    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b6lfq"
Sep 17 00:30:10.322295 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.322275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2m9vh"
Sep 17 00:30:10.330939 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.330916    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlp7k"
Sep 17 00:30:10.336925 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.336903    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:10.340620 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.340600    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:10.606098 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.606031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:10.606226 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.606152    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:10.606226 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.606198    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs podName:f3834b70-3e64-4873-ab8e-b551c9504f6d nodeName:}" failed. No retries permitted until 2026-09-17 00:30:11.606186394 +0000 UTC m=+4.033644309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs") pod "network-metrics-daemon-hf4kw" (UID: "f3834b70-3e64-4873-ab8e-b551c9504f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:10.707015 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.706980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8qd\" (UniqueName: \"kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd\") pod \"network-check-target-sr855\" (UID: \"59c0329b-9905-4051-b603-fc4d3d17873c\") " pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:10.707185 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.707047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:10.707185 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.707170    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:10.707185 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.707175    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:30:10.707288 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.707195    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:30:10.707288 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.707209    2576 projected.go:196] Error preparing data for projected volume kube-api-access-ch8qd for pod openshift-network-diagnostics/network-check-target-sr855: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:10.707288 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.707229    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret podName:c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3 nodeName:}" failed. No retries permitted until 2026-09-17 00:30:11.70720911 +0000 UTC m=+4.134667011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret") pod "global-pull-secret-syncer-drkmn" (UID: "c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:10.707288 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:10.707274    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd podName:59c0329b-9905-4051-b603-fc4d3d17873c nodeName:}" failed. No retries permitted until 2026-09-17 00:30:11.707259148 +0000 UTC m=+4.134717066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch8qd" (UniqueName: "kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd") pod "network-check-target-sr855" (UID: "59c0329b-9905-4051-b603-fc4d3d17873c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:10.912353 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:10.912327    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:30:11.025779 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:11.025719    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 00:25:10 +0000 UTC" deadline="2028-06-25 07:27:51.38718139 +0000 UTC"
Sep 17 00:30:11.025779 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:11.025771    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15534h57m40.361413394s"
Sep 17 00:30:11.242736 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:11.242699    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce8bade_b989_4083_a84c_f0502f829fcd.slice/crio-fcc2fbf4ce4d47bc06b03e1c3d7a3e68a4bb91f699df1efd1ace42fa27c330ad WatchSource:0}: Error finding container fcc2fbf4ce4d47bc06b03e1c3d7a3e68a4bb91f699df1efd1ace42fa27c330ad: Status 404 returned error can't find the container with id fcc2fbf4ce4d47bc06b03e1c3d7a3e68a4bb91f699df1efd1ace42fa27c330ad
Sep 17 00:30:11.245048 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:11.244876    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138ffd91_a273_46b4_bd1a_b59abe010b48.slice/crio-ee320932efc80094660b85cdf528474a1d5c02c47915d5ced980a47282146c25 WatchSource:0}: Error finding container ee320932efc80094660b85cdf528474a1d5c02c47915d5ced980a47282146c25: Status 404 returned error can't find the container with id ee320932efc80094660b85cdf528474a1d5c02c47915d5ced980a47282146c25
Sep 17 00:30:11.249338 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:11.249293    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2b64bdf_fb1b_44bc_96ae_83a0b56d1c3b.slice/crio-029cc1c96f456016bd1a5425319a9af8ad5fa03ef2691753232be3160cac99da WatchSource:0}: Error finding container 029cc1c96f456016bd1a5425319a9af8ad5fa03ef2691753232be3160cac99da: Status 404 returned error can't find the container with id 029cc1c96f456016bd1a5425319a9af8ad5fa03ef2691753232be3160cac99da
Sep 17 00:30:11.250935 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:11.250792    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd028a8f3_fd72_4b0d_80cf_5b42b0d344bd.slice/crio-8ffde0de08b8e67c52abeab8c6f6c9e26ec0e4b664f345972c5b235cf7d1d859 WatchSource:0}: Error finding container 8ffde0de08b8e67c52abeab8c6f6c9e26ec0e4b664f345972c5b235cf7d1d859: Status 404 returned error can't find the container with id 8ffde0de08b8e67c52abeab8c6f6c9e26ec0e4b664f345972c5b235cf7d1d859
Sep 17 00:30:11.252342 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:11.252156    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fba316c_30a0_4da6_b8fb_cc90962a2984.slice/crio-e24ff03903d2a5c38be624191dd78de848208f4f77b2b954053413aa7185bffd WatchSource:0}: Error finding container e24ff03903d2a5c38be624191dd78de848208f4f77b2b954053413aa7185bffd: Status 404 returned error can't find the container with id e24ff03903d2a5c38be624191dd78de848208f4f77b2b954053413aa7185bffd
Sep 17 00:30:11.253849 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:11.253340    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf8371a_4deb_4395_8f22_e52aea021f62.slice/crio-a2b67639923901187f8129a1164db6a3a43b9ba8179188b6ab452977e5cdadaf WatchSource:0}: Error finding container a2b67639923901187f8129a1164db6a3a43b9ba8179188b6ab452977e5cdadaf: Status 404 returned error can't find the container with id a2b67639923901187f8129a1164db6a3a43b9ba8179188b6ab452977e5cdadaf
Sep 17 00:30:11.254215 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:11.254051    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55972c67_d658_4505_9eae_4c41003b146f.slice/crio-33d8e338c6e361c953336f630a193a72614c61418554fcefb7694b501f620b11 WatchSource:0}: Error finding container 33d8e338c6e361c953336f630a193a72614c61418554fcefb7694b501f620b11: Status 404 returned error can't find the container with id 33d8e338c6e361c953336f630a193a72614c61418554fcefb7694b501f620b11
Sep 17 00:30:11.255083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:11.254902    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09882e1_0cd9_4fbe_941a_fa217471afbb.slice/crio-1a8fa05eab4cf89b5033505a6cae7b68a9eca8a42a08b8afca98272d49147b60 WatchSource:0}: Error finding container 1a8fa05eab4cf89b5033505a6cae7b68a9eca8a42a08b8afca98272d49147b60: Status 404 returned error can't find the container with id 1a8fa05eab4cf89b5033505a6cae7b68a9eca8a42a08b8afca98272d49147b60
Sep 17 00:30:11.256389 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:11.255918    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b03180_1da9_4fe4_8df1_564bc4fecfcf.slice/crio-7efa6fef66e8d9eb10c958c2d225b4aaf29a1e5280fafaf4690a20bfde717864 WatchSource:0}: Error finding container 7efa6fef66e8d9eb10c958c2d225b4aaf29a1e5280fafaf4690a20bfde717864: Status 404 returned error can't find the container with id 7efa6fef66e8d9eb10c958c2d225b4aaf29a1e5280fafaf4690a20bfde717864
Sep 17 00:30:11.613356 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:11.613324    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:11.613522 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:11.613447    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:11.613522 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:11.613506    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs podName:f3834b70-3e64-4873-ab8e-b551c9504f6d nodeName:}" failed. No retries permitted until 2026-09-17 00:30:13.613491161 +0000 UTC m=+6.040949068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs") pod "network-metrics-daemon-hf4kw" (UID: "f3834b70-3e64-4873-ab8e-b551c9504f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:11.713912 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:11.713872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8qd\" (UniqueName: \"kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd\") pod \"network-check-target-sr855\" (UID: \"59c0329b-9905-4051-b603-fc4d3d17873c\") " pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:11.714108 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:11.713933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:11.714108 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:11.714077    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:11.714108 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:11.714082    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:30:11.714108 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:11.714108    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:30:11.714310 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:11.714122    2576 projected.go:196] Error preparing data for projected volume kube-api-access-ch8qd for pod openshift-network-diagnostics/network-check-target-sr855: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:11.714310 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:11.714133    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret podName:c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3 nodeName:}" failed. No retries permitted until 2026-09-17 00:30:13.714121088 +0000 UTC m=+6.141578989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret") pod "global-pull-secret-syncer-drkmn" (UID: "c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:11.714310 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:11.714175    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd podName:59c0329b-9905-4051-b603-fc4d3d17873c nodeName:}" failed. No retries permitted until 2026-09-17 00:30:13.714159087 +0000 UTC m=+6.141617003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch8qd" (UniqueName: "kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd") pod "network-check-target-sr855" (UID: "59c0329b-9905-4051-b603-fc4d3d17873c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:12.026332 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.026291    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 00:25:10 +0000 UTC" deadline="2028-02-10 09:21:35.430289317 +0000 UTC"
Sep 17 00:30:12.026332 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.026330    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12272h51m23.403964196s"
Sep 17 00:30:12.135286 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.135255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:12.135463 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:12.135401    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:12.135802 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.135780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:12.135901 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:12.135878    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:12.135985 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.135972    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:12.136063 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:12.136047    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:12.163864 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.163711    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7" event={"ID":"0ce8bade-b989-4083-a84c-f0502f829fcd","Type":"ContainerStarted","Data":"fcc2fbf4ce4d47bc06b03e1c3d7a3e68a4bb91f699df1efd1ace42fa27c330ad"}
Sep 17 00:30:12.176252 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.174814    2576 generic.go:356] "Generic (PLEG): container finished" podID="db7cd5fe2b3fbb28de2fb060564fe5f8" containerID="bdc9e05850c05bd741a7ac4b5cf280dc7f1dbe0f726c6fc9f40f034033741c20" exitCode=0
Sep 17 00:30:12.176252 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.175620    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal" event={"ID":"db7cd5fe2b3fbb28de2fb060564fe5f8","Type":"ContainerDied","Data":"bdc9e05850c05bd741a7ac4b5cf280dc7f1dbe0f726c6fc9f40f034033741c20"}
Sep 17 00:30:12.185831 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.185635    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-98.ec2.internal" event={"ID":"ee2bbf241d4d47d45cb8a3bfac597f7f","Type":"ContainerStarted","Data":"4c50033572e9c1ce9d82c3c9328c4e1ad91123b9559cd00a30cc82d661d0566e"}
Sep 17 00:30:12.189528 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.189479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dbmwm" event={"ID":"14b03180-1da9-4fe4-8df1-564bc4fecfcf","Type":"ContainerStarted","Data":"7efa6fef66e8d9eb10c958c2d225b4aaf29a1e5280fafaf4690a20bfde717864"}
Sep 17 00:30:12.208298 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.208261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlp7k" event={"ID":"55972c67-d658-4505-9eae-4c41003b146f","Type":"ContainerStarted","Data":"33d8e338c6e361c953336f630a193a72614c61418554fcefb7694b501f620b11"}
Sep 17 00:30:12.213448 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.213416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl" event={"ID":"bbf8371a-4deb-4395-8f22-e52aea021f62","Type":"ContainerStarted","Data":"a2b67639923901187f8129a1164db6a3a43b9ba8179188b6ab452977e5cdadaf"}
Sep 17 00:30:12.219298 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.219269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xv89m" event={"ID":"1fba316c-30a0-4da6-b8fb-cc90962a2984","Type":"ContainerStarted","Data":"e24ff03903d2a5c38be624191dd78de848208f4f77b2b954053413aa7185bffd"}
Sep 17 00:30:12.224119 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.224093    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z65fg" event={"ID":"d028a8f3-fd72-4b0d-80cf-5b42b0d344bd","Type":"ContainerStarted","Data":"8ffde0de08b8e67c52abeab8c6f6c9e26ec0e4b664f345972c5b235cf7d1d859"}
Sep 17 00:30:12.233983 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.233936    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xm8jp" event={"ID":"138ffd91-a273-46b4-bd1a-b59abe010b48","Type":"ContainerStarted","Data":"ee320932efc80094660b85cdf528474a1d5c02c47915d5ced980a47282146c25"}
Sep 17 00:30:12.236079 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.236053    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m9vh" event={"ID":"b09882e1-0cd9-4fbe-941a-fa217471afbb","Type":"ContainerStarted","Data":"1a8fa05eab4cf89b5033505a6cae7b68a9eca8a42a08b8afca98272d49147b60"}
Sep 17 00:30:12.240121 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:12.240075    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b6lfq" event={"ID":"a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b","Type":"ContainerStarted","Data":"029cc1c96f456016bd1a5425319a9af8ad5fa03ef2691753232be3160cac99da"}
Sep 17 00:30:13.267293 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:13.267004    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal" event={"ID":"db7cd5fe2b3fbb28de2fb060564fe5f8","Type":"ContainerStarted","Data":"bf850a76bdd763f56b9b969977704dc198191b57c173a42b546946cb5226602f"}
Sep 17 00:30:13.279698 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:13.279638    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-98.ec2.internal" podStartSLOduration=4.279615358 podStartE2EDuration="4.279615358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:30:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:12.212289049 +0000 UTC m=+4.639746976" watchObservedRunningTime="2026-09-17 00:30:13.279615358 +0000 UTC m=+5.707073260"
Sep 17 00:30:13.632765 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:13.632623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:13.632942 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:13.632838    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:13.632942 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:13.632906    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs podName:f3834b70-3e64-4873-ab8e-b551c9504f6d nodeName:}" failed. No retries permitted until 2026-09-17 00:30:17.632885439 +0000 UTC m=+10.060343347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs") pod "network-metrics-daemon-hf4kw" (UID: "f3834b70-3e64-4873-ab8e-b551c9504f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:13.734751 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:13.733944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8qd\" (UniqueName: \"kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd\") pod \"network-check-target-sr855\" (UID: \"59c0329b-9905-4051-b603-fc4d3d17873c\") " pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:13.734751 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:13.734023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:13.734751 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:13.734179    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:13.734751 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:13.734243    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret podName:c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3 nodeName:}" failed. No retries permitted until 2026-09-17 00:30:17.734224609 +0000 UTC m=+10.161682533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret") pod "global-pull-secret-syncer-drkmn" (UID: "c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:13.734751 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:13.734634    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:30:13.734751 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:13.734655    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:30:13.734751 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:13.734668    2576 projected.go:196] Error preparing data for projected volume kube-api-access-ch8qd for pod openshift-network-diagnostics/network-check-target-sr855: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:13.734751 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:13.734715    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd podName:59c0329b-9905-4051-b603-fc4d3d17873c nodeName:}" failed. No retries permitted until 2026-09-17 00:30:17.734699632 +0000 UTC m=+10.162157533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch8qd" (UniqueName: "kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd") pod "network-check-target-sr855" (UID: "59c0329b-9905-4051-b603-fc4d3d17873c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:14.138071 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:14.138039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:14.138236 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:14.138170    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:14.138320 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:14.138245    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:14.138371 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:14.138318    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:14.138435 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:14.138375    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:14.138479 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:14.138442    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:16.135304 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:16.134899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:16.135304 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:16.134902    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:16.135304 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:16.134902    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:16.135304 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:16.135038    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:16.135304 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:16.135154    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:16.135304 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:16.135236    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:17.670847 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:17.670810    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:17.671331 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:17.670930    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:17.671331 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:17.671020    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs podName:f3834b70-3e64-4873-ab8e-b551c9504f6d nodeName:}" failed. No retries permitted until 2026-09-17 00:30:25.67099867 +0000 UTC m=+18.098456574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs") pod "network-metrics-daemon-hf4kw" (UID: "f3834b70-3e64-4873-ab8e-b551c9504f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:17.771617 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:17.771578    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:17.771777 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:17.771661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8qd\" (UniqueName: \"kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd\") pod \"network-check-target-sr855\" (UID: \"59c0329b-9905-4051-b603-fc4d3d17873c\") " pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:17.771777 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:17.771756    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:17.771985 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:17.771787    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:30:17.771985 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:17.771804    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:30:17.771985 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:17.771816    2576 projected.go:196] Error preparing data for projected volume kube-api-access-ch8qd for pod openshift-network-diagnostics/network-check-target-sr855: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:17.771985 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:17.771831    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret podName:c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3 nodeName:}" failed. No retries permitted until 2026-09-17 00:30:25.771809724 +0000 UTC m=+18.199267641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret") pod "global-pull-secret-syncer-drkmn" (UID: "c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:17.771985 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:17.771863    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd podName:59c0329b-9905-4051-b603-fc4d3d17873c nodeName:}" failed. No retries permitted until 2026-09-17 00:30:25.771848706 +0000 UTC m=+18.199306621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch8qd" (UniqueName: "kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd") pod "network-check-target-sr855" (UID: "59c0329b-9905-4051-b603-fc4d3d17873c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:18.135557 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:18.135459    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:18.135692 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:18.135553    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:18.135837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:18.135824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:18.135897 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:18.135884    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:18.135937 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:18.135928    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:18.136011 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:18.135995    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:20.136109 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:20.136075    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:20.136109 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:20.136108    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:20.136622 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:20.136075    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:20.136622 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:20.136231    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:20.136622 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:20.136350    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:20.136622 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:20.136427    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:22.135560 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:22.135477    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:22.136017 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:22.135477    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:22.136017 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:22.135596    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:22.136017 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:22.135710    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:22.136017 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:22.135477    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:22.136017 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:22.135816    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:24.134880 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:24.134848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:24.135366 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:24.134859    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:24.135366 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:24.134982    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:24.135366 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:24.135081    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:24.135366 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:24.135122    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:24.135366 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:24.135243    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:25.737481 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:25.737443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:25.737913 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:25.737610    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:25.737913 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:25.737678    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs podName:f3834b70-3e64-4873-ab8e-b551c9504f6d nodeName:}" failed. No retries permitted until 2026-09-17 00:30:41.737659623 +0000 UTC m=+34.165117527 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs") pod "network-metrics-daemon-hf4kw" (UID: "f3834b70-3e64-4873-ab8e-b551c9504f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:25.838117 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:25.838040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8qd\" (UniqueName: \"kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd\") pod \"network-check-target-sr855\" (UID: \"59c0329b-9905-4051-b603-fc4d3d17873c\") " pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:25.838117 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:25.838085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:25.838291 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:25.838184    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:25.838291 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:25.838201    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:30:25.838291 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:25.838222    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:30:25.838291 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:25.838232    2576 projected.go:196] Error preparing data for projected volume kube-api-access-ch8qd for pod openshift-network-diagnostics/network-check-target-sr855: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:25.838291 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:25.838242    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret podName:c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3 nodeName:}" failed. No retries permitted until 2026-09-17 00:30:41.838226216 +0000 UTC m=+34.265684138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret") pod "global-pull-secret-syncer-drkmn" (UID: "c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:25.838291 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:25.838271    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd podName:59c0329b-9905-4051-b603-fc4d3d17873c nodeName:}" failed. No retries permitted until 2026-09-17 00:30:41.838259632 +0000 UTC m=+34.265717533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch8qd" (UniqueName: "kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd") pod "network-check-target-sr855" (UID: "59c0329b-9905-4051-b603-fc4d3d17873c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:26.135536 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:26.135444    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:26.135536 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:26.135460    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:26.136308 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:26.136275    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:26.136672 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:26.136653    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:26.136822 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:26.136803    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:26.136929 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:26.136912    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:28.136393 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:28.136359    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:28.136796 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:28.136479    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:28.136848 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:28.136800    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:28.136881 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:28.136859    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:28.136918 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:28.136889    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:28.136949 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:28.136928    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:30.134974 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.134771    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:30.135500 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.134781    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:30.135500 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:30.135065    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:30.135500 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.134805    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:30.135500 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:30.135131    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:30.135500 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:30.135219    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:30.305664 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.305578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dbmwm" event={"ID":"14b03180-1da9-4fe4-8df1-564bc4fecfcf","Type":"ContainerStarted","Data":"931db8bf973ee81bc32ceb482f26780f352b97f723c8868bf94e4211788d74e7"}
Sep 17 00:30:30.309102 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.309073    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl" event={"ID":"bbf8371a-4deb-4395-8f22-e52aea021f62","Type":"ContainerStarted","Data":"e99b45e7f39e315447c0ccae3c601c19c209fa1e9586ec7e2e22197b013946dc"}
Sep 17 00:30:30.309243 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.309169    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl" event={"ID":"bbf8371a-4deb-4395-8f22-e52aea021f62","Type":"ContainerStarted","Data":"70a0ef7b5fa3cd1a904a0d0bc1a4b12091576405ca9d8cfa88b25dfb97583e36"}
Sep 17 00:30:30.309243 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.309217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl" event={"ID":"bbf8371a-4deb-4395-8f22-e52aea021f62","Type":"ContainerStarted","Data":"8107ac50f0ff40f9c8f50f8012e22b833c2d4e0c5c84b6778a46a01d989e0577"}
Sep 17 00:30:30.309351 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.309264    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl" event={"ID":"bbf8371a-4deb-4395-8f22-e52aea021f62","Type":"ContainerStarted","Data":"0f933d252abc3e50b1fc5ac39e8608ebfe2f89d53dbd4c9db3968898ffc90fea"}
Sep 17 00:30:30.309351 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.309310    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl" event={"ID":"bbf8371a-4deb-4395-8f22-e52aea021f62","Type":"ContainerStarted","Data":"a4414e93f609ac8f09d0cdcc5e2effcce013d66508c297abf1843d1583963bf3"}
Sep 17 00:30:30.309444 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.309360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl" event={"ID":"bbf8371a-4deb-4395-8f22-e52aea021f62","Type":"ContainerStarted","Data":"779bc11a0722d31bb3d9721645d708b1d9c2c004ce6d5cc8435d4e7db7c095a2"}
Sep 17 00:30:30.311076 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.311050    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xv89m" event={"ID":"1fba316c-30a0-4da6-b8fb-cc90962a2984","Type":"ContainerStarted","Data":"260c454817847c4b1cf8419230a804b4e2eff6cf29f282e9f634c8eaaf61c2d5"}
Sep 17 00:30:30.312506 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.312485    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z65fg" event={"ID":"d028a8f3-fd72-4b0d-80cf-5b42b0d344bd","Type":"ContainerStarted","Data":"acaafb824f43aea7215104d32ae57aed9483145e74797605983232c3474e1582"}
Sep 17 00:30:30.313934 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.313916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xm8jp" event={"ID":"138ffd91-a273-46b4-bd1a-b59abe010b48","Type":"ContainerStarted","Data":"7cc9e32259d9e996ca0abbf4ad4e9252142be244b4014864bbfa6ea941a71a0b"}
Sep 17 00:30:30.315238 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.315219    2576 generic.go:356] "Generic (PLEG): container finished" podID="b09882e1-0cd9-4fbe-941a-fa217471afbb" containerID="f91d0576116aa6522c48a0f29f6a05b3a94b8ecbf9d1b72de75eb3dfeabea128" exitCode=0
Sep 17 00:30:30.315308 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.315273    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m9vh" event={"ID":"b09882e1-0cd9-4fbe-941a-fa217471afbb","Type":"ContainerDied","Data":"f91d0576116aa6522c48a0f29f6a05b3a94b8ecbf9d1b72de75eb3dfeabea128"}
Sep 17 00:30:30.316728 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.316650    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b6lfq" event={"ID":"a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b","Type":"ContainerStarted","Data":"9a12bd1400ffc06a9ea6982f45616013a8f163a057aa1ae6f6f1d810307713f1"}
Sep 17 00:30:30.318119 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.318074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7" event={"ID":"0ce8bade-b989-4083-a84c-f0502f829fcd","Type":"ContainerStarted","Data":"b59738acc76c7400ea76f6123691724ddce0a07623d20f88e921d1595824741c"}
Sep 17 00:30:30.321343 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.321298    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dbmwm" podStartSLOduration=4.173987276 podStartE2EDuration="22.321281566s" totalImagesPullingTime="18.14729429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:30.32077871 +0000 UTC m=+22.748236635" watchObservedRunningTime="2026-09-17 00:30:30.321281566 +0000 UTC m=+22.748739493"
Sep 17 00:30:30.321536 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.321470    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-98.ec2.internal" podStartSLOduration=21.321464158 podStartE2EDuration="21.321464158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:30:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:13.28104684 +0000 UTC m=+5.708504759" watchObservedRunningTime="2026-09-17 00:30:30.321464158 +0000 UTC m=+22.748922082"
Sep 17 00:30:30.334873 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.334828    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z65fg" podStartSLOduration=4.213713595 podStartE2EDuration="22.334812s" totalImagesPullingTime="18.121098405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:30.334044488 +0000 UTC m=+22.761502410" watchObservedRunningTime="2026-09-17 00:30:30.334812 +0000 UTC m=+22.762269924"
Sep 17 00:30:30.351404 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.351367    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xm8jp" podStartSLOduration=4.067254879 podStartE2EDuration="22.351352355s" totalImagesPullingTime="18.284097476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:30.350905891 +0000 UTC m=+22.778363814" watchObservedRunningTime="2026-09-17 00:30:30.351352355 +0000 UTC m=+22.778810282"
Sep 17 00:30:30.375328 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.375289    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xv89m" podStartSLOduration=4.255772242 podStartE2EDuration="22.375275904s" totalImagesPullingTime="18.119503662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:30.362894633 +0000 UTC m=+22.790352567" watchObservedRunningTime="2026-09-17 00:30:30.375275904 +0000 UTC m=+22.802733827"
Sep 17 00:30:30.375655 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.375631    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b6lfq" podStartSLOduration=8.090659578 podStartE2EDuration="22.375624747s" totalImagesPullingTime="14.284965169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:30.375179257 +0000 UTC m=+22.802637171" watchObservedRunningTime="2026-09-17 00:30:30.375624747 +0000 UTC m=+22.803082669"
Sep 17 00:30:30.947415 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:30.947212    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 00:30:31.062078 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:31.061947    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T00:30:30.947379006Z","UUID":"b9d126cb-9cdc-4390-bf7e-01b4cd348c6d","Handler":null,"Name":"","Endpoint":""}
Sep 17 00:30:31.063599 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:31.063583    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 00:30:31.063684 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:31.063610    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 00:30:31.323206 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:31.323088    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7" event={"ID":"0ce8bade-b989-4083-a84c-f0502f829fcd","Type":"ContainerStarted","Data":"a872403d7dae4d85b2b04fd140ca18df3e76eaf1956aefd3c43fd0a562614f10"}
Sep 17 00:30:31.325009 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:31.324969    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlp7k" event={"ID":"55972c67-d658-4505-9eae-4c41003b146f","Type":"ContainerStarted","Data":"e35201a680b271a267766cdf251ce99df19f299496df617f97dd973db3e0147b"}
Sep 17 00:30:31.338469 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:31.338421    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qlp7k" podStartSLOduration=9.058300732 podStartE2EDuration="23.338401328s" totalImagesPullingTime="14.280100596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:31.338204688 +0000 UTC m=+23.765662611" watchObservedRunningTime="2026-09-17 00:30:31.338401328 +0000 UTC m=+23.765859251"
Sep 17 00:30:32.135812 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:32.135779    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:32.135812 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:32.135812    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:32.136086 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:32.135780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:32.136086 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:32.135924    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:32.136086 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:32.136001    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:32.136086 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:32.136073    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:32.332919 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:32.332882    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl" event={"ID":"bbf8371a-4deb-4395-8f22-e52aea021f62","Type":"ContainerStarted","Data":"e91ddb52c188f63b6f853c07ce7883d87ae8f85b070e42c6b93dccc6a2fb41ba"}
Sep 17 00:30:32.336126 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:32.336098    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7" event={"ID":"0ce8bade-b989-4083-a84c-f0502f829fcd","Type":"ContainerStarted","Data":"fd8fa3ffa3342aa7a545eabdd451cbff9e23d619da8b10c49dce8d7dbc3dff2c"}
Sep 17 00:30:32.353207 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:32.353158    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76cf7" podStartSLOduration=4.096486015 podStartE2EDuration="24.353138988s" totalImagesPullingTime="20.256652973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:32.352718248 +0000 UTC m=+24.780176172" watchObservedRunningTime="2026-09-17 00:30:32.353138988 +0000 UTC m=+24.780596912"
Sep 17 00:30:33.826459 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:33.826422    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:33.827018 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:33.826995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:34.135427 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:34.135352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:34.135427 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:34.135398    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:34.135658 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:34.135352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:34.135658 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:34.135490    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:34.135658 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:34.135570    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:34.135658 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:34.135640    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:34.340925 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:34.340873    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:34.341284 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:34.341267    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z65fg"
Sep 17 00:30:35.344429 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:35.344176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m9vh" event={"ID":"b09882e1-0cd9-4fbe-941a-fa217471afbb","Type":"ContainerStarted","Data":"680656bf2371d2dc9891d0b7ffacfc64cb15d075a2eebce2c0199ef908f4bb4b"}
Sep 17 00:30:35.348183 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:35.348152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl" event={"ID":"bbf8371a-4deb-4395-8f22-e52aea021f62","Type":"ContainerStarted","Data":"bd612d42c916025ef57e46adfd95c05f058993918cb1988b6931c79b548c6bc8"}
Sep 17 00:30:35.348542 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:35.348451    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:35.348542 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:35.348525    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:35.348688 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:35.348568    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:35.365327 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:35.365305    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:35.365408 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:35.365399    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:30:35.387441 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:35.387356    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl" podStartSLOduration=9.201735867 podStartE2EDuration="27.387341446s" totalImagesPullingTime="18.185605579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:35.386166516 +0000 UTC m=+27.813624438" watchObservedRunningTime="2026-09-17 00:30:35.387341446 +0000 UTC m=+27.814799369"
Sep 17 00:30:36.135198 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:36.135166    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:36.135374 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:36.135166    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:36.135374 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:36.135301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:36.135374 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:36.135300    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:36.135552 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:36.135414    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:36.135552 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:36.135495    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:36.352360 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:36.352329    2576 generic.go:356] "Generic (PLEG): container finished" podID="b09882e1-0cd9-4fbe-941a-fa217471afbb" containerID="680656bf2371d2dc9891d0b7ffacfc64cb15d075a2eebce2c0199ef908f4bb4b" exitCode=0
Sep 17 00:30:36.352972 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:36.352409    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m9vh" event={"ID":"b09882e1-0cd9-4fbe-941a-fa217471afbb","Type":"ContainerDied","Data":"680656bf2371d2dc9891d0b7ffacfc64cb15d075a2eebce2c0199ef908f4bb4b"}
Sep 17 00:30:36.671846 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:36.671815    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sr855"]
Sep 17 00:30:36.672049 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:36.671916    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:36.672049 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:36.672013    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:36.672435 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:36.672411    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hf4kw"]
Sep 17 00:30:36.672523 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:36.672512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:36.672655 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:36.672631    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:36.673190 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:36.673171    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-drkmn"]
Sep 17 00:30:36.673279 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:36.673246    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:36.673340 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:36.673320    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:38.136072 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:38.136040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:38.136588 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:38.136112    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:38.136588 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:38.136125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:38.136588 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:38.136182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:38.136588 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:38.136258    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:38.136588 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:38.136321    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:38.358808 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:38.358633    2576 generic.go:356] "Generic (PLEG): container finished" podID="b09882e1-0cd9-4fbe-941a-fa217471afbb" containerID="d6c43f3140a9f728cd0710dfccc8fbab2d016b97884fe6c3bca9088714a0008f" exitCode=0
Sep 17 00:30:38.359004 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:38.358819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m9vh" event={"ID":"b09882e1-0cd9-4fbe-941a-fa217471afbb","Type":"ContainerDied","Data":"d6c43f3140a9f728cd0710dfccc8fbab2d016b97884fe6c3bca9088714a0008f"}
Sep 17 00:30:40.135534 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:40.135501    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:40.135534 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:40.135524    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:40.135953 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:40.135497    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:40.135953 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:40.135601    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:40.135953 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:40.135679    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:40.135953 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:40.135756    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:40.364939 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:40.364900    2576 generic.go:356] "Generic (PLEG): container finished" podID="b09882e1-0cd9-4fbe-941a-fa217471afbb" containerID="76825264d7b9bb1a09bb72e07ed55e337541c7e8ae4a8285e9432bc4057ff398" exitCode=0
Sep 17 00:30:40.365117 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:40.364977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m9vh" event={"ID":"b09882e1-0cd9-4fbe-941a-fa217471afbb","Type":"ContainerDied","Data":"76825264d7b9bb1a09bb72e07ed55e337541c7e8ae4a8285e9432bc4057ff398"}
Sep 17 00:30:41.758500 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:41.758466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:41.758884 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:41.758604    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:41.758884 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:41.758661    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs podName:f3834b70-3e64-4873-ab8e-b551c9504f6d nodeName:}" failed. No retries permitted until 2026-09-17 00:31:13.758643473 +0000 UTC m=+66.186101383 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs") pod "network-metrics-daemon-hf4kw" (UID: "f3834b70-3e64-4873-ab8e-b551c9504f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:30:41.859111 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:41.859073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8qd\" (UniqueName: \"kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd\") pod \"network-check-target-sr855\" (UID: \"59c0329b-9905-4051-b603-fc4d3d17873c\") " pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:41.859279 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:41.859136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:41.859279 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:41.859249    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:30:41.859279 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:41.859266    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:41.859279 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:41.859273    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:30:41.859498 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:41.859287    2576 projected.go:196] Error preparing data for projected volume kube-api-access-ch8qd for pod openshift-network-diagnostics/network-check-target-sr855: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:41.859498 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:41.859329    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret podName:c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3 nodeName:}" failed. No retries permitted until 2026-09-17 00:31:13.859311056 +0000 UTC m=+66.286768962 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret") pod "global-pull-secret-syncer-drkmn" (UID: "c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:30:41.859498 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:41.859347    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd podName:59c0329b-9905-4051-b603-fc4d3d17873c nodeName:}" failed. No retries permitted until 2026-09-17 00:31:13.859337523 +0000 UTC m=+66.286795425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch8qd" (UniqueName: "kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd") pod "network-check-target-sr855" (UID: "59c0329b-9905-4051-b603-fc4d3d17873c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:30:42.135633 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.135556    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:42.135633 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.135580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:42.135633 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.135623    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:42.135891 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:42.135700    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr855" podUID="59c0329b-9905-4051-b603-fc4d3d17873c"
Sep 17 00:30:42.135891 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:42.135830    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:30:42.136025 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:42.135902    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drkmn" podUID="c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3"
Sep 17 00:30:42.324657 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.324630    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-98.ec2.internal" event="NodeReady"
Sep 17 00:30:42.324806 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.324775    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 00:30:42.364237 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.364205    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-thdzd"]
Sep 17 00:30:42.365867 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.365844    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.367283 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.367257    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h6jkw"]
Sep 17 00:30:42.368059 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.368036    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n9svt\""
Sep 17 00:30:42.368163 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.368065    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 00:30:42.368163 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.368096    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 00:30:42.368971 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.368938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h6jkw"
Sep 17 00:30:42.371030 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.371009    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 00:30:42.371129 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.371057    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6wf2d\""
Sep 17 00:30:42.371129 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.371113    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 00:30:42.371690 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.371670    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 00:30:42.375945 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.375919    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-thdzd"]
Sep 17 00:30:42.380197 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.380173    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h6jkw"]
Sep 17 00:30:42.464576 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.464556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wz2z\" (UniqueName: \"kubernetes.io/projected/f7be6e12-562d-48cd-bec6-9f4a39ca9862-kube-api-access-7wz2z\") pod \"ingress-canary-h6jkw\" (UID: \"f7be6e12-562d-48cd-bec6-9f4a39ca9862\") " pod="openshift-ingress-canary/ingress-canary-h6jkw"
Sep 17 00:30:42.464665 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.464611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44e39968-25a0-4b24-9f29-22e64c88ebe1-tmp-dir\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.464665 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.464634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7be6e12-562d-48cd-bec6-9f4a39ca9862-cert\") pod \"ingress-canary-h6jkw\" (UID: \"f7be6e12-562d-48cd-bec6-9f4a39ca9862\") " pod="openshift-ingress-canary/ingress-canary-h6jkw"
Sep 17 00:30:42.464665 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.464650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcl9b\" (UniqueName: \"kubernetes.io/projected/44e39968-25a0-4b24-9f29-22e64c88ebe1-kube-api-access-rcl9b\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.464804 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.464666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.464804 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.464687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44e39968-25a0-4b24-9f29-22e64c88ebe1-config-volume\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.565403 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.565369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcl9b\" (UniqueName: \"kubernetes.io/projected/44e39968-25a0-4b24-9f29-22e64c88ebe1-kube-api-access-rcl9b\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.565565 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.565415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.565565 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.565453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44e39968-25a0-4b24-9f29-22e64c88ebe1-config-volume\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.565565 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.565502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wz2z\" (UniqueName: \"kubernetes.io/projected/f7be6e12-562d-48cd-bec6-9f4a39ca9862-kube-api-access-7wz2z\") pod \"ingress-canary-h6jkw\" (UID: \"f7be6e12-562d-48cd-bec6-9f4a39ca9862\") " pod="openshift-ingress-canary/ingress-canary-h6jkw"
Sep 17 00:30:42.565707 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:42.565611    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:30:42.565707 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:42.565671    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls podName:44e39968-25a0-4b24-9f29-22e64c88ebe1 nodeName:}" failed. No retries permitted until 2026-09-17 00:30:43.065652564 +0000 UTC m=+35.493110468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls") pod "dns-default-thdzd" (UID: "44e39968-25a0-4b24-9f29-22e64c88ebe1") : secret "dns-default-metrics-tls" not found
Sep 17 00:30:42.565835 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.565709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44e39968-25a0-4b24-9f29-22e64c88ebe1-tmp-dir\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.565835 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.565744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7be6e12-562d-48cd-bec6-9f4a39ca9862-cert\") pod \"ingress-canary-h6jkw\" (UID: \"f7be6e12-562d-48cd-bec6-9f4a39ca9862\") " pod="openshift-ingress-canary/ingress-canary-h6jkw"
Sep 17 00:30:42.566075 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.566056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44e39968-25a0-4b24-9f29-22e64c88ebe1-tmp-dir\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.566129 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.566111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44e39968-25a0-4b24-9f29-22e64c88ebe1-config-volume\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.570865 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.570835    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7be6e12-562d-48cd-bec6-9f4a39ca9862-cert\") pod \"ingress-canary-h6jkw\" (UID: \"f7be6e12-562d-48cd-bec6-9f4a39ca9862\") " pod="openshift-ingress-canary/ingress-canary-h6jkw"
Sep 17 00:30:42.573731 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.573707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wz2z\" (UniqueName: \"kubernetes.io/projected/f7be6e12-562d-48cd-bec6-9f4a39ca9862-kube-api-access-7wz2z\") pod \"ingress-canary-h6jkw\" (UID: \"f7be6e12-562d-48cd-bec6-9f4a39ca9862\") " pod="openshift-ingress-canary/ingress-canary-h6jkw"
Sep 17 00:30:42.576232 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.576211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcl9b\" (UniqueName: \"kubernetes.io/projected/44e39968-25a0-4b24-9f29-22e64c88ebe1-kube-api-access-rcl9b\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:42.686369 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.686293    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h6jkw"
Sep 17 00:30:42.965791 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:42.965510    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h6jkw"]
Sep 17 00:30:42.970081 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:30:42.970057    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7be6e12_562d_48cd_bec6_9f4a39ca9862.slice/crio-745919089cc94ae22006a806ae5a78922a370ceec4425d06627ce763d5b44a80 WatchSource:0}: Error finding container 745919089cc94ae22006a806ae5a78922a370ceec4425d06627ce763d5b44a80: Status 404 returned error can't find the container with id 745919089cc94ae22006a806ae5a78922a370ceec4425d06627ce763d5b44a80
Sep 17 00:30:43.068980 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:43.068933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:43.069108 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:43.069082    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:30:43.069160 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:43.069145    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls podName:44e39968-25a0-4b24-9f29-22e64c88ebe1 nodeName:}" failed. No retries permitted until 2026-09-17 00:30:44.069128605 +0000 UTC m=+36.496586510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls") pod "dns-default-thdzd" (UID: "44e39968-25a0-4b24-9f29-22e64c88ebe1") : secret "dns-default-metrics-tls" not found
Sep 17 00:30:43.374307 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:43.374223    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h6jkw" event={"ID":"f7be6e12-562d-48cd-bec6-9f4a39ca9862","Type":"ContainerStarted","Data":"745919089cc94ae22006a806ae5a78922a370ceec4425d06627ce763d5b44a80"}
Sep 17 00:30:44.077797 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:44.077749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:44.078275 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:44.077974    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:30:44.078275 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:44.078036    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls podName:44e39968-25a0-4b24-9f29-22e64c88ebe1 nodeName:}" failed. No retries permitted until 2026-09-17 00:30:46.078017381 +0000 UTC m=+38.505475287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls") pod "dns-default-thdzd" (UID: "44e39968-25a0-4b24-9f29-22e64c88ebe1") : secret "dns-default-metrics-tls" not found
Sep 17 00:30:44.138435 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:44.136841    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:30:44.138435 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:44.137262    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:30:44.138435 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:44.137651    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:30:44.139530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:44.139506    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 00:30:44.139819 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:44.139793    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 00:30:44.139890 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:44.139854    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 00:30:44.140920 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:44.140731    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-plv5t\""
Sep 17 00:30:44.140920 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:44.140816    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lqlnk\""
Sep 17 00:30:44.140920 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:44.140879    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 00:30:46.096105 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:46.096076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:46.096673 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:46.096182    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:30:46.096673 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:46.096245    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls podName:44e39968-25a0-4b24-9f29-22e64c88ebe1 nodeName:}" failed. No retries permitted until 2026-09-17 00:30:50.096228864 +0000 UTC m=+42.523686767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls") pod "dns-default-thdzd" (UID: "44e39968-25a0-4b24-9f29-22e64c88ebe1") : secret "dns-default-metrics-tls" not found
Sep 17 00:30:47.387576 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:47.387546    2576 generic.go:356] "Generic (PLEG): container finished" podID="b09882e1-0cd9-4fbe-941a-fa217471afbb" containerID="58df72046c814b537406e0b0d4640e0b00b52ac85491fcee92c1cb961be46beb" exitCode=0
Sep 17 00:30:47.387985 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:47.387635    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m9vh" event={"ID":"b09882e1-0cd9-4fbe-941a-fa217471afbb","Type":"ContainerDied","Data":"58df72046c814b537406e0b0d4640e0b00b52ac85491fcee92c1cb961be46beb"}
Sep 17 00:30:47.389211 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:47.389186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h6jkw" event={"ID":"f7be6e12-562d-48cd-bec6-9f4a39ca9862","Type":"ContainerStarted","Data":"c953af43252f68564b66576ebd6664efbceb608fafba3fd6ef4ddd4100db581d"}
Sep 17 00:30:47.418334 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:47.418078    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h6jkw" podStartSLOduration=1.394111683 podStartE2EDuration="5.418059424s" totalImagesPullingTime="4.023947741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:47.417453629 +0000 UTC m=+39.844911553" watchObservedRunningTime="2026-09-17 00:30:47.418059424 +0000 UTC m=+39.845517349"
Sep 17 00:30:48.394670 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:48.394632    2576 generic.go:356] "Generic (PLEG): container finished" podID="b09882e1-0cd9-4fbe-941a-fa217471afbb" containerID="d6d00d9e39812c66a29146b012225a8a787928aa57afb1d6be2e681185eb410c" exitCode=0
Sep 17 00:30:48.395025 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:48.394715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m9vh" event={"ID":"b09882e1-0cd9-4fbe-941a-fa217471afbb","Type":"ContainerDied","Data":"d6d00d9e39812c66a29146b012225a8a787928aa57afb1d6be2e681185eb410c"}
Sep 17 00:30:49.400125 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:49.400089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m9vh" event={"ID":"b09882e1-0cd9-4fbe-941a-fa217471afbb","Type":"ContainerStarted","Data":"d6fe986119ca55ed01971f30e905dd001fd16cce606a59061924b192094c9053"}
Sep 17 00:30:49.419326 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:49.419284    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2m9vh" podStartSLOduration=9.931561069 podStartE2EDuration="41.419269417s" totalImagesPullingTime="31.487708348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:49.417950601 +0000 UTC m=+41.845408524" watchObservedRunningTime="2026-09-17 00:30:49.419269417 +0000 UTC m=+41.846727341"
Sep 17 00:30:50.126678 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:50.126637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:50.126850 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:50.126742    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:30:50.126850 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:50.126796    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls podName:44e39968-25a0-4b24-9f29-22e64c88ebe1 nodeName:}" failed. No retries permitted until 2026-09-17 00:30:58.126780784 +0000 UTC m=+50.554238688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls") pod "dns-default-thdzd" (UID: "44e39968-25a0-4b24-9f29-22e64c88ebe1") : secret "dns-default-metrics-tls" not found
Sep 17 00:30:58.176497 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:30:58.176466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:30:58.176902 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:58.176607    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:30:58.176902 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:30:58.176674    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls podName:44e39968-25a0-4b24-9f29-22e64c88ebe1 nodeName:}" failed. No retries permitted until 2026-09-17 00:31:14.176655531 +0000 UTC m=+66.604113448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls") pod "dns-default-thdzd" (UID: "44e39968-25a0-4b24-9f29-22e64c88ebe1") : secret "dns-default-metrics-tls" not found
Sep 17 00:31:07.369527 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:07.369494    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x5qvl"
Sep 17 00:31:13.784752 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:13.784693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:31:13.787087 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:13.787068    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 00:31:13.795913 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:31:13.795892    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 00:31:13.795994 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:31:13.795949    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs podName:f3834b70-3e64-4873-ab8e-b551c9504f6d nodeName:}" failed. No retries permitted until 2026-09-17 00:32:17.795932942 +0000 UTC m=+130.223390843 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs") pod "network-metrics-daemon-hf4kw" (UID: "f3834b70-3e64-4873-ab8e-b551c9504f6d") : secret "metrics-daemon-secret" not found
Sep 17 00:31:13.885248 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:13.885207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:31:13.885371 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:13.885284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8qd\" (UniqueName: \"kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd\") pod \"network-check-target-sr855\" (UID: \"59c0329b-9905-4051-b603-fc4d3d17873c\") " pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:31:13.887491 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:13.887471    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 00:31:13.887547 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:13.887507    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 00:31:13.898515 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:13.898490    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 00:31:13.899318 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:13.899301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3-original-pull-secret\") pod \"global-pull-secret-syncer-drkmn\" (UID: \"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3\") " pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:31:13.909323 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:13.909302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch8qd\" (UniqueName: \"kubernetes.io/projected/59c0329b-9905-4051-b603-fc4d3d17873c-kube-api-access-ch8qd\") pod \"network-check-target-sr855\" (UID: \"59c0329b-9905-4051-b603-fc4d3d17873c\") " pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:31:14.151240 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:14.151219    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drkmn"
Sep 17 00:31:14.167794 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:14.167772    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lqlnk\""
Sep 17 00:31:14.175665 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:14.175639    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:31:14.187984 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:14.187948    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:31:14.188109 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:31:14.188090    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:31:14.188182 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:31:14.188170    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls podName:44e39968-25a0-4b24-9f29-22e64c88ebe1 nodeName:}" failed. No retries permitted until 2026-09-17 00:31:46.18814886 +0000 UTC m=+98.615606776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls") pod "dns-default-thdzd" (UID: "44e39968-25a0-4b24-9f29-22e64c88ebe1") : secret "dns-default-metrics-tls" not found
Sep 17 00:31:14.419611 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:14.419533    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-drkmn"]
Sep 17 00:31:14.423031 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:31:14.423009    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b2a03a_fc36_4bdd_9de2_5bb7ac6ccee3.slice/crio-9520d145693b30e4cb01730a308909d14d7692889a37252f5d4804beac70b97f WatchSource:0}: Error finding container 9520d145693b30e4cb01730a308909d14d7692889a37252f5d4804beac70b97f: Status 404 returned error can't find the container with id 9520d145693b30e4cb01730a308909d14d7692889a37252f5d4804beac70b97f
Sep 17 00:31:14.444063 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:14.444039    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sr855"]
Sep 17 00:31:14.446887 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:31:14.446864    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c0329b_9905_4051_b603_fc4d3d17873c.slice/crio-c25c1641c7598a2aa0a5b05ab295553eac6970cb1cea15d789717e5baaae5e42 WatchSource:0}: Error finding container c25c1641c7598a2aa0a5b05ab295553eac6970cb1cea15d789717e5baaae5e42: Status 404 returned error can't find the container with id c25c1641c7598a2aa0a5b05ab295553eac6970cb1cea15d789717e5baaae5e42
Sep 17 00:31:14.462577 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:14.462553    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sr855" event={"ID":"59c0329b-9905-4051-b603-fc4d3d17873c","Type":"ContainerStarted","Data":"c25c1641c7598a2aa0a5b05ab295553eac6970cb1cea15d789717e5baaae5e42"}
Sep 17 00:31:14.463606 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:14.463584    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-drkmn" event={"ID":"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3","Type":"ContainerStarted","Data":"9520d145693b30e4cb01730a308909d14d7692889a37252f5d4804beac70b97f"}
Sep 17 00:31:20.480660 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:20.480608    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sr855" event={"ID":"59c0329b-9905-4051-b603-fc4d3d17873c","Type":"ContainerStarted","Data":"93e852f239fd3d1ade485cff2cb267c016aa8120f51d0ee9772be34d15898717"}
Sep 17 00:31:20.481205 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:20.480746    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:31:20.482063 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:20.482042    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-drkmn" event={"ID":"c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3","Type":"ContainerStarted","Data":"567a7a48ea0c28af80356f0f063641cd997a6ad734be54935056c25659d7f4f1"}
Sep 17 00:31:20.494736 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:20.494695    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sr855" podStartSLOduration=67.396343166 podStartE2EDuration="1m12.49467987s" totalImagesPullingTime="5.098336704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:31:20.493794484 +0000 UTC m=+72.921252420" watchObservedRunningTime="2026-09-17 00:31:20.49467987 +0000 UTC m=+72.922137792"
Sep 17 00:31:20.507623 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:20.507576    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-drkmn" podStartSLOduration=67.373986231 podStartE2EDuration="1m12.507560752s" totalImagesPullingTime="5.133574521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:31:20.50723321 +0000 UTC m=+72.934691135" watchObservedRunningTime="2026-09-17 00:31:20.507560752 +0000 UTC m=+72.935018675"
Sep 17 00:31:34.544320 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.544213    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"]
Sep 17 00:31:34.546709 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.546694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.549253 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.549229    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 00:31:34.550120 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.550101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 17 00:31:34.550120 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.550112    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 17 00:31:34.550299 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.550154    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 00:31:34.550299 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.550112    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 17 00:31:34.550299 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.550161    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 00:31:34.550299 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.550205    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 17 00:31:34.556932 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.556909    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"]
Sep 17 00:31:34.627988 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.627943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt7r7\" (UniqueName: \"kubernetes.io/projected/a9cf5e29-d69e-405a-a142-cbf53918261e-kube-api-access-zt7r7\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.628124 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.627992    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9cf5e29-d69e-405a-a142-cbf53918261e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.628124 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.628019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-hub\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.628124 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.628093    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.628277 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.628146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-ca\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.628277 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.628175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.729378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.729347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.729569 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.729401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-ca\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.729569 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.729517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.729569 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.729559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7r7\" (UniqueName: \"kubernetes.io/projected/a9cf5e29-d69e-405a-a142-cbf53918261e-kube-api-access-zt7r7\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.729729 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.729583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9cf5e29-d69e-405a-a142-cbf53918261e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.729729 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.729606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-hub\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.730236 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.730214    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9cf5e29-d69e-405a-a142-cbf53918261e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.731895 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.731875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-ca\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.732080 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.732063    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-hub\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.732448 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.732428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.732514 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.732472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9cf5e29-d69e-405a-a142-cbf53918261e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.737029 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.737010    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt7r7\" (UniqueName: \"kubernetes.io/projected/a9cf5e29-d69e-405a-a142-cbf53918261e-kube-api-access-zt7r7\") pod \"cluster-proxy-proxy-agent-bd8bb746-5jqgq\" (UID: \"a9cf5e29-d69e-405a-a142-cbf53918261e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:34.864341 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:34.864266    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:31:35.134945 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:35.134869    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"]
Sep 17 00:31:35.137981 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:31:35.137929    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9cf5e29_d69e_405a_a142_cbf53918261e.slice/crio-099c2c2268fb5d518ab0143fef27230919399de680844cbe5cf7254352d06262 WatchSource:0}: Error finding container 099c2c2268fb5d518ab0143fef27230919399de680844cbe5cf7254352d06262: Status 404 returned error can't find the container with id 099c2c2268fb5d518ab0143fef27230919399de680844cbe5cf7254352d06262
Sep 17 00:31:35.520198 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:35.520156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" event={"ID":"a9cf5e29-d69e-405a-a142-cbf53918261e","Type":"ContainerStarted","Data":"099c2c2268fb5d518ab0143fef27230919399de680844cbe5cf7254352d06262"}
Sep 17 00:31:40.537324 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:40.537283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" event={"ID":"a9cf5e29-d69e-405a-a142-cbf53918261e","Type":"ContainerStarted","Data":"72fca4287a08ff20f8da1226b4d026461752db103d78c68b0e44e5a993412557"}
Sep 17 00:31:40.537713 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:40.537336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" event={"ID":"a9cf5e29-d69e-405a-a142-cbf53918261e","Type":"ContainerStarted","Data":"6b4bd9bbbc91c9f6d9083154267f82c83f4be9d7337800d0e3449d119496e95a"}
Sep 17 00:31:40.537713 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:40.537354    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" event={"ID":"a9cf5e29-d69e-405a-a142-cbf53918261e","Type":"ContainerStarted","Data":"e5cb76668064eb78305dd3450a34257c1013dba5ebcae4cd79b8383bd1ee524d"}
Sep 17 00:31:40.554175 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:40.554133    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" podStartSLOduration=1.6205445410000001 podStartE2EDuration="6.554118956s" totalImagesPullingTime="4.933574415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:31:40.55285855 +0000 UTC m=+92.980316472" watchObservedRunningTime="2026-09-17 00:31:40.554118956 +0000 UTC m=+92.981576879"
Sep 17 00:31:46.205886 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:46.205848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:31:46.206422 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:31:46.206004    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:31:46.206422 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:31:46.206087    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls podName:44e39968-25a0-4b24-9f29-22e64c88ebe1 nodeName:}" failed. No retries permitted until 2026-09-17 00:32:50.206066237 +0000 UTC m=+162.633524140 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls") pod "dns-default-thdzd" (UID: "44e39968-25a0-4b24-9f29-22e64c88ebe1") : secret "dns-default-metrics-tls" not found
Sep 17 00:31:51.486745 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:31:51.486718    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sr855"
Sep 17 00:32:17.806162 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:32:17.806115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:32:17.806568 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:32:17.806231    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 00:32:17.806568 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:32:17.806283    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs podName:f3834b70-3e64-4873-ab8e-b551c9504f6d nodeName:}" failed. No retries permitted until 2026-09-17 00:34:19.806270174 +0000 UTC m=+252.233728075 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs") pod "network-metrics-daemon-hf4kw" (UID: "f3834b70-3e64-4873-ab8e-b551c9504f6d") : secret "metrics-daemon-secret" not found
Sep 17 00:32:45.380164 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:32:45.380130    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-thdzd" podUID="44e39968-25a0-4b24-9f29-22e64c88ebe1"
Sep 17 00:32:45.723445 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:32:45.723419    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-thdzd"
Sep 17 00:32:47.160194 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:32:47.160145    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hf4kw" podUID="f3834b70-3e64-4873-ab8e-b551c9504f6d"
Sep 17 00:32:50.215559 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:32:50.215532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:32:50.215947 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:32:50.215634    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:32:50.215947 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:32:50.215680    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls podName:44e39968-25a0-4b24-9f29-22e64c88ebe1 nodeName:}" failed. No retries permitted until 2026-09-17 00:34:52.215667636 +0000 UTC m=+284.643125542 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls") pod "dns-default-thdzd" (UID: "44e39968-25a0-4b24-9f29-22e64c88ebe1") : secret "dns-default-metrics-tls" not found
Sep 17 00:32:58.136566 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:32:58.136530    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:33:58.816580 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.816548    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qm42r"]
Sep 17 00:33:58.818329 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.818315    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:58.820635 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.820609    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 00:33:58.820767 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.820609    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 00:33:58.820767 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.820610    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 00:33:58.821457 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.821437    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4ctq5\""
Sep 17 00:33:58.821563 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.821458    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 00:33:58.828569 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.828551    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qm42r"]
Sep 17 00:33:58.960112 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.960084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b50420e4-bdcc-4a03-85e0-39ed24a11a99-crio-socket\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:58.960265 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.960163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:58.960265 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.960190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:58.960265 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.960206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl4mw\" (UniqueName: \"kubernetes.io/projected/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-api-access-jl4mw\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:58.960265 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:58.960232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b50420e4-bdcc-4a03-85e0-39ed24a11a99-data-volume\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:59.060607 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.060558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:59.060607 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.060607    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl4mw\" (UniqueName: \"kubernetes.io/projected/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-api-access-jl4mw\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:59.060833 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.060627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b50420e4-bdcc-4a03-85e0-39ed24a11a99-data-volume\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:59.060833 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:33:59.060699    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 00:33:59.060833 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.060749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b50420e4-bdcc-4a03-85e0-39ed24a11a99-crio-socket\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:59.060833 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:33:59.060777    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm podName:b50420e4-bdcc-4a03-85e0-39ed24a11a99 nodeName:}" failed. No retries permitted until 2026-09-17 00:33:59.560759679 +0000 UTC m=+231.988217580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qm42r" (UID: "b50420e4-bdcc-4a03-85e0-39ed24a11a99") : configmap "kube-rbac-proxy" not found
Sep 17 00:33:59.060833 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.060812    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b50420e4-bdcc-4a03-85e0-39ed24a11a99-crio-socket\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:59.061091 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.060844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:59.061091 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.060922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b50420e4-bdcc-4a03-85e0-39ed24a11a99-data-volume\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:59.061091 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:33:59.060925    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:33:59.061091 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:33:59.061014    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls podName:b50420e4-bdcc-4a03-85e0-39ed24a11a99 nodeName:}" failed. No retries permitted until 2026-09-17 00:33:59.560999158 +0000 UTC m=+231.988457058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qm42r" (UID: "b50420e4-bdcc-4a03-85e0-39ed24a11a99") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:33:59.070480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.070432    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl4mw\" (UniqueName: \"kubernetes.io/projected/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-api-access-jl4mw\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:59.564166 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.564124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:59.564166 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.564175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:33:59.564377 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:33:59.564240    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 00:33:59.564377 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:33:59.564271    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:33:59.564377 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:33:59.564301    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm podName:b50420e4-bdcc-4a03-85e0-39ed24a11a99 nodeName:}" failed. No retries permitted until 2026-09-17 00:34:00.564288208 +0000 UTC m=+232.991746109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qm42r" (UID: "b50420e4-bdcc-4a03-85e0-39ed24a11a99") : configmap "kube-rbac-proxy" not found
Sep 17 00:33:59.564377 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:33:59.564323    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls podName:b50420e4-bdcc-4a03-85e0-39ed24a11a99 nodeName:}" failed. No retries permitted until 2026-09-17 00:34:00.564310231 +0000 UTC m=+232.991768136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qm42r" (UID: "b50420e4-bdcc-4a03-85e0-39ed24a11a99") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:33:59.682123 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.682094    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k"]
Sep 17 00:33:59.684014 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.684000    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k"
Sep 17 00:33:59.686341 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.686318    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 00:33:59.686450 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.686399    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-h5z4g\""
Sep 17 00:33:59.687217 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.687200    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 00:33:59.694856 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.694835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k"]
Sep 17 00:33:59.765739 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.765715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqdhq\" (UniqueName: \"kubernetes.io/projected/0cc8b73f-d364-48f4-bcee-0403859d6fbe-kube-api-access-pqdhq\") pod \"migrator-8b4d697c5-4qd9k\" (UID: \"0cc8b73f-d364-48f4-bcee-0403859d6fbe\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k"
Sep 17 00:33:59.866671 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.866606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqdhq\" (UniqueName: \"kubernetes.io/projected/0cc8b73f-d364-48f4-bcee-0403859d6fbe-kube-api-access-pqdhq\") pod \"migrator-8b4d697c5-4qd9k\" (UID: \"0cc8b73f-d364-48f4-bcee-0403859d6fbe\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k"
Sep 17 00:33:59.873796 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.873767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqdhq\" (UniqueName: \"kubernetes.io/projected/0cc8b73f-d364-48f4-bcee-0403859d6fbe-kube-api-access-pqdhq\") pod \"migrator-8b4d697c5-4qd9k\" (UID: \"0cc8b73f-d364-48f4-bcee-0403859d6fbe\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k"
Sep 17 00:33:59.993066 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:33:59.993039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k"
Sep 17 00:34:00.255618 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:00.255589    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k"]
Sep 17 00:34:00.259510 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:34:00.259486    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc8b73f_d364_48f4_bcee_0403859d6fbe.slice/crio-67b9b7e8e25fb89fc74ef009e8f19b3ff3560ce17a787a0c9d4ca2da0ab6c520 WatchSource:0}: Error finding container 67b9b7e8e25fb89fc74ef009e8f19b3ff3560ce17a787a0c9d4ca2da0ab6c520: Status 404 returned error can't find the container with id 67b9b7e8e25fb89fc74ef009e8f19b3ff3560ce17a787a0c9d4ca2da0ab6c520
Sep 17 00:34:00.567924 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:00.567850    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b6lfq_a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b/dns-node-resolver/0.log"
Sep 17 00:34:00.572090 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:00.572065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:34:00.572241 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:00.572100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:34:00.572241 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:00.572170    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 00:34:00.572241 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:00.572211    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:34:00.572365 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:00.572220    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm podName:b50420e4-bdcc-4a03-85e0-39ed24a11a99 nodeName:}" failed. No retries permitted until 2026-09-17 00:34:02.572206685 +0000 UTC m=+234.999664590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qm42r" (UID: "b50420e4-bdcc-4a03-85e0-39ed24a11a99") : configmap "kube-rbac-proxy" not found
Sep 17 00:34:00.572365 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:00.572282    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls podName:b50420e4-bdcc-4a03-85e0-39ed24a11a99 nodeName:}" failed. No retries permitted until 2026-09-17 00:34:02.572262898 +0000 UTC m=+234.999720813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qm42r" (UID: "b50420e4-bdcc-4a03-85e0-39ed24a11a99") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:34:00.932758 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:00.932715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k" event={"ID":"0cc8b73f-d364-48f4-bcee-0403859d6fbe","Type":"ContainerStarted","Data":"67b9b7e8e25fb89fc74ef009e8f19b3ff3560ce17a787a0c9d4ca2da0ab6c520"}
Sep 17 00:34:01.937213 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:01.937176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k" event={"ID":"0cc8b73f-d364-48f4-bcee-0403859d6fbe","Type":"ContainerStarted","Data":"0b5e51517097d11456f9717870bf9a6663e639e948e4764732fd8ca36eab5263"}
Sep 17 00:34:01.937573 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:01.937233    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k" event={"ID":"0cc8b73f-d364-48f4-bcee-0403859d6fbe","Type":"ContainerStarted","Data":"b3f3f79c249b3feab8a40b65a6d653ef4fa1f8044f8cd329ac8291805486cced"}
Sep 17 00:34:01.952239 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:01.952196    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4qd9k" podStartSLOduration=1.680595812 podStartE2EDuration="2.952179803s" totalImagesPullingTime="1.271583991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:01.95075583 +0000 UTC m=+234.378213754" watchObservedRunningTime="2026-09-17 00:34:01.952179803 +0000 UTC m=+234.379637725"
Sep 17 00:34:01.967561 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:01.967539    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xv89m_1fba316c-30a0-4da6-b8fb-cc90962a2984/node-ca/0.log"
Sep 17 00:34:02.577933 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:02.577873    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h6jkw_f7be6e12-562d-48cd-bec6-9f4a39ca9862/serve-healthcheck-canary/0.log"
Sep 17 00:34:02.586100 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:02.586072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:34:02.586184 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:02.586113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:34:02.586219 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:02.586213    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 00:34:02.586252 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:02.586216    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:34:02.586281 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:02.586267    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm podName:b50420e4-bdcc-4a03-85e0-39ed24a11a99 nodeName:}" failed. No retries permitted until 2026-09-17 00:34:06.586252363 +0000 UTC m=+239.013710265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qm42r" (UID: "b50420e4-bdcc-4a03-85e0-39ed24a11a99") : configmap "kube-rbac-proxy" not found
Sep 17 00:34:02.586318 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:02.586282    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls podName:b50420e4-bdcc-4a03-85e0-39ed24a11a99 nodeName:}" failed. No retries permitted until 2026-09-17 00:34:06.586273638 +0000 UTC m=+239.013731539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qm42r" (UID: "b50420e4-bdcc-4a03-85e0-39ed24a11a99") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:34:06.619623 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:06.619585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:34:06.620120 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:06.619631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:34:06.620120 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:06.619710    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 00:34:06.620120 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:06.619726    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:34:06.620120 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:06.619795    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls podName:b50420e4-bdcc-4a03-85e0-39ed24a11a99 nodeName:}" failed. No retries permitted until 2026-09-17 00:34:14.619779665 +0000 UTC m=+247.047237569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qm42r" (UID: "b50420e4-bdcc-4a03-85e0-39ed24a11a99") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:34:06.620120 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:06.619809    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm podName:b50420e4-bdcc-4a03-85e0-39ed24a11a99 nodeName:}" failed. No retries permitted until 2026-09-17 00:34:14.619802517 +0000 UTC m=+247.047260418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qm42r" (UID: "b50420e4-bdcc-4a03-85e0-39ed24a11a99") : configmap "kube-rbac-proxy" not found
Sep 17 00:34:14.676589 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:14.676556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:34:14.676589 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:14.676595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:34:14.677215 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:14.677197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50420e4-bdcc-4a03-85e0-39ed24a11a99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:34:14.679106 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:14.679083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50420e4-bdcc-4a03-85e0-39ed24a11a99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm42r\" (UID: \"b50420e4-bdcc-4a03-85e0-39ed24a11a99\") " pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:34:14.729232 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:14.729206    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4ctq5\""
Sep 17 00:34:14.737835 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:14.737816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qm42r"
Sep 17 00:34:15.025996 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:15.025894    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qm42r"]
Sep 17 00:34:15.029016 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:34:15.028989    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50420e4_bdcc_4a03_85e0_39ed24a11a99.slice/crio-46adf28d36e44e7c818dec9eefc16236c3e58c8370c3c0e09378f41a1cef670b WatchSource:0}: Error finding container 46adf28d36e44e7c818dec9eefc16236c3e58c8370c3c0e09378f41a1cef670b: Status 404 returned error can't find the container with id 46adf28d36e44e7c818dec9eefc16236c3e58c8370c3c0e09378f41a1cef670b
Sep 17 00:34:15.977132 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:15.977099    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qm42r" event={"ID":"b50420e4-bdcc-4a03-85e0-39ed24a11a99","Type":"ContainerStarted","Data":"a4291e907721ebb8c624ebb5de3aeff38773d5672942c61760d426b8d0be5b70"}
Sep 17 00:34:15.977453 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:15.977151    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qm42r" event={"ID":"b50420e4-bdcc-4a03-85e0-39ed24a11a99","Type":"ContainerStarted","Data":"409f8f69c30e6678ccd0421383e19db848e071538918d840984c19d44fd3c25b"}
Sep 17 00:34:15.977453 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:15.977172    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qm42r" event={"ID":"b50420e4-bdcc-4a03-85e0-39ed24a11a99","Type":"ContainerStarted","Data":"46adf28d36e44e7c818dec9eefc16236c3e58c8370c3c0e09378f41a1cef670b"}
Sep 17 00:34:17.985811 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:17.985762    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qm42r" event={"ID":"b50420e4-bdcc-4a03-85e0-39ed24a11a99","Type":"ContainerStarted","Data":"9ad5d235fad25c47a62c9bfce1b425b90fee88d19f95802aabc877208eb9e53a"}
Sep 17 00:34:18.002532 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:18.002487    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qm42r" podStartSLOduration=17.663548862 podStartE2EDuration="20.002472352s" totalImagesPullingTime="2.33892349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:33:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:18.00146278 +0000 UTC m=+250.428920704" watchObservedRunningTime="2026-09-17 00:34:18.002472352 +0000 UTC m=+250.429930275"
Sep 17 00:34:19.812435 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:19.812388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:34:19.814748 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:19.814729    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3834b70-3e64-4873-ab8e-b551c9504f6d-metrics-certs\") pod \"network-metrics-daemon-hf4kw\" (UID: \"f3834b70-3e64-4873-ab8e-b551c9504f6d\") " pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:34:20.039754 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:20.039724    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-plv5t\""
Sep 17 00:34:20.048606 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:20.048583    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hf4kw"
Sep 17 00:34:20.313902 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:20.313868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hf4kw"]
Sep 17 00:34:20.317227 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:34:20.317203    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3834b70_3e64_4873_ab8e_b551c9504f6d.slice/crio-231302dea8ee7b27a72840d121d4ccc90e4d1906222fdd88e235b29ac4b78679 WatchSource:0}: Error finding container 231302dea8ee7b27a72840d121d4ccc90e4d1906222fdd88e235b29ac4b78679: Status 404 returned error can't find the container with id 231302dea8ee7b27a72840d121d4ccc90e4d1906222fdd88e235b29ac4b78679
Sep 17 00:34:20.995817 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:20.995783    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hf4kw" event={"ID":"f3834b70-3e64-4873-ab8e-b551c9504f6d","Type":"ContainerStarted","Data":"231302dea8ee7b27a72840d121d4ccc90e4d1906222fdd88e235b29ac4b78679"}
Sep 17 00:34:22.000741 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:22.000704    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hf4kw" event={"ID":"f3834b70-3e64-4873-ab8e-b551c9504f6d","Type":"ContainerStarted","Data":"344017163adc7695d0df128c7851ecc2f7508c49d486b1d0feba8f650434c865"}
Sep 17 00:34:22.001138 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:22.000760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hf4kw" event={"ID":"f3834b70-3e64-4873-ab8e-b551c9504f6d","Type":"ContainerStarted","Data":"c725ed3c3d4e9cd9f8798e5a76320f49c42fac6d5a21bf63a204881a2352e59b"}
Sep 17 00:34:22.015563 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:22.015517    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hf4kw" podStartSLOduration=253.100975784 podStartE2EDuration="4m14.015500079s" totalImagesPullingTime="914.524295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:22.014477449 +0000 UTC m=+254.441935372" watchObservedRunningTime="2026-09-17 00:34:22.015500079 +0000 UTC m=+254.442958001"
Sep 17 00:34:23.142523 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.142494    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d55b595c7-ltl2k"]
Sep 17 00:34:23.145301 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.145281    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.147402 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.147383    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 00:34:23.147683 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.147662    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 00:34:23.147780 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.147763    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 00:34:23.148349 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.148331    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cjf6n\""
Sep 17 00:34:23.157091 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.157071    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 00:34:23.163496 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.163471    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d55b595c7-ltl2k"]
Sep 17 00:34:23.236547 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.236525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcr8c\" (UniqueName: \"kubernetes.io/projected/c5685fe3-0998-4bb8-bafc-1e66ee55174a-kube-api-access-mcr8c\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.236702 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.236562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5685fe3-0998-4bb8-bafc-1e66ee55174a-image-registry-private-configuration\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.236702 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.236635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5685fe3-0998-4bb8-bafc-1e66ee55174a-bound-sa-token\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.236803 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.236699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5685fe3-0998-4bb8-bafc-1e66ee55174a-trusted-ca\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.236803 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.236732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5685fe3-0998-4bb8-bafc-1e66ee55174a-ca-trust-extracted\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.236803 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.236776    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5685fe3-0998-4bb8-bafc-1e66ee55174a-installation-pull-secrets\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.236942 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.236808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5685fe3-0998-4bb8-bafc-1e66ee55174a-registry-certificates\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.236942 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.236827    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5685fe3-0998-4bb8-bafc-1e66ee55174a-registry-tls\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.337144 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.337109    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5685fe3-0998-4bb8-bafc-1e66ee55174a-installation-pull-secrets\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.337291 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.337152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5685fe3-0998-4bb8-bafc-1e66ee55174a-registry-certificates\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.337291 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.337180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5685fe3-0998-4bb8-bafc-1e66ee55174a-registry-tls\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.337376 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.337292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcr8c\" (UniqueName: \"kubernetes.io/projected/c5685fe3-0998-4bb8-bafc-1e66ee55174a-kube-api-access-mcr8c\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.337376 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.337344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5685fe3-0998-4bb8-bafc-1e66ee55174a-image-registry-private-configuration\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.337478 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.337392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5685fe3-0998-4bb8-bafc-1e66ee55174a-bound-sa-token\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.337478 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.337427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5685fe3-0998-4bb8-bafc-1e66ee55174a-trusted-ca\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.337478 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.337457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5685fe3-0998-4bb8-bafc-1e66ee55174a-ca-trust-extracted\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.337844 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.337817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5685fe3-0998-4bb8-bafc-1e66ee55174a-ca-trust-extracted\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.337999 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.337932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5685fe3-0998-4bb8-bafc-1e66ee55174a-registry-certificates\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.338446 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.338428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5685fe3-0998-4bb8-bafc-1e66ee55174a-trusted-ca\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.339751 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.339729    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5685fe3-0998-4bb8-bafc-1e66ee55174a-image-registry-private-configuration\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.340184 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.340167    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5685fe3-0998-4bb8-bafc-1e66ee55174a-registry-tls\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.340289 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.340267    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5685fe3-0998-4bb8-bafc-1e66ee55174a-installation-pull-secrets\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.346836 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.346813    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcr8c\" (UniqueName: \"kubernetes.io/projected/c5685fe3-0998-4bb8-bafc-1e66ee55174a-kube-api-access-mcr8c\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.347701 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.347685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5685fe3-0998-4bb8-bafc-1e66ee55174a-bound-sa-token\") pod \"image-registry-5d55b595c7-ltl2k\" (UID: \"c5685fe3-0998-4bb8-bafc-1e66ee55174a\") " pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.454430 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.454397    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:23.731345 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:23.731257    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d55b595c7-ltl2k"]
Sep 17 00:34:23.735156 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:34:23.735127    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5685fe3_0998_4bb8_bafc_1e66ee55174a.slice/crio-94a63abccfc03850c67f61f906f220de65177e3d4c80db2ea1d501097464edb2 WatchSource:0}: Error finding container 94a63abccfc03850c67f61f906f220de65177e3d4c80db2ea1d501097464edb2: Status 404 returned error can't find the container with id 94a63abccfc03850c67f61f906f220de65177e3d4c80db2ea1d501097464edb2
Sep 17 00:34:24.008906 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:24.008821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k" event={"ID":"c5685fe3-0998-4bb8-bafc-1e66ee55174a","Type":"ContainerStarted","Data":"6bef650ffefe8a2cc8c1f0fbffb9d192059a9aa821aa128ba78ada30c1143fa5"}
Sep 17 00:34:24.008906 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:24.008877    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k" event={"ID":"c5685fe3-0998-4bb8-bafc-1e66ee55174a","Type":"ContainerStarted","Data":"94a63abccfc03850c67f61f906f220de65177e3d4c80db2ea1d501097464edb2"}
Sep 17 00:34:24.009096 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:24.008977    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:24.029170 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:24.029114    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k" podStartSLOduration=1.029093675 podStartE2EDuration="1.029093675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:24.028516097 +0000 UTC m=+256.455974021" watchObservedRunningTime="2026-09-17 00:34:24.029093675 +0000 UTC m=+256.456551599"
Sep 17 00:34:31.898853 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.898775    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s8llp"]
Sep 17 00:34:31.903466 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.903446    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:31.905762 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.905736    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 00:34:31.905869 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.905740    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s8d7w\""
Sep 17 00:34:31.906618 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.906594    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 00:34:31.906618 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.906612    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 00:34:31.906765 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.906620    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 00:34:31.906765 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.906627    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 00:34:31.906765 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.906630    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 00:34:31.996350 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.996326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjxd4\" (UniqueName: \"kubernetes.io/projected/a6cb4e3b-3458-4135-9900-a2d33ac95f36-kube-api-access-sjxd4\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:31.996518 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.996357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-wtmp\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:31.996518 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.996383    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6cb4e3b-3458-4135-9900-a2d33ac95f36-metrics-client-ca\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:31.996518 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.996445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:31.996518 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.996493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-tls\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:31.996681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.996519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6cb4e3b-3458-4135-9900-a2d33ac95f36-root\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:31.996681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.996578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:31.996681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.996606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-textfile\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:31.996681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:31.996643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6cb4e3b-3458-4135-9900-a2d33ac95f36-sys\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.096953 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.096927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjxd4\" (UniqueName: \"kubernetes.io/projected/a6cb4e3b-3458-4135-9900-a2d33ac95f36-kube-api-access-sjxd4\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097089 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.096975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-wtmp\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097089 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.096998    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6cb4e3b-3458-4135-9900-a2d33ac95f36-metrics-client-ca\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097089 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097089 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-tls\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097089 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097050    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6cb4e3b-3458-4135-9900-a2d33ac95f36-root\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097326 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097326 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-textfile\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097326 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-wtmp\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097326 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6cb4e3b-3458-4135-9900-a2d33ac95f36-sys\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097513 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6cb4e3b-3458-4135-9900-a2d33ac95f36-sys\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097513 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6cb4e3b-3458-4135-9900-a2d33ac95f36-root\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097513 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097489    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-textfile\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097808 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6cb4e3b-3458-4135-9900-a2d33ac95f36-metrics-client-ca\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.097953 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.097933    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.099437 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.099421    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.099625 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.099603    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6cb4e3b-3458-4135-9900-a2d33ac95f36-node-exporter-tls\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.109195 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.109172    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjxd4\" (UniqueName: \"kubernetes.io/projected/a6cb4e3b-3458-4135-9900-a2d33ac95f36-kube-api-access-sjxd4\") pod \"node-exporter-s8llp\" (UID: \"a6cb4e3b-3458-4135-9900-a2d33ac95f36\") " pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.213017 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:32.212927    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8llp"
Sep 17 00:34:32.225922 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:34:32.225895    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cb4e3b_3458_4135_9900_a2d33ac95f36.slice/crio-56080e3c61d326c6ee9d3911faadd4ec982297a8a72d4b87acc5b3a67edfc363 WatchSource:0}: Error finding container 56080e3c61d326c6ee9d3911faadd4ec982297a8a72d4b87acc5b3a67edfc363: Status 404 returned error can't find the container with id 56080e3c61d326c6ee9d3911faadd4ec982297a8a72d4b87acc5b3a67edfc363
Sep 17 00:34:33.037556 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:33.037520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8llp" event={"ID":"a6cb4e3b-3458-4135-9900-a2d33ac95f36","Type":"ContainerStarted","Data":"56080e3c61d326c6ee9d3911faadd4ec982297a8a72d4b87acc5b3a67edfc363"}
Sep 17 00:34:34.045046 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:34.045009    2576 generic.go:356] "Generic (PLEG): container finished" podID="a6cb4e3b-3458-4135-9900-a2d33ac95f36" containerID="f6b27d5fd600c2d967b7cd6c39fdd22d1ad1611eb5a4fd573b96176e5d0efab0" exitCode=0
Sep 17 00:34:34.045461 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:34.045099    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8llp" event={"ID":"a6cb4e3b-3458-4135-9900-a2d33ac95f36","Type":"ContainerDied","Data":"f6b27d5fd600c2d967b7cd6c39fdd22d1ad1611eb5a4fd573b96176e5d0efab0"}
Sep 17 00:34:35.050278 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:35.050245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8llp" event={"ID":"a6cb4e3b-3458-4135-9900-a2d33ac95f36","Type":"ContainerStarted","Data":"f1807f19b411e64e4defae66d6fd380b2f832464c295280806752a26affd3e57"}
Sep 17 00:34:35.050670 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:35.050297    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8llp" event={"ID":"a6cb4e3b-3458-4135-9900-a2d33ac95f36","Type":"ContainerStarted","Data":"52bc5f275c3bc5f090ac424962ac097addf78bec236076bc0eb91ae3dd1af6d2"}
Sep 17 00:34:35.067263 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:35.067218    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s8llp" podStartSLOduration=2.794313047 podStartE2EDuration="4.06720477s" totalImagesPullingTime="1.206213453s" totalInitContainerRuntime="66.67827ms" isStatefulPod=true podCreationTimestamp="2026-09-17 00:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:35.066215299 +0000 UTC m=+267.493673245" watchObservedRunningTime="2026-09-17 00:34:35.06720477 +0000 UTC m=+267.494662705"
Sep 17 00:34:39.115200 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.115172    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5866649cf4-dbgj4"]
Sep 17 00:34:39.118432 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.118416    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.120741 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.120717    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 00:34:39.120849 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.120720    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-px6mv\""
Sep 17 00:34:39.121644 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.121618    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 00:34:39.121644 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.121633    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 00:34:39.121786 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.121689    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 00:34:39.121786 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.121729    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 00:34:39.121897 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.121805    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 00:34:39.121897 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.121887    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 00:34:39.129895 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.129858    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5866649cf4-dbgj4"]
Sep 17 00:34:39.130283 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.130165    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 00:34:39.252809 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.252779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-oauth-serving-cert\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.252950 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.252822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-trusted-ca-bundle\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.252950 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.252853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2zvc\" (UniqueName: \"kubernetes.io/projected/3d4eb309-ce11-4862-bea5-65af56b11867-kube-api-access-w2zvc\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.252950 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.252873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-service-ca\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.252950 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.252894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-console-config\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.252950 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.252928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-oauth-config\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.252950 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.252947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-serving-cert\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.354111 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.354080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-console-config\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.354246 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.354123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-oauth-config\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.354246 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.354149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-serving-cert\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.354246 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.354202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-oauth-serving-cert\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.354246 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.354242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-trusted-ca-bundle\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.354443 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.354261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2zvc\" (UniqueName: \"kubernetes.io/projected/3d4eb309-ce11-4862-bea5-65af56b11867-kube-api-access-w2zvc\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.354443 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.354282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-service-ca\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.354807 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.354782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-console-config\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.355591 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.355570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-oauth-serving-cert\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.355686 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.355609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-service-ca\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.355802 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.355778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-trusted-ca-bundle\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.356844 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.356819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-serving-cert\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.356844 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.356837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-oauth-config\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.361576 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.361558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2zvc\" (UniqueName: \"kubernetes.io/projected/3d4eb309-ce11-4862-bea5-65af56b11867-kube-api-access-w2zvc\") pod \"console-5866649cf4-dbgj4\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") " pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.431667 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.431638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:39.698688 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:39.698610    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5866649cf4-dbgj4"]
Sep 17 00:34:39.701678 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:34:39.701653    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4eb309_ce11_4862_bea5_65af56b11867.slice/crio-396a1f20565ae8d010aaa611515d964fb2ebea213727906bdaff9ef2356317a5 WatchSource:0}: Error finding container 396a1f20565ae8d010aaa611515d964fb2ebea213727906bdaff9ef2356317a5: Status 404 returned error can't find the container with id 396a1f20565ae8d010aaa611515d964fb2ebea213727906bdaff9ef2356317a5
Sep 17 00:34:40.066507 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:40.066417    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5866649cf4-dbgj4" event={"ID":"3d4eb309-ce11-4862-bea5-65af56b11867","Type":"ContainerStarted","Data":"396a1f20565ae8d010aaa611515d964fb2ebea213727906bdaff9ef2356317a5"}
Sep 17 00:34:43.078496 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:43.078458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5866649cf4-dbgj4" event={"ID":"3d4eb309-ce11-4862-bea5-65af56b11867","Type":"ContainerStarted","Data":"0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f"}
Sep 17 00:34:43.096246 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:43.096204    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5866649cf4-dbgj4" podStartSLOduration=1.2351030920000001 podStartE2EDuration="4.096187995s" totalImagesPullingTime="2.861084903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:43.095108429 +0000 UTC m=+275.522566352" watchObservedRunningTime="2026-09-17 00:34:43.096187995 +0000 UTC m=+275.523645918"
Sep 17 00:34:43.459326 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:43.459297    2576 patch_prober.go:28] interesting pod/image-registry-5d55b595c7-ltl2k container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 00:34:43.459472 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:43.459347    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k" podUID="c5685fe3-0998-4bb8-bafc-1e66ee55174a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:34:45.016485 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:45.016451    2576 patch_prober.go:28] interesting pod/image-registry-5d55b595c7-ltl2k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 00:34:45.016864 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:45.016504    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k" podUID="c5685fe3-0998-4bb8-bafc-1e66ee55174a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:34:48.723763 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:34:48.723726    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-thdzd" podUID="44e39968-25a0-4b24-9f29-22e64c88ebe1"
Sep 17 00:34:49.097116 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:49.097040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-thdzd"
Sep 17 00:34:49.431897 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:49.431860    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:49.432088 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:49.432067    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:49.433215 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:49.433195    2576 patch_prober.go:28] interesting pod/console-5866649cf4-dbgj4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body=
Sep 17 00:34:49.433300 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:49.433238    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5866649cf4-dbgj4" podUID="3d4eb309-ce11-4862-bea5-65af56b11867" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused"
Sep 17 00:34:52.246553 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:52.246506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:34:52.248926 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:52.248907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44e39968-25a0-4b24-9f29-22e64c88ebe1-metrics-tls\") pod \"dns-default-thdzd\" (UID: \"44e39968-25a0-4b24-9f29-22e64c88ebe1\") " pod="openshift-dns/dns-default-thdzd"
Sep 17 00:34:52.400230 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:52.400200    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n9svt\""
Sep 17 00:34:52.408964 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:52.408943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-thdzd"
Sep 17 00:34:52.674273 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:52.674243    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-thdzd"]
Sep 17 00:34:52.677261 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:34:52.677235    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e39968_25a0_4b24_9f29_22e64c88ebe1.slice/crio-6fd556306d02598fb5a8e27295063dbcefcacaf4af219009ab7526284f8bd948 WatchSource:0}: Error finding container 6fd556306d02598fb5a8e27295063dbcefcacaf4af219009ab7526284f8bd948: Status 404 returned error can't find the container with id 6fd556306d02598fb5a8e27295063dbcefcacaf4af219009ab7526284f8bd948
Sep 17 00:34:53.115367 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:53.115295    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-thdzd" event={"ID":"44e39968-25a0-4b24-9f29-22e64c88ebe1","Type":"ContainerStarted","Data":"6fd556306d02598fb5a8e27295063dbcefcacaf4af219009ab7526284f8bd948"}
Sep 17 00:34:53.459435 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:53.459406    2576 patch_prober.go:28] interesting pod/image-registry-5d55b595c7-ltl2k container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 00:34:53.459878 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:53.459454    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k" podUID="c5685fe3-0998-4bb8-bafc-1e66ee55174a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:34:55.016464 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:55.016435    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d55b595c7-ltl2k"
Sep 17 00:34:55.124517 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:55.124470    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-thdzd" event={"ID":"44e39968-25a0-4b24-9f29-22e64c88ebe1","Type":"ContainerStarted","Data":"195c4f3432485ffb6897e2e0d4ad24ce704328253b136370614b5746e23f908e"}
Sep 17 00:34:55.124517 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:55.124522    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-thdzd" event={"ID":"44e39968-25a0-4b24-9f29-22e64c88ebe1","Type":"ContainerStarted","Data":"09015336936b0112d3f67aa4a0512f49c217a4372aaf4aa8516b9b0e591ffd02"}
Sep 17 00:34:55.124744 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:55.124622    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-thdzd"
Sep 17 00:34:59.436385 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:59.436356    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:59.440297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:59.440274    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:34:59.451837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:34:59.451785    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-thdzd" podStartSLOduration=255.728025825 podStartE2EDuration="4m17.451768207s" totalImagesPullingTime="1.723742382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:55.140917219 +0000 UTC m=+287.568375143" watchObservedRunningTime="2026-09-17 00:34:59.451768207 +0000 UTC m=+291.879226131"
Sep 17 00:35:04.434919 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:04.434887    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-thdzd_44e39968-25a0-4b24-9f29-22e64c88ebe1/dns/0.log"
Sep 17 00:35:04.635135 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:04.635097    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-thdzd_44e39968-25a0-4b24-9f29-22e64c88ebe1/kube-rbac-proxy/0.log"
Sep 17 00:35:04.842756 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:04.842693    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b6lfq_a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b/dns-node-resolver/0.log"
Sep 17 00:35:05.129572 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:05.129498    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-thdzd"
Sep 17 00:35:05.834975 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:05.834923    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h6jkw_f7be6e12-562d-48cd-bec6-9f4a39ca9862/serve-healthcheck-canary/0.log"
Sep 17 00:35:08.001456 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:08.001429    2576 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 00:35:14.865931 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:14.865884    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" podUID="a9cf5e29-d69e-405a-a142-cbf53918261e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 00:35:24.865411 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:24.865369    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" podUID="a9cf5e29-d69e-405a-a142-cbf53918261e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 00:35:34.865280 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:34.865241    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" podUID="a9cf5e29-d69e-405a-a142-cbf53918261e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 00:35:34.865670 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:34.865308    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq"
Sep 17 00:35:34.865890 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:34.865859    2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"72fca4287a08ff20f8da1226b4d026461752db103d78c68b0e44e5a993412557"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 17 00:35:34.865932 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:34.865914    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" podUID="a9cf5e29-d69e-405a-a142-cbf53918261e" containerName="service-proxy" containerID="cri-o://72fca4287a08ff20f8da1226b4d026461752db103d78c68b0e44e5a993412557" gracePeriod=30
Sep 17 00:35:35.261461 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:35.261427    2576 generic.go:356] "Generic (PLEG): container finished" podID="a9cf5e29-d69e-405a-a142-cbf53918261e" containerID="72fca4287a08ff20f8da1226b4d026461752db103d78c68b0e44e5a993412557" exitCode=2
Sep 17 00:35:35.261643 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:35.261496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" event={"ID":"a9cf5e29-d69e-405a-a142-cbf53918261e","Type":"ContainerDied","Data":"72fca4287a08ff20f8da1226b4d026461752db103d78c68b0e44e5a993412557"}
Sep 17 00:35:35.261643 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:35.261541    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd8bb746-5jqgq" event={"ID":"a9cf5e29-d69e-405a-a142-cbf53918261e","Type":"ContainerStarted","Data":"8a19e3581027bf0e87d4734923ffb355b8e15246588063bf83301b19abd2a96f"}
Sep 17 00:35:59.255767 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.255691    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cff65945-tf9gh"]
Sep 17 00:35:59.258581 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.258564    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.269555 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.269532    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cff65945-tf9gh"]
Sep 17 00:35:59.415221 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.415181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-service-ca\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.415221 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.415222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-trusted-ca-bundle\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.415434 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.415255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-oauth-config\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.415434 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.415304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-oauth-serving-cert\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.415434 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.415341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkp7p\" (UniqueName: \"kubernetes.io/projected/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-kube-api-access-pkp7p\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.415434 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.415372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-serving-cert\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.415434 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.415425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-config\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.516696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.516606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-serving-cert\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.516696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.516647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-config\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.516936 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.516783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-service-ca\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.516936 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.516819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-trusted-ca-bundle\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.516936 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.516857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-oauth-config\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.516936 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.516888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-oauth-serving-cert\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.516936 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.516933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkp7p\" (UniqueName: \"kubernetes.io/projected/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-kube-api-access-pkp7p\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.517405 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.517386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-config\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.517577 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.517557    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-service-ca\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.517686 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.517669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-trusted-ca-bundle\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.517879 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.517856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-oauth-serving-cert\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.519378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.519359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-serving-cert\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.519485 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.519468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-oauth-config\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.524361 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.524340    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkp7p\" (UniqueName: \"kubernetes.io/projected/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-kube-api-access-pkp7p\") pod \"console-cff65945-tf9gh\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") " pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.566853 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.566824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:35:59.835803 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:35:59.835723    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cff65945-tf9gh"]
Sep 17 00:35:59.838766 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:35:59.838735    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6e7a6d_c7f0_4523_bb1f_8ec777dd8024.slice/crio-56db0a8de78062fb1c64e628a81b77349cdf358691db63405f23999aaaed65bb WatchSource:0}: Error finding container 56db0a8de78062fb1c64e628a81b77349cdf358691db63405f23999aaaed65bb: Status 404 returned error can't find the container with id 56db0a8de78062fb1c64e628a81b77349cdf358691db63405f23999aaaed65bb
Sep 17 00:36:00.346170 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:00.346137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cff65945-tf9gh" event={"ID":"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024","Type":"ContainerStarted","Data":"e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27"}
Sep 17 00:36:00.346659 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:00.346184    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cff65945-tf9gh" event={"ID":"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024","Type":"ContainerStarted","Data":"56db0a8de78062fb1c64e628a81b77349cdf358691db63405f23999aaaed65bb"}
Sep 17 00:36:00.361597 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:00.361547    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cff65945-tf9gh" podStartSLOduration=1.361529347 podStartE2EDuration="1.361529347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:36:00.3611329 +0000 UTC m=+352.788590813" watchObservedRunningTime="2026-09-17 00:36:00.361529347 +0000 UTC m=+352.788987270"
Sep 17 00:36:09.567916 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:09.567877    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:36:09.568280 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:09.568035    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:36:09.572654 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:09.572635    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:36:10.385767 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:10.385734    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:36:10.459201 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:10.459173    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5866649cf4-dbgj4"]
Sep 17 00:36:35.482775 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.482721    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5866649cf4-dbgj4" podUID="3d4eb309-ce11-4862-bea5-65af56b11867" containerName="console" containerID="cri-o://0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f" gracePeriod=15
Sep 17 00:36:35.714206 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.714176    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:36:35.770932 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.770873    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2zvc\" (UniqueName: \"kubernetes.io/projected/3d4eb309-ce11-4862-bea5-65af56b11867-kube-api-access-w2zvc\") pod \"3d4eb309-ce11-4862-bea5-65af56b11867\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") "
Sep 17 00:36:35.770932 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.770908    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-service-ca\") pod \"3d4eb309-ce11-4862-bea5-65af56b11867\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") "
Sep 17 00:36:35.771123 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.771011    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-oauth-config\") pod \"3d4eb309-ce11-4862-bea5-65af56b11867\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") "
Sep 17 00:36:35.771123 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.771071    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-console-config\") pod \"3d4eb309-ce11-4862-bea5-65af56b11867\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") "
Sep 17 00:36:35.771123 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.771105    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-serving-cert\") pod \"3d4eb309-ce11-4862-bea5-65af56b11867\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") "
Sep 17 00:36:35.771259 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.771137    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-trusted-ca-bundle\") pod \"3d4eb309-ce11-4862-bea5-65af56b11867\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") "
Sep 17 00:36:35.771259 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.771176    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-oauth-serving-cert\") pod \"3d4eb309-ce11-4862-bea5-65af56b11867\" (UID: \"3d4eb309-ce11-4862-bea5-65af56b11867\") "
Sep 17 00:36:35.771361 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.771234    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d4eb309-ce11-4862-bea5-65af56b11867" (UID: "3d4eb309-ce11-4862-bea5-65af56b11867"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:36:35.771477 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.771448    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-console-config" (OuterVolumeSpecName: "console-config") pod "3d4eb309-ce11-4862-bea5-65af56b11867" (UID: "3d4eb309-ce11-4862-bea5-65af56b11867"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:36:35.771592 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.771509    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3d4eb309-ce11-4862-bea5-65af56b11867" (UID: "3d4eb309-ce11-4862-bea5-65af56b11867"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:36:35.771592 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.771556    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d4eb309-ce11-4862-bea5-65af56b11867" (UID: "3d4eb309-ce11-4862-bea5-65af56b11867"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:36:35.773355 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.773327    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d4eb309-ce11-4862-bea5-65af56b11867-kube-api-access-w2zvc" (OuterVolumeSpecName: "kube-api-access-w2zvc") pod "3d4eb309-ce11-4862-bea5-65af56b11867" (UID: "3d4eb309-ce11-4862-bea5-65af56b11867"). InnerVolumeSpecName "kube-api-access-w2zvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:36:35.773450 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.773404    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d4eb309-ce11-4862-bea5-65af56b11867" (UID: "3d4eb309-ce11-4862-bea5-65af56b11867"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:36:35.773504 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.773455    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d4eb309-ce11-4862-bea5-65af56b11867" (UID: "3d4eb309-ce11-4862-bea5-65af56b11867"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:36:35.872447 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.872414    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-trusted-ca-bundle\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:36:35.872447 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.872440    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-oauth-serving-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:36:35.872447 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.872449    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2zvc\" (UniqueName: \"kubernetes.io/projected/3d4eb309-ce11-4862-bea5-65af56b11867-kube-api-access-w2zvc\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:36:35.872649 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.872459    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-service-ca\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:36:35.872649 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.872468    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-oauth-config\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:36:35.872649 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.872475    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d4eb309-ce11-4862-bea5-65af56b11867-console-config\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:36:35.872649 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:35.872485    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d4eb309-ce11-4862-bea5-65af56b11867-console-serving-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:36:36.466165 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:36.466079    2576 generic.go:356] "Generic (PLEG): container finished" podID="3d4eb309-ce11-4862-bea5-65af56b11867" containerID="0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f" exitCode=0
Sep 17 00:36:36.466165 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:36.466130    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5866649cf4-dbgj4"
Sep 17 00:36:36.466335 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:36.466163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5866649cf4-dbgj4" event={"ID":"3d4eb309-ce11-4862-bea5-65af56b11867","Type":"ContainerDied","Data":"0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f"}
Sep 17 00:36:36.466335 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:36.466217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5866649cf4-dbgj4" event={"ID":"3d4eb309-ce11-4862-bea5-65af56b11867","Type":"ContainerDied","Data":"396a1f20565ae8d010aaa611515d964fb2ebea213727906bdaff9ef2356317a5"}
Sep 17 00:36:36.466335 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:36.466237    2576 scope.go:117] "RemoveContainer" containerID="0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f"
Sep 17 00:36:36.476353 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:36.476334    2576 scope.go:117] "RemoveContainer" containerID="0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f"
Sep 17 00:36:36.476645 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:36:36.476622    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f\": container with ID starting with 0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f not found: ID does not exist" containerID="0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f"
Sep 17 00:36:36.476704 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:36.476655    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f"} err="failed to get container status \"0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f\": rpc error: code = NotFound desc = could not find container \"0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f\": container with ID starting with 0c71c60e638b85f87a35bd9e763082090f52a184eed3337acc4d9118cca99f9f not found: ID does not exist"
Sep 17 00:36:36.481579 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:36.481556    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5866649cf4-dbgj4"]
Sep 17 00:36:36.483422 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:36.483401    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5866649cf4-dbgj4"]
Sep 17 00:36:38.139198 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:36:38.139161    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d4eb309-ce11-4862-bea5-65af56b11867" path="/var/lib/kubelet/pods/3d4eb309-ce11-4862-bea5-65af56b11867/volumes"
Sep 17 00:37:12.527646 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.527614    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8bffd6cc5-tklgg"]
Sep 17 00:37:12.528068 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.527824    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4eb309-ce11-4862-bea5-65af56b11867" containerName="console"
Sep 17 00:37:12.528068 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.527835    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4eb309-ce11-4862-bea5-65af56b11867" containerName="console"
Sep 17 00:37:12.528068 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.527914    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d4eb309-ce11-4862-bea5-65af56b11867" containerName="console"
Sep 17 00:37:12.531822 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.531806    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.542446 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.542421    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8bffd6cc5-tklgg"]
Sep 17 00:37:12.625466 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.625432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9t6r\" (UniqueName: \"kubernetes.io/projected/03d40773-d217-49df-8b67-15af7ee4506d-kube-api-access-f9t6r\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.625466 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.625470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-console-config\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.625652 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.625486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-trusted-ca-bundle\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.625652 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.625517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-oauth-config\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.625652 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.625560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-serving-cert\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.625652 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.625625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-oauth-serving-cert\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.625652 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.625642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-service-ca\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.726310 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.726274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-oauth-serving-cert\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.726310 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.726310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-service-ca\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.726521 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.726333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9t6r\" (UniqueName: \"kubernetes.io/projected/03d40773-d217-49df-8b67-15af7ee4506d-kube-api-access-f9t6r\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.726521 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.726467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-console-config\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.726521 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.726504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-trusted-ca-bundle\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.726679 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.726534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-oauth-config\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.726679 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.726665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-serving-cert\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.727090 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.727056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-service-ca\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.727090 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.727074    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-oauth-serving-cert\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.727257 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.727172    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-console-config\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.727370 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.727350    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-trusted-ca-bundle\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.729067 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.729040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-oauth-config\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.729189 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.729172    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-serving-cert\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.733054 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.733034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9t6r\" (UniqueName: \"kubernetes.io/projected/03d40773-d217-49df-8b67-15af7ee4506d-kube-api-access-f9t6r\") pod \"console-8bffd6cc5-tklgg\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") " pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:12.840803 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:12.840722    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:13.110182 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:13.110156    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8bffd6cc5-tklgg"]
Sep 17 00:37:13.112562 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:37:13.112537    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d40773_d217_49df_8b67_15af7ee4506d.slice/crio-cb13bf948509f190e80e5112c39c43ec4bd849f6b9144779fc25338a3313781f WatchSource:0}: Error finding container cb13bf948509f190e80e5112c39c43ec4bd849f6b9144779fc25338a3313781f: Status 404 returned error can't find the container with id cb13bf948509f190e80e5112c39c43ec4bd849f6b9144779fc25338a3313781f
Sep 17 00:37:13.592350 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:13.592321    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8bffd6cc5-tklgg" event={"ID":"03d40773-d217-49df-8b67-15af7ee4506d","Type":"ContainerStarted","Data":"5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782"}
Sep 17 00:37:13.592734 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:13.592366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8bffd6cc5-tklgg" event={"ID":"03d40773-d217-49df-8b67-15af7ee4506d","Type":"ContainerStarted","Data":"cb13bf948509f190e80e5112c39c43ec4bd849f6b9144779fc25338a3313781f"}
Sep 17 00:37:13.608072 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:13.608027    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8bffd6cc5-tklgg" podStartSLOduration=1.607990491 podStartE2EDuration="1.607990491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:37:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:37:13.606592756 +0000 UTC m=+426.034050679" watchObservedRunningTime="2026-09-17 00:37:13.607990491 +0000 UTC m=+426.035448414"
Sep 17 00:37:22.841021 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:22.840983    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:22.841435 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:22.841040    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:22.845665 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:22.845644    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:23.629743 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:23.629715    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:37:23.674406 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:23.674375    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cff65945-tf9gh"]
Sep 17 00:37:48.694199 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:48.694091    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cff65945-tf9gh" podUID="1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" containerName="console" containerID="cri-o://e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27" gracePeriod=15
Sep 17 00:37:48.925374 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:48.925352    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:37:49.077555 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.077457    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-service-ca\") pod \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") "
Sep 17 00:37:49.077555 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.077519    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-serving-cert\") pod \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") "
Sep 17 00:37:49.077555 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.077550    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-oauth-config\") pod \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") "
Sep 17 00:37:49.077831 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.077573    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-trusted-ca-bundle\") pod \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") "
Sep 17 00:37:49.077831 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.077606    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkp7p\" (UniqueName: \"kubernetes.io/projected/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-kube-api-access-pkp7p\") pod \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") "
Sep 17 00:37:49.077831 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.077621    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-config\") pod \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") "
Sep 17 00:37:49.077831 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.077744    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-oauth-serving-cert\") pod \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\" (UID: \"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024\") "
Sep 17 00:37:49.078062 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.077947    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-service-ca" (OuterVolumeSpecName: "service-ca") pod "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" (UID: "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:37:49.078104 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.078054    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-config" (OuterVolumeSpecName: "console-config") pod "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" (UID: "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:37:49.078173 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.078064    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" (UID: "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:37:49.078232 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.078214    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" (UID: "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:37:49.079897 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.079873    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" (UID: "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:37:49.079897 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.079885    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-kube-api-access-pkp7p" (OuterVolumeSpecName: "kube-api-access-pkp7p") pod "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" (UID: "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024"). InnerVolumeSpecName "kube-api-access-pkp7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:37:49.080062 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.079917    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" (UID: "1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:37:49.178554 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.178516    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-trusted-ca-bundle\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:37:49.178554 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.178548    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkp7p\" (UniqueName: \"kubernetes.io/projected/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-kube-api-access-pkp7p\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:37:49.178554 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.178559    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-config\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:37:49.178783 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.178568    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-oauth-serving-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:37:49.178783 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.178577    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-service-ca\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:37:49.178783 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.178585    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-serving-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:37:49.178783 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.178593    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024-console-oauth-config\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:37:49.712817 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.712782    2576 generic.go:356] "Generic (PLEG): container finished" podID="1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" containerID="e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27" exitCode=0
Sep 17 00:37:49.712817 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.712821    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cff65945-tf9gh"
Sep 17 00:37:49.713325 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.712826    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cff65945-tf9gh" event={"ID":"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024","Type":"ContainerDied","Data":"e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27"}
Sep 17 00:37:49.713325 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.712874    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cff65945-tf9gh" event={"ID":"1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024","Type":"ContainerDied","Data":"56db0a8de78062fb1c64e628a81b77349cdf358691db63405f23999aaaed65bb"}
Sep 17 00:37:49.713325 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.712903    2576 scope.go:117] "RemoveContainer" containerID="e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27"
Sep 17 00:37:49.720985 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.720949    2576 scope.go:117] "RemoveContainer" containerID="e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27"
Sep 17 00:37:49.721258 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:37:49.721242    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27\": container with ID starting with e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27 not found: ID does not exist" containerID="e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27"
Sep 17 00:37:49.721303 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.721267    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27"} err="failed to get container status \"e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27\": rpc error: code = NotFound desc = could not find container \"e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27\": container with ID starting with e1ba124b14fda3a0f29e3e31ea45ba5252dd51f8af2c958bc08907504eff4f27 not found: ID does not exist"
Sep 17 00:37:49.731189 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.731165    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cff65945-tf9gh"]
Sep 17 00:37:49.734419 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:49.734400    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cff65945-tf9gh"]
Sep 17 00:37:50.139448 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:37:50.139373    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" path="/var/lib/kubelet/pods/1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024/volumes"
Sep 17 00:38:42.605600 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.605564    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"]
Sep 17 00:38:42.606188 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.605786    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" containerName="console"
Sep 17 00:38:42.606188 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.605796    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" containerName="console"
Sep 17 00:38:42.606188 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.605845    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b6e7a6d-c7f0-4523-bb1f-8ec777dd8024" containerName="console"
Sep 17 00:38:42.609020 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.609004    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:38:42.611213 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.611187    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-22bqm\""
Sep 17 00:38:42.611213 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.611209    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 00:38:42.611389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.611194    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 00:38:42.616727 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.616703    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"]
Sep 17 00:38:42.656912 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.656888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsffl\" (UniqueName: \"kubernetes.io/projected/e07c6316-431d-442e-a8fb-0058de7c6817-kube-api-access-vsffl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:38:42.657056 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.656925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:38:42.657056 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.656982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:38:42.758254 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.758219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:38:42.758385 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.758287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:38:42.758385 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.758321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsffl\" (UniqueName: \"kubernetes.io/projected/e07c6316-431d-442e-a8fb-0058de7c6817-kube-api-access-vsffl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:38:42.758676 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.758652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:38:42.758736 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.758665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:38:42.766050 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.766033    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsffl\" (UniqueName: \"kubernetes.io/projected/e07c6316-431d-442e-a8fb-0058de7c6817-kube-api-access-vsffl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:38:42.918639 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:42.918609    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:38:43.183769 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:43.183690    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"]
Sep 17 00:38:43.187213 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:38:43.187186    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07c6316_431d_442e_a8fb_0058de7c6817.slice/crio-845d2cc1572a530ff4e11478dd6e2aa4930ad85d735ea63e33fd41b5d794ac85 WatchSource:0}: Error finding container 845d2cc1572a530ff4e11478dd6e2aa4930ad85d735ea63e33fd41b5d794ac85: Status 404 returned error can't find the container with id 845d2cc1572a530ff4e11478dd6e2aa4930ad85d735ea63e33fd41b5d794ac85
Sep 17 00:38:43.189154 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:43.189141    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:38:43.890098 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:43.890062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j" event={"ID":"e07c6316-431d-442e-a8fb-0058de7c6817","Type":"ContainerStarted","Data":"845d2cc1572a530ff4e11478dd6e2aa4930ad85d735ea63e33fd41b5d794ac85"}
Sep 17 00:38:49.913196 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:49.913168    2576 generic.go:356] "Generic (PLEG): container finished" podID="e07c6316-431d-442e-a8fb-0058de7c6817" containerID="7d8a2d712d963fbf85540f3eafe7b8352e41c4ce1435ba744187afb4b13396f0" exitCode=0
Sep 17 00:38:49.913636 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:49.913259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j" event={"ID":"e07c6316-431d-442e-a8fb-0058de7c6817","Type":"ContainerDied","Data":"7d8a2d712d963fbf85540f3eafe7b8352e41c4ce1435ba744187afb4b13396f0"}
Sep 17 00:38:51.923336 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:51.923304    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j" event={"ID":"e07c6316-431d-442e-a8fb-0058de7c6817","Type":"ContainerStarted","Data":"fb225e185e99646bd4c54f8c857e2994654007a15802a59f98e529f5a82788a3"}
Sep 17 00:38:52.928860 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:52.928822    2576 generic.go:356] "Generic (PLEG): container finished" podID="e07c6316-431d-442e-a8fb-0058de7c6817" containerID="fb225e185e99646bd4c54f8c857e2994654007a15802a59f98e529f5a82788a3" exitCode=0
Sep 17 00:38:52.929249 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:38:52.928894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j" event={"ID":"e07c6316-431d-442e-a8fb-0058de7c6817","Type":"ContainerDied","Data":"fb225e185e99646bd4c54f8c857e2994654007a15802a59f98e529f5a82788a3"}
Sep 17 00:39:01.964765 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:01.964731    2576 generic.go:356] "Generic (PLEG): container finished" podID="e07c6316-431d-442e-a8fb-0058de7c6817" containerID="a5be168982d6ca164784e97068c3fd0a8c3f2dbd5e5df4966cf11ebccbf87c26" exitCode=0
Sep 17 00:39:01.965179 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:01.964798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j" event={"ID":"e07c6316-431d-442e-a8fb-0058de7c6817","Type":"ContainerDied","Data":"a5be168982d6ca164784e97068c3fd0a8c3f2dbd5e5df4966cf11ebccbf87c26"}
Sep 17 00:39:03.082440 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.082416    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:39:03.221470 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.221367    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-util\") pod \"e07c6316-431d-442e-a8fb-0058de7c6817\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") "
Sep 17 00:39:03.221470 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.221454    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-bundle\") pod \"e07c6316-431d-442e-a8fb-0058de7c6817\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") "
Sep 17 00:39:03.221695 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.221495    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsffl\" (UniqueName: \"kubernetes.io/projected/e07c6316-431d-442e-a8fb-0058de7c6817-kube-api-access-vsffl\") pod \"e07c6316-431d-442e-a8fb-0058de7c6817\" (UID: \"e07c6316-431d-442e-a8fb-0058de7c6817\") "
Sep 17 00:39:03.222134 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.222098    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-bundle" (OuterVolumeSpecName: "bundle") pod "e07c6316-431d-442e-a8fb-0058de7c6817" (UID: "e07c6316-431d-442e-a8fb-0058de7c6817"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:03.223826 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.223796    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e07c6316-431d-442e-a8fb-0058de7c6817-kube-api-access-vsffl" (OuterVolumeSpecName: "kube-api-access-vsffl") pod "e07c6316-431d-442e-a8fb-0058de7c6817" (UID: "e07c6316-431d-442e-a8fb-0058de7c6817"). InnerVolumeSpecName "kube-api-access-vsffl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:03.225903 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.225881    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-util" (OuterVolumeSpecName: "util") pod "e07c6316-431d-442e-a8fb-0058de7c6817" (UID: "e07c6316-431d-442e-a8fb-0058de7c6817"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:03.322145 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.322116    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-util\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:39:03.322145 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.322143    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e07c6316-431d-442e-a8fb-0058de7c6817-bundle\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:39:03.322305 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.322155    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsffl\" (UniqueName: \"kubernetes.io/projected/e07c6316-431d-442e-a8fb-0058de7c6817-kube-api-access-vsffl\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:39:03.972619 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.972582    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j" event={"ID":"e07c6316-431d-442e-a8fb-0058de7c6817","Type":"ContainerDied","Data":"845d2cc1572a530ff4e11478dd6e2aa4930ad85d735ea63e33fd41b5d794ac85"}
Sep 17 00:39:03.972619 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.972620    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ftj7j"
Sep 17 00:39:03.972818 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:03.972637    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="845d2cc1572a530ff4e11478dd6e2aa4930ad85d735ea63e33fd41b5d794ac85"
Sep 17 00:39:15.615211 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.615176    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"]
Sep 17 00:39:15.615639 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.615387    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e07c6316-431d-442e-a8fb-0058de7c6817" containerName="pull"
Sep 17 00:39:15.615639 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.615397    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e07c6316-431d-442e-a8fb-0058de7c6817" containerName="pull"
Sep 17 00:39:15.615639 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.615411    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e07c6316-431d-442e-a8fb-0058de7c6817" containerName="extract"
Sep 17 00:39:15.615639 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.615416    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e07c6316-431d-442e-a8fb-0058de7c6817" containerName="extract"
Sep 17 00:39:15.615639 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.615425    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e07c6316-431d-442e-a8fb-0058de7c6817" containerName="util"
Sep 17 00:39:15.615639 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.615430    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e07c6316-431d-442e-a8fb-0058de7c6817" containerName="util"
Sep 17 00:39:15.615639 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.615473    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e07c6316-431d-442e-a8fb-0058de7c6817" containerName="extract"
Sep 17 00:39:15.619595 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.619574    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:15.621682 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.621657    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 00:39:15.621787 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.621691    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-22bqm\""
Sep 17 00:39:15.622474 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.622458    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 00:39:15.629605 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.629584    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"]
Sep 17 00:39:15.710577 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.710550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:15.710721 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.710585    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:15.710721 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.710634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfqg6\" (UniqueName: \"kubernetes.io/projected/51c42431-7b1e-458b-80b1-c1e5a6a598bb-kube-api-access-bfqg6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:15.811478 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.811453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:15.811545 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.811500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfqg6\" (UniqueName: \"kubernetes.io/projected/51c42431-7b1e-458b-80b1-c1e5a6a598bb-kube-api-access-bfqg6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:15.811545 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.811532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:15.811937 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.811916    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:15.811990 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.811921    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:15.819826 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.819801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfqg6\" (UniqueName: \"kubernetes.io/projected/51c42431-7b1e-458b-80b1-c1e5a6a598bb-kube-api-access-bfqg6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:15.928734 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:15.928709    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:16.200492 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:16.200379    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"]
Sep 17 00:39:16.203056 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:39:16.203028    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c42431_7b1e_458b_80b1_c1e5a6a598bb.slice/crio-edd623971ad62e0ee17e740ee8d74024e663ad361d387087503224404b5980de WatchSource:0}: Error finding container edd623971ad62e0ee17e740ee8d74024e663ad361d387087503224404b5980de: Status 404 returned error can't find the container with id edd623971ad62e0ee17e740ee8d74024e663ad361d387087503224404b5980de
Sep 17 00:39:17.014590 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:17.014552    2576 generic.go:356] "Generic (PLEG): container finished" podID="51c42431-7b1e-458b-80b1-c1e5a6a598bb" containerID="ca46797f3afa347f06521c585baa4278568f3872aaf8d0952d71acda47901851" exitCode=0
Sep 17 00:39:17.015072 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:17.014641    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf" event={"ID":"51c42431-7b1e-458b-80b1-c1e5a6a598bb","Type":"ContainerDied","Data":"ca46797f3afa347f06521c585baa4278568f3872aaf8d0952d71acda47901851"}
Sep 17 00:39:17.015072 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:17.014740    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf" event={"ID":"51c42431-7b1e-458b-80b1-c1e5a6a598bb","Type":"ContainerStarted","Data":"edd623971ad62e0ee17e740ee8d74024e663ad361d387087503224404b5980de"}
Sep 17 00:39:20.029821 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.029783    2576 generic.go:356] "Generic (PLEG): container finished" podID="51c42431-7b1e-458b-80b1-c1e5a6a598bb" containerID="af71e66c02e07f0dc4e71dcea007d742cbfe5a15d7374e3ea6382bbfb1810dfc" exitCode=0
Sep 17 00:39:20.030220 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.029866    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf" event={"ID":"51c42431-7b1e-458b-80b1-c1e5a6a598bb","Type":"ContainerDied","Data":"af71e66c02e07f0dc4e71dcea007d742cbfe5a15d7374e3ea6382bbfb1810dfc"}
Sep 17 00:39:20.633890 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.633851    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx"]
Sep 17 00:39:20.635774 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.635753    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx"
Sep 17 00:39:20.638090 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.638057    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 17 00:39:20.638188 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.638090    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 17 00:39:20.639246 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.639226    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gnxgq\""
Sep 17 00:39:20.645793 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.645770    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx"]
Sep 17 00:39:20.754643 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.754615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c33964cd-8b9a-4bd3-ba60-91ffb2335651-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bzlqx\" (UID: \"c33964cd-8b9a-4bd3-ba60-91ffb2335651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx"
Sep 17 00:39:20.754790 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.754659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4v2p\" (UniqueName: \"kubernetes.io/projected/c33964cd-8b9a-4bd3-ba60-91ffb2335651-kube-api-access-p4v2p\") pod \"cert-manager-cainjector-559cdd8c87-bzlqx\" (UID: \"c33964cd-8b9a-4bd3-ba60-91ffb2335651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx"
Sep 17 00:39:20.855880 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.855838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c33964cd-8b9a-4bd3-ba60-91ffb2335651-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bzlqx\" (UID: \"c33964cd-8b9a-4bd3-ba60-91ffb2335651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx"
Sep 17 00:39:20.856012 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.855901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4v2p\" (UniqueName: \"kubernetes.io/projected/c33964cd-8b9a-4bd3-ba60-91ffb2335651-kube-api-access-p4v2p\") pod \"cert-manager-cainjector-559cdd8c87-bzlqx\" (UID: \"c33964cd-8b9a-4bd3-ba60-91ffb2335651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx"
Sep 17 00:39:20.863871 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.863852    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c33964cd-8b9a-4bd3-ba60-91ffb2335651-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bzlqx\" (UID: \"c33964cd-8b9a-4bd3-ba60-91ffb2335651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx"
Sep 17 00:39:20.863987 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.863941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4v2p\" (UniqueName: \"kubernetes.io/projected/c33964cd-8b9a-4bd3-ba60-91ffb2335651-kube-api-access-p4v2p\") pod \"cert-manager-cainjector-559cdd8c87-bzlqx\" (UID: \"c33964cd-8b9a-4bd3-ba60-91ffb2335651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx"
Sep 17 00:39:20.944042 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:20.944013    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx"
Sep 17 00:39:21.035484 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:21.035455    2576 generic.go:356] "Generic (PLEG): container finished" podID="51c42431-7b1e-458b-80b1-c1e5a6a598bb" containerID="b20ed9cbf885eace7316c43ef19daaf50c4291a7a1b0f3a5bf5d2221ee0a82e6" exitCode=0
Sep 17 00:39:21.035802 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:21.035511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf" event={"ID":"51c42431-7b1e-458b-80b1-c1e5a6a598bb","Type":"ContainerDied","Data":"b20ed9cbf885eace7316c43ef19daaf50c4291a7a1b0f3a5bf5d2221ee0a82e6"}
Sep 17 00:39:21.210170 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:21.209632    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx"]
Sep 17 00:39:21.212432 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:39:21.212404    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc33964cd_8b9a_4bd3_ba60_91ffb2335651.slice/crio-ae97ae7f4ec7227b24a352c51827c71193142099104151cc9ac183d779093b35 WatchSource:0}: Error finding container ae97ae7f4ec7227b24a352c51827c71193142099104151cc9ac183d779093b35: Status 404 returned error can't find the container with id ae97ae7f4ec7227b24a352c51827c71193142099104151cc9ac183d779093b35
Sep 17 00:39:22.040848 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:22.040812    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx" event={"ID":"c33964cd-8b9a-4bd3-ba60-91ffb2335651","Type":"ContainerStarted","Data":"ae97ae7f4ec7227b24a352c51827c71193142099104151cc9ac183d779093b35"}
Sep 17 00:39:22.170481 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:22.170459    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:22.265427 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:22.265394    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfqg6\" (UniqueName: \"kubernetes.io/projected/51c42431-7b1e-458b-80b1-c1e5a6a598bb-kube-api-access-bfqg6\") pod \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") "
Sep 17 00:39:22.265601 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:22.265445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-util\") pod \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") "
Sep 17 00:39:22.265601 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:22.265480    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-bundle\") pod \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\" (UID: \"51c42431-7b1e-458b-80b1-c1e5a6a598bb\") "
Sep 17 00:39:22.265946 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:22.265911    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-bundle" (OuterVolumeSpecName: "bundle") pod "51c42431-7b1e-458b-80b1-c1e5a6a598bb" (UID: "51c42431-7b1e-458b-80b1-c1e5a6a598bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:22.267910 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:22.267882    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c42431-7b1e-458b-80b1-c1e5a6a598bb-kube-api-access-bfqg6" (OuterVolumeSpecName: "kube-api-access-bfqg6") pod "51c42431-7b1e-458b-80b1-c1e5a6a598bb" (UID: "51c42431-7b1e-458b-80b1-c1e5a6a598bb"). InnerVolumeSpecName "kube-api-access-bfqg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:22.271625 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:22.271574    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-util" (OuterVolumeSpecName: "util") pod "51c42431-7b1e-458b-80b1-c1e5a6a598bb" (UID: "51c42431-7b1e-458b-80b1-c1e5a6a598bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:22.366874 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:22.366800    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfqg6\" (UniqueName: \"kubernetes.io/projected/51c42431-7b1e-458b-80b1-c1e5a6a598bb-kube-api-access-bfqg6\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.366874 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:22.366834    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-util\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.366874 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:22.366849    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c42431-7b1e-458b-80b1-c1e5a6a598bb-bundle\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:39:23.046773 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:23.046733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf" event={"ID":"51c42431-7b1e-458b-80b1-c1e5a6a598bb","Type":"ContainerDied","Data":"edd623971ad62e0ee17e740ee8d74024e663ad361d387087503224404b5980de"}
Sep 17 00:39:23.047159 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:23.046790    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edd623971ad62e0ee17e740ee8d74024e663ad361d387087503224404b5980de"
Sep 17 00:39:23.047159 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:23.046748    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f249qf"
Sep 17 00:39:25.062816 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:25.062778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx" event={"ID":"c33964cd-8b9a-4bd3-ba60-91ffb2335651","Type":"ContainerStarted","Data":"ab392f91e47c6c16def67a85f25d690c79159d1a79250dc150411f04ac70f62d"}
Sep 17 00:39:25.077691 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:25.077647    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bzlqx" podStartSLOduration=2.295993511 podStartE2EDuration="5.077634344s" totalImagesPullingTime="2.781640833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:39:25.076472553 +0000 UTC m=+557.503930476" watchObservedRunningTime="2026-09-17 00:39:25.077634344 +0000 UTC m=+557.505092266"
Sep 17 00:39:40.934294 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:40.934261    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d4b5c5f-jdm9t"]
Sep 17 00:39:40.934721 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:40.934476    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c42431-7b1e-458b-80b1-c1e5a6a598bb" containerName="util"
Sep 17 00:39:40.934721 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:40.934489    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c42431-7b1e-458b-80b1-c1e5a6a598bb" containerName="util"
Sep 17 00:39:40.934721 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:40.934532    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c42431-7b1e-458b-80b1-c1e5a6a598bb" containerName="pull"
Sep 17 00:39:40.934721 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:40.934538    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c42431-7b1e-458b-80b1-c1e5a6a598bb" containerName="pull"
Sep 17 00:39:40.934721 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:40.934553    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c42431-7b1e-458b-80b1-c1e5a6a598bb" containerName="extract"
Sep 17 00:39:40.934721 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:40.934558    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c42431-7b1e-458b-80b1-c1e5a6a598bb" containerName="extract"
Sep 17 00:39:40.934721 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:40.934600    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="51c42431-7b1e-458b-80b1-c1e5a6a598bb" containerName="extract"
Sep 17 00:39:40.936312 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:40.936297    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:40.946544 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:40.946521    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4b5c5f-jdm9t"]
Sep 17 00:39:41.090574 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.090532    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-trusted-ca-bundle\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.090574 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.090578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-console-oauth-config\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.090773 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.090609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-console-config\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.090773 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.090656    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-oauth-serving-cert\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.090773 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.090694    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-console-serving-cert\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.090773 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.090718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-service-ca\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.090773 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.090737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snplc\" (UniqueName: \"kubernetes.io/projected/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-kube-api-access-snplc\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.192034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.191924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-service-ca\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.192034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.191972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snplc\" (UniqueName: \"kubernetes.io/projected/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-kube-api-access-snplc\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.192034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.192000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-trusted-ca-bundle\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.192034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.192031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-console-oauth-config\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.192351 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.192054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-console-config\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.192351 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.192074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-oauth-serving-cert\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.192351 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.192109    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-console-serving-cert\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.192733 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.192707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-service-ca\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.193046 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.192905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-oauth-serving-cert\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.193046 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.192978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-console-config\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.193173 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.193045    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-trusted-ca-bundle\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.194712 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.194692    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-console-serving-cert\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.194809 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.194718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-console-oauth-config\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.200499 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.200479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snplc\" (UniqueName: \"kubernetes.io/projected/02d1fa35-5b4f-4872-bbab-0183b5f5d5ba-kube-api-access-snplc\") pod \"console-6d4b5c5f-jdm9t\" (UID: \"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba\") " pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.246261 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.246236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:41.514705 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:41.514684    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4b5c5f-jdm9t"]
Sep 17 00:39:41.516973 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:39:41.516918    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d1fa35_5b4f_4872_bbab_0183b5f5d5ba.slice/crio-e91c8d740e8b1f3a7a2aded39dbced5c1aa986199f26a3ae069bfbdbaefd171f WatchSource:0}: Error finding container e91c8d740e8b1f3a7a2aded39dbced5c1aa986199f26a3ae069bfbdbaefd171f: Status 404 returned error can't find the container with id e91c8d740e8b1f3a7a2aded39dbced5c1aa986199f26a3ae069bfbdbaefd171f
Sep 17 00:39:42.126374 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:42.126334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4b5c5f-jdm9t" event={"ID":"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba","Type":"ContainerStarted","Data":"05a5f217c5b460df54b72e82e5e8ac500129a2c9de8530377a541a3775fc8241"}
Sep 17 00:39:42.126823 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:42.126384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4b5c5f-jdm9t" event={"ID":"02d1fa35-5b4f-4872-bbab-0183b5f5d5ba","Type":"ContainerStarted","Data":"e91c8d740e8b1f3a7a2aded39dbced5c1aa986199f26a3ae069bfbdbaefd171f"}
Sep 17 00:39:42.143940 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:42.143893    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d4b5c5f-jdm9t" podStartSLOduration=2.143877566 podStartE2EDuration="2.143877566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:39:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:39:42.142030473 +0000 UTC m=+574.569488397" watchObservedRunningTime="2026-09-17 00:39:42.143877566 +0000 UTC m=+574.571335488"
Sep 17 00:39:43.826495 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:43.826458    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"]
Sep 17 00:39:43.828727 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:43.828711    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:43.831005 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:43.830980    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 00:39:43.831132 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:43.831085    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-22bqm\""
Sep 17 00:39:43.831882 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:43.831867    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 00:39:43.838049 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:43.838028    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"]
Sep 17 00:39:44.011060 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:44.011029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:44.011211 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:44.011073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhgm7\" (UniqueName: \"kubernetes.io/projected/9fe83341-edfe-4663-b5a8-c65a1394c70e-kube-api-access-bhgm7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:44.011211 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:44.011150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:44.112258 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:44.112190    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhgm7\" (UniqueName: \"kubernetes.io/projected/9fe83341-edfe-4663-b5a8-c65a1394c70e-kube-api-access-bhgm7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:44.112258 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:44.112244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:44.112442 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:44.112282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:44.112634 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:44.112615    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:44.112716 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:44.112648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:44.119706 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:44.119682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhgm7\" (UniqueName: \"kubernetes.io/projected/9fe83341-edfe-4663-b5a8-c65a1394c70e-kube-api-access-bhgm7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:44.138269 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:44.138239    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:44.403898 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:44.403762    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"]
Sep 17 00:39:44.406596 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:39:44.406562    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe83341_edfe_4663_b5a8_c65a1394c70e.slice/crio-c113f02c861e2e404dfe702bb43a4b64f0b80b8b33c3523a214f0d54ea7b634c WatchSource:0}: Error finding container c113f02c861e2e404dfe702bb43a4b64f0b80b8b33c3523a214f0d54ea7b634c: Status 404 returned error can't find the container with id c113f02c861e2e404dfe702bb43a4b64f0b80b8b33c3523a214f0d54ea7b634c
Sep 17 00:39:45.140467 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:45.140437    2576 generic.go:356] "Generic (PLEG): container finished" podID="9fe83341-edfe-4663-b5a8-c65a1394c70e" containerID="71b1f0e39da7de6dcfd1aa1fbdd3d95e8f29cd0f89a346c36d57fec9bf97eaec" exitCode=0
Sep 17 00:39:45.140815 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:45.140479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn" event={"ID":"9fe83341-edfe-4663-b5a8-c65a1394c70e","Type":"ContainerDied","Data":"71b1f0e39da7de6dcfd1aa1fbdd3d95e8f29cd0f89a346c36d57fec9bf97eaec"}
Sep 17 00:39:45.140815 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:45.140511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn" event={"ID":"9fe83341-edfe-4663-b5a8-c65a1394c70e","Type":"ContainerStarted","Data":"c113f02c861e2e404dfe702bb43a4b64f0b80b8b33c3523a214f0d54ea7b634c"}
Sep 17 00:39:46.145354 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:46.145325    2576 generic.go:356] "Generic (PLEG): container finished" podID="9fe83341-edfe-4663-b5a8-c65a1394c70e" containerID="f89598205350d6390c91d14b67cce410e9f33481f84430ce02851caccf8e9af1" exitCode=0
Sep 17 00:39:46.145713 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:46.145410    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn" event={"ID":"9fe83341-edfe-4663-b5a8-c65a1394c70e","Type":"ContainerDied","Data":"f89598205350d6390c91d14b67cce410e9f33481f84430ce02851caccf8e9af1"}
Sep 17 00:39:47.151214 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:47.151181    2576 generic.go:356] "Generic (PLEG): container finished" podID="9fe83341-edfe-4663-b5a8-c65a1394c70e" containerID="65ee97a7601ddc8e63b14e08189b151969e38651bcf65c9c506248a57200daa6" exitCode=0
Sep 17 00:39:47.151551 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:47.151266    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn" event={"ID":"9fe83341-edfe-4663-b5a8-c65a1394c70e","Type":"ContainerDied","Data":"65ee97a7601ddc8e63b14e08189b151969e38651bcf65c9c506248a57200daa6"}
Sep 17 00:39:48.273117 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:48.273096    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:48.443072 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:48.442991    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-bundle\") pod \"9fe83341-edfe-4663-b5a8-c65a1394c70e\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") "
Sep 17 00:39:48.443072 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:48.443027    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-util\") pod \"9fe83341-edfe-4663-b5a8-c65a1394c70e\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") "
Sep 17 00:39:48.443072 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:48.443073    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhgm7\" (UniqueName: \"kubernetes.io/projected/9fe83341-edfe-4663-b5a8-c65a1394c70e-kube-api-access-bhgm7\") pod \"9fe83341-edfe-4663-b5a8-c65a1394c70e\" (UID: \"9fe83341-edfe-4663-b5a8-c65a1394c70e\") "
Sep 17 00:39:48.443762 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:48.443735    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-bundle" (OuterVolumeSpecName: "bundle") pod "9fe83341-edfe-4663-b5a8-c65a1394c70e" (UID: "9fe83341-edfe-4663-b5a8-c65a1394c70e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:48.445253 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:48.445230    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fe83341-edfe-4663-b5a8-c65a1394c70e-kube-api-access-bhgm7" (OuterVolumeSpecName: "kube-api-access-bhgm7") pod "9fe83341-edfe-4663-b5a8-c65a1394c70e" (UID: "9fe83341-edfe-4663-b5a8-c65a1394c70e"). InnerVolumeSpecName "kube-api-access-bhgm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:48.451046 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:48.451019    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-util" (OuterVolumeSpecName: "util") pod "9fe83341-edfe-4663-b5a8-c65a1394c70e" (UID: "9fe83341-edfe-4663-b5a8-c65a1394c70e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:48.543607 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:48.543569    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhgm7\" (UniqueName: \"kubernetes.io/projected/9fe83341-edfe-4663-b5a8-c65a1394c70e-kube-api-access-bhgm7\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:39:48.543607 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:48.543605    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-bundle\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:39:48.543607 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:48.543614    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fe83341-edfe-4663-b5a8-c65a1394c70e-util\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:39:49.159096 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:49.159063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn" event={"ID":"9fe83341-edfe-4663-b5a8-c65a1394c70e","Type":"ContainerDied","Data":"c113f02c861e2e404dfe702bb43a4b64f0b80b8b33c3523a214f0d54ea7b634c"}
Sep 17 00:39:49.159096 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:49.159099    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd42tn"
Sep 17 00:39:49.159286 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:49.159112    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c113f02c861e2e404dfe702bb43a4b64f0b80b8b33c3523a214f0d54ea7b634c"
Sep 17 00:39:51.247188 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:51.247157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:51.247622 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:51.247232    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:51.251913 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:51.251886    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:52.171733 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:52.171706    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d4b5c5f-jdm9t"
Sep 17 00:39:52.218862 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:39:52.218827    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8bffd6cc5-tklgg"]
Sep 17 00:40:01.038734 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.038700    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"]
Sep 17 00:40:01.039107 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.039083    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fe83341-edfe-4663-b5a8-c65a1394c70e" containerName="util"
Sep 17 00:40:01.039107 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.039100    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fe83341-edfe-4663-b5a8-c65a1394c70e" containerName="util"
Sep 17 00:40:01.039182 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.039113    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fe83341-edfe-4663-b5a8-c65a1394c70e" containerName="pull"
Sep 17 00:40:01.039182 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.039122    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fe83341-edfe-4663-b5a8-c65a1394c70e" containerName="pull"
Sep 17 00:40:01.039182 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.039141    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fe83341-edfe-4663-b5a8-c65a1394c70e" containerName="extract"
Sep 17 00:40:01.039182 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.039152    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fe83341-edfe-4663-b5a8-c65a1394c70e" containerName="extract"
Sep 17 00:40:01.039339 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.039255    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fe83341-edfe-4663-b5a8-c65a1394c70e" containerName="extract"
Sep 17 00:40:01.042612 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.042589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:01.045666 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.045640    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-22bqm\""
Sep 17 00:40:01.046179 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.046161    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 00:40:01.046253 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.046199    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 00:40:01.058579 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.058555    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"]
Sep 17 00:40:01.131467 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.131424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:01.131659 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.131481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wfzr\" (UniqueName: \"kubernetes.io/projected/995aba86-b5ab-4d29-8855-a0b1f806f9ea-kube-api-access-5wfzr\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:01.131659 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.131521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:01.232725 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.232686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wfzr\" (UniqueName: \"kubernetes.io/projected/995aba86-b5ab-4d29-8855-a0b1f806f9ea-kube-api-access-5wfzr\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:01.232725 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.232732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:01.232929 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.232772    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:01.233142 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.233125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:01.233194 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.233154    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:01.252265 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.252236    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"]
Sep 17 00:40:01.254046 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.254024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wfzr\" (UniqueName: \"kubernetes.io/projected/995aba86-b5ab-4d29-8855-a0b1f806f9ea-kube-api-access-5wfzr\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:01.255479 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.255448    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.259349 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.259327    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 00:40:01.259453 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.259426    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mmxsx\""
Sep 17 00:40:01.259530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.259459    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 00:40:01.259607 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.259585    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 00:40:01.259706 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.259689    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 00:40:01.277497 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.277476    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"]
Sep 17 00:40:01.333393 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.333313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.333393 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.333356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-tmp\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.333561 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.333419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.333561 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.333468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5k2f\" (UniqueName: \"kubernetes.io/projected/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-kube-api-access-p5k2f\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.333561 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.333543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-manifests\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.352305 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.352279    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:01.434698 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.434667    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-tmp\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.434837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.434723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.434837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.434777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5k2f\" (UniqueName: \"kubernetes.io/projected/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-kube-api-access-p5k2f\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.434837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.434821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-manifests\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.435048 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.434850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.435309 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.435286    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-manifests\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.437197 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.437170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-tmp\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.437281 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.437230    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.437281 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.437270    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.443269 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.443247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5k2f\" (UniqueName: \"kubernetes.io/projected/47666fe1-e069-4ffb-9b2e-cc74f282e3fc-kube-api-access-p5k2f\") pod \"opendatahub-operator-controller-manager-596c59f645-gxlg5\" (UID: \"47666fe1-e069-4ffb-9b2e-cc74f282e3fc\") " pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.568901 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.568865    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:01.626767 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.626740    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"]
Sep 17 00:40:01.630347 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:40:01.630306    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995aba86_b5ab_4d29_8855_a0b1f806f9ea.slice/crio-e337960fe5c034ab26dcbb5897a9c5df31563f05834894f5599ca54ec18bfe64 WatchSource:0}: Error finding container e337960fe5c034ab26dcbb5897a9c5df31563f05834894f5599ca54ec18bfe64: Status 404 returned error can't find the container with id e337960fe5c034ab26dcbb5897a9c5df31563f05834894f5599ca54ec18bfe64
Sep 17 00:40:01.852577 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:01.852545    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"]
Sep 17 00:40:01.856128 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:40:01.856098    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47666fe1_e069_4ffb_9b2e_cc74f282e3fc.slice/crio-fcf9d6af5fae63129cd79e7a5d46a11a34f19e5a5569f9ea274d99ded41f24de WatchSource:0}: Error finding container fcf9d6af5fae63129cd79e7a5d46a11a34f19e5a5569f9ea274d99ded41f24de: Status 404 returned error can't find the container with id fcf9d6af5fae63129cd79e7a5d46a11a34f19e5a5569f9ea274d99ded41f24de
Sep 17 00:40:02.205247 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:02.205214    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5" event={"ID":"47666fe1-e069-4ffb-9b2e-cc74f282e3fc","Type":"ContainerStarted","Data":"fcf9d6af5fae63129cd79e7a5d46a11a34f19e5a5569f9ea274d99ded41f24de"}
Sep 17 00:40:02.206666 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:02.206640    2576 generic.go:356] "Generic (PLEG): container finished" podID="995aba86-b5ab-4d29-8855-a0b1f806f9ea" containerID="ae053ccecb7610d587aa3929335dd7df13ff7ca4e70fe83eede6b27615254d24" exitCode=0
Sep 17 00:40:02.206767 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:02.206731    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj" event={"ID":"995aba86-b5ab-4d29-8855-a0b1f806f9ea","Type":"ContainerDied","Data":"ae053ccecb7610d587aa3929335dd7df13ff7ca4e70fe83eede6b27615254d24"}
Sep 17 00:40:02.206767 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:02.206765    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj" event={"ID":"995aba86-b5ab-4d29-8855-a0b1f806f9ea","Type":"ContainerStarted","Data":"e337960fe5c034ab26dcbb5897a9c5df31563f05834894f5599ca54ec18bfe64"}
Sep 17 00:40:03.214813 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:03.214782    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj" event={"ID":"995aba86-b5ab-4d29-8855-a0b1f806f9ea","Type":"ContainerStarted","Data":"4d1e1c6af479b698def396218ef624c8dff16c9ffd4e46302b860e13d644f44f"}
Sep 17 00:40:04.222947 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:04.222908    2576 generic.go:356] "Generic (PLEG): container finished" podID="995aba86-b5ab-4d29-8855-a0b1f806f9ea" containerID="4d1e1c6af479b698def396218ef624c8dff16c9ffd4e46302b860e13d644f44f" exitCode=0
Sep 17 00:40:04.223438 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:04.223005    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj" event={"ID":"995aba86-b5ab-4d29-8855-a0b1f806f9ea","Type":"ContainerDied","Data":"4d1e1c6af479b698def396218ef624c8dff16c9ffd4e46302b860e13d644f44f"}
Sep 17 00:40:05.228708 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:05.228604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5" event={"ID":"47666fe1-e069-4ffb-9b2e-cc74f282e3fc","Type":"ContainerStarted","Data":"54a750672ea964a544906c9eb9a4fcb20fbc18c342f2895cc61960f7467b8b36"}
Sep 17 00:40:05.230752 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:05.230727    2576 generic.go:356] "Generic (PLEG): container finished" podID="995aba86-b5ab-4d29-8855-a0b1f806f9ea" containerID="c27c49c947d52302fc4a9380694b57730ffe4aa9c3cc88fd839dc0f664759635" exitCode=0
Sep 17 00:40:05.230867 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:05.230810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj" event={"ID":"995aba86-b5ab-4d29-8855-a0b1f806f9ea","Type":"ContainerDied","Data":"c27c49c947d52302fc4a9380694b57730ffe4aa9c3cc88fd839dc0f664759635"}
Sep 17 00:40:06.236160 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.236130    2576 generic.go:356] "Generic (PLEG): container finished" podID="47666fe1-e069-4ffb-9b2e-cc74f282e3fc" containerID="54a750672ea964a544906c9eb9a4fcb20fbc18c342f2895cc61960f7467b8b36" exitCode=0
Sep 17 00:40:06.236534 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.236209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5" event={"ID":"47666fe1-e069-4ffb-9b2e-cc74f282e3fc","Type":"ContainerDied","Data":"54a750672ea964a544906c9eb9a4fcb20fbc18c342f2895cc61960f7467b8b36"}
Sep 17 00:40:06.357306 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.357283    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:06.376803 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.376778    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-bundle\") pod \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") "
Sep 17 00:40:06.376925 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.376812    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-util\") pod \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") "
Sep 17 00:40:06.376925 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.376889    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wfzr\" (UniqueName: \"kubernetes.io/projected/995aba86-b5ab-4d29-8855-a0b1f806f9ea-kube-api-access-5wfzr\") pod \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\" (UID: \"995aba86-b5ab-4d29-8855-a0b1f806f9ea\") "
Sep 17 00:40:06.377613 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.377518    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-bundle" (OuterVolumeSpecName: "bundle") pod "995aba86-b5ab-4d29-8855-a0b1f806f9ea" (UID: "995aba86-b5ab-4d29-8855-a0b1f806f9ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:06.379312 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.379286    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995aba86-b5ab-4d29-8855-a0b1f806f9ea-kube-api-access-5wfzr" (OuterVolumeSpecName: "kube-api-access-5wfzr") pod "995aba86-b5ab-4d29-8855-a0b1f806f9ea" (UID: "995aba86-b5ab-4d29-8855-a0b1f806f9ea"). InnerVolumeSpecName "kube-api-access-5wfzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:40:06.382147 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.382122    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-util" (OuterVolumeSpecName: "util") pod "995aba86-b5ab-4d29-8855-a0b1f806f9ea" (UID: "995aba86-b5ab-4d29-8855-a0b1f806f9ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:06.478172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.478140    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-util\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:06.478172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.478168    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wfzr\" (UniqueName: \"kubernetes.io/projected/995aba86-b5ab-4d29-8855-a0b1f806f9ea-kube-api-access-5wfzr\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:06.478172 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:06.478177    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/995aba86-b5ab-4d29-8855-a0b1f806f9ea-bundle\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:07.242358 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:07.242327    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5" event={"ID":"47666fe1-e069-4ffb-9b2e-cc74f282e3fc","Type":"ContainerStarted","Data":"8453f1db032f63b4caad70cfd9594cacfe096b90c78bb4122b1f0e77dfa83d04"}
Sep 17 00:40:07.242819 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:07.242448    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:07.244283 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:07.244266    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj"
Sep 17 00:40:07.244283 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:07.244273    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0brgcj" event={"ID":"995aba86-b5ab-4d29-8855-a0b1f806f9ea","Type":"ContainerDied","Data":"e337960fe5c034ab26dcbb5897a9c5df31563f05834894f5599ca54ec18bfe64"}
Sep 17 00:40:07.244419 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:07.244303    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e337960fe5c034ab26dcbb5897a9c5df31563f05834894f5599ca54ec18bfe64"
Sep 17 00:40:07.263530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:07.263485    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5" podStartSLOduration=1.8062851709999999 podStartE2EDuration="6.263471819s" totalImagesPullingTime="3.413440079s" totalInitContainerRuntime="1.043746569s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:40:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:40:07.261442558 +0000 UTC m=+599.688900482" watchObservedRunningTime="2026-09-17 00:40:07.263471819 +0000 UTC m=+599.690929742"
Sep 17 00:40:17.239012 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.238947    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8bffd6cc5-tklgg" podUID="03d40773-d217-49df-8b67-15af7ee4506d" containerName="console" containerID="cri-o://5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782" gracePeriod=15
Sep 17 00:40:17.476818 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.476787    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:40:17.565070 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.564985    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-serving-cert\") pod \"03d40773-d217-49df-8b67-15af7ee4506d\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") "
Sep 17 00:40:17.565070 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.565027    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-trusted-ca-bundle\") pod \"03d40773-d217-49df-8b67-15af7ee4506d\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") "
Sep 17 00:40:17.565070 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.565048    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-oauth-config\") pod \"03d40773-d217-49df-8b67-15af7ee4506d\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") "
Sep 17 00:40:17.565327 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.565102    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-oauth-serving-cert\") pod \"03d40773-d217-49df-8b67-15af7ee4506d\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") "
Sep 17 00:40:17.565327 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.565142    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9t6r\" (UniqueName: \"kubernetes.io/projected/03d40773-d217-49df-8b67-15af7ee4506d-kube-api-access-f9t6r\") pod \"03d40773-d217-49df-8b67-15af7ee4506d\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") "
Sep 17 00:40:17.565327 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.565166    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-console-config\") pod \"03d40773-d217-49df-8b67-15af7ee4506d\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") "
Sep 17 00:40:17.565327 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.565197    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-service-ca\") pod \"03d40773-d217-49df-8b67-15af7ee4506d\" (UID: \"03d40773-d217-49df-8b67-15af7ee4506d\") "
Sep 17 00:40:17.565580 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.565488    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03d40773-d217-49df-8b67-15af7ee4506d" (UID: "03d40773-d217-49df-8b67-15af7ee4506d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:40:17.565701 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.565620    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-service-ca" (OuterVolumeSpecName: "service-ca") pod "03d40773-d217-49df-8b67-15af7ee4506d" (UID: "03d40773-d217-49df-8b67-15af7ee4506d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:40:17.565701 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.565689    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-console-config" (OuterVolumeSpecName: "console-config") pod "03d40773-d217-49df-8b67-15af7ee4506d" (UID: "03d40773-d217-49df-8b67-15af7ee4506d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:40:17.566001 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.565729    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03d40773-d217-49df-8b67-15af7ee4506d" (UID: "03d40773-d217-49df-8b67-15af7ee4506d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:40:17.567331 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.567312    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03d40773-d217-49df-8b67-15af7ee4506d" (UID: "03d40773-d217-49df-8b67-15af7ee4506d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:40:17.567829 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.567801    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03d40773-d217-49df-8b67-15af7ee4506d" (UID: "03d40773-d217-49df-8b67-15af7ee4506d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:40:17.567914 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.567825    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d40773-d217-49df-8b67-15af7ee4506d-kube-api-access-f9t6r" (OuterVolumeSpecName: "kube-api-access-f9t6r") pod "03d40773-d217-49df-8b67-15af7ee4506d" (UID: "03d40773-d217-49df-8b67-15af7ee4506d"). InnerVolumeSpecName "kube-api-access-f9t6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:40:17.666082 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.666043    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-service-ca\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:17.666082 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.666077    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-serving-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:17.666082 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.666087    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-trusted-ca-bundle\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:17.666258 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.666097    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03d40773-d217-49df-8b67-15af7ee4506d-console-oauth-config\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:17.666258 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.666106    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-oauth-serving-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:17.666258 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.666114    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9t6r\" (UniqueName: \"kubernetes.io/projected/03d40773-d217-49df-8b67-15af7ee4506d-kube-api-access-f9t6r\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:17.666258 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:17.666122    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03d40773-d217-49df-8b67-15af7ee4506d-console-config\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:18.250942 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:18.250915    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-596c59f645-gxlg5"
Sep 17 00:40:18.293921 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:18.293889    2576 generic.go:356] "Generic (PLEG): container finished" podID="03d40773-d217-49df-8b67-15af7ee4506d" containerID="5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782" exitCode=0
Sep 17 00:40:18.294110 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:18.293923    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8bffd6cc5-tklgg" event={"ID":"03d40773-d217-49df-8b67-15af7ee4506d","Type":"ContainerDied","Data":"5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782"}
Sep 17 00:40:18.294110 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:18.294008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8bffd6cc5-tklgg" event={"ID":"03d40773-d217-49df-8b67-15af7ee4506d","Type":"ContainerDied","Data":"cb13bf948509f190e80e5112c39c43ec4bd849f6b9144779fc25338a3313781f"}
Sep 17 00:40:18.294110 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:18.293937    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8bffd6cc5-tklgg"
Sep 17 00:40:18.294110 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:18.294039    2576 scope.go:117] "RemoveContainer" containerID="5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782"
Sep 17 00:40:18.302969 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:18.302935    2576 scope.go:117] "RemoveContainer" containerID="5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782"
Sep 17 00:40:18.303284 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:40:18.303254    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782\": container with ID starting with 5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782 not found: ID does not exist" containerID="5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782"
Sep 17 00:40:18.303376 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:18.303295    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782"} err="failed to get container status \"5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782\": rpc error: code = NotFound desc = could not find container \"5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782\": container with ID starting with 5a9be470c1c326951140a9139d0f93b7e126ca1edb3ad130405f04a3c7a5c782 not found: ID does not exist"
Sep 17 00:40:18.315871 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:18.315839    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8bffd6cc5-tklgg"]
Sep 17 00:40:18.319482 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:18.319459    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8bffd6cc5-tklgg"]
Sep 17 00:40:20.142064 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.142017    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03d40773-d217-49df-8b67-15af7ee4506d" path="/var/lib/kubelet/pods/03d40773-d217-49df-8b67-15af7ee4506d/volumes"
Sep 17 00:40:20.588431 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.588399    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67475995c-8zxcm"]
Sep 17 00:40:20.588638 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.588626    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995aba86-b5ab-4d29-8855-a0b1f806f9ea" containerName="util"
Sep 17 00:40:20.588681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.588641    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="995aba86-b5ab-4d29-8855-a0b1f806f9ea" containerName="util"
Sep 17 00:40:20.588681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.588655    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995aba86-b5ab-4d29-8855-a0b1f806f9ea" containerName="pull"
Sep 17 00:40:20.588681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.588660    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="995aba86-b5ab-4d29-8855-a0b1f806f9ea" containerName="pull"
Sep 17 00:40:20.588681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.588668    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d40773-d217-49df-8b67-15af7ee4506d" containerName="console"
Sep 17 00:40:20.588681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.588674    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d40773-d217-49df-8b67-15af7ee4506d" containerName="console"
Sep 17 00:40:20.588837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.588686    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995aba86-b5ab-4d29-8855-a0b1f806f9ea" containerName="extract"
Sep 17 00:40:20.588837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.588691    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="995aba86-b5ab-4d29-8855-a0b1f806f9ea" containerName="extract"
Sep 17 00:40:20.588837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.588737    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="03d40773-d217-49df-8b67-15af7ee4506d" containerName="console"
Sep 17 00:40:20.588837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.588746    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="995aba86-b5ab-4d29-8855-a0b1f806f9ea" containerName="extract"
Sep 17 00:40:20.593021 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.593003    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm"
Sep 17 00:40:20.595208 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.595187    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 17 00:40:20.595306 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.595238    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 00:40:20.596139 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.596122    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 17 00:40:20.596212 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.596124    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 00:40:20.596267 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.596146    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-p4g7r\""
Sep 17 00:40:20.602594 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.602574    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67475995c-8zxcm"]
Sep 17 00:40:20.690816 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.690787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckds\" (UniqueName: \"kubernetes.io/projected/3383b705-fc43-4b86-9c77-725bcac9b006-kube-api-access-9ckds\") pod \"kube-auth-proxy-67475995c-8zxcm\" (UID: \"3383b705-fc43-4b86-9c77-725bcac9b006\") " pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm"
Sep 17 00:40:20.690816 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.690819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3383b705-fc43-4b86-9c77-725bcac9b006-tls-certs\") pod \"kube-auth-proxy-67475995c-8zxcm\" (UID: \"3383b705-fc43-4b86-9c77-725bcac9b006\") " pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm"
Sep 17 00:40:20.691049 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.690844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3383b705-fc43-4b86-9c77-725bcac9b006-tmp\") pod \"kube-auth-proxy-67475995c-8zxcm\" (UID: \"3383b705-fc43-4b86-9c77-725bcac9b006\") " pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm"
Sep 17 00:40:20.791926 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.791899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckds\" (UniqueName: \"kubernetes.io/projected/3383b705-fc43-4b86-9c77-725bcac9b006-kube-api-access-9ckds\") pod \"kube-auth-proxy-67475995c-8zxcm\" (UID: \"3383b705-fc43-4b86-9c77-725bcac9b006\") " pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm"
Sep 17 00:40:20.792098 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.791931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3383b705-fc43-4b86-9c77-725bcac9b006-tls-certs\") pod \"kube-auth-proxy-67475995c-8zxcm\" (UID: \"3383b705-fc43-4b86-9c77-725bcac9b006\") " pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm"
Sep 17 00:40:20.792098 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.791953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3383b705-fc43-4b86-9c77-725bcac9b006-tmp\") pod \"kube-auth-proxy-67475995c-8zxcm\" (UID: \"3383b705-fc43-4b86-9c77-725bcac9b006\") " pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm"
Sep 17 00:40:20.794414 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.794384    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3383b705-fc43-4b86-9c77-725bcac9b006-tmp\") pod \"kube-auth-proxy-67475995c-8zxcm\" (UID: \"3383b705-fc43-4b86-9c77-725bcac9b006\") " pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm"
Sep 17 00:40:20.794576 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.794554    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3383b705-fc43-4b86-9c77-725bcac9b006-tls-certs\") pod \"kube-auth-proxy-67475995c-8zxcm\" (UID: \"3383b705-fc43-4b86-9c77-725bcac9b006\") " pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm"
Sep 17 00:40:20.800122 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.800102    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckds\" (UniqueName: \"kubernetes.io/projected/3383b705-fc43-4b86-9c77-725bcac9b006-kube-api-access-9ckds\") pod \"kube-auth-proxy-67475995c-8zxcm\" (UID: \"3383b705-fc43-4b86-9c77-725bcac9b006\") " pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm"
Sep 17 00:40:20.903187 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:20.903161    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm"
Sep 17 00:40:21.173246 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.173225    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67475995c-8zxcm"]
Sep 17 00:40:21.175546 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:40:21.175520    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3383b705_fc43_4b86_9c77_725bcac9b006.slice/crio-c5b8e484126f290ee14b7825fe6a8144301ea5b603fd774a1c4f7af27f1ce873 WatchSource:0}: Error finding container c5b8e484126f290ee14b7825fe6a8144301ea5b603fd774a1c4f7af27f1ce873: Status 404 returned error can't find the container with id c5b8e484126f290ee14b7825fe6a8144301ea5b603fd774a1c4f7af27f1ce873
Sep 17 00:40:21.310755 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.310730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm" event={"ID":"3383b705-fc43-4b86-9c77-725bcac9b006","Type":"ContainerStarted","Data":"c5b8e484126f290ee14b7825fe6a8144301ea5b603fd774a1c4f7af27f1ce873"}
Sep 17 00:40:21.795089 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.795061    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"]
Sep 17 00:40:21.799388 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.799370    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:21.801557 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.801535    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 00:40:21.801679 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.801565    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 00:40:21.801679 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.801661    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w7n8h\""
Sep 17 00:40:21.801679 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.801670    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 00:40:21.801827 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.801679    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 00:40:21.808575 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.808552    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"]
Sep 17 00:40:21.901226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.901197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:21.901352 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.901233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:21.901352 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.901260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:21.901352 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.901302    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:21.901352 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.901324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:21.901352 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.901341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh5dz\" (UniqueName: \"kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-kube-api-access-dh5dz\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:21.901528 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:21.901396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.002661 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.002630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.002822 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.002668    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.002822 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.002696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.002822 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.002736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.002822 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.002778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.002822 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.002806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.003199 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.002830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh5dz\" (UniqueName: \"kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-kube-api-access-dh5dz\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.003688 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.003643    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.005902 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.005860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.006036 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.005943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.006036 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.005946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.006161 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.006051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.010698 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.010454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh5dz\" (UniqueName: \"kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-kube-api-access-dh5dz\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.010818 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.010776    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-92mwc\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.109043 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.108945    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:22.394903 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:22.394830    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"]
Sep 17 00:40:22.397804 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:40:22.397770    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b9fb19_b312_4e35_a8d7_c206ac5b8ef4.slice/crio-11d65e2bb002c8a2b91ce4753193eac0f8762435257eec15e9195f63c0521f9f WatchSource:0}: Error finding container 11d65e2bb002c8a2b91ce4753193eac0f8762435257eec15e9195f63c0521f9f: Status 404 returned error can't find the container with id 11d65e2bb002c8a2b91ce4753193eac0f8762435257eec15e9195f63c0521f9f
Sep 17 00:40:23.323401 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:23.323364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc" event={"ID":"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4","Type":"ContainerStarted","Data":"11d65e2bb002c8a2b91ce4753193eac0f8762435257eec15e9195f63c0521f9f"}
Sep 17 00:40:24.331092 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:24.331018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm" event={"ID":"3383b705-fc43-4b86-9c77-725bcac9b006","Type":"ContainerStarted","Data":"ebcb44d0782e82796102c9ffd9c36a112c5dc52aedcd371578172e084d2173b3"}
Sep 17 00:40:24.345357 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:24.345203    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67475995c-8zxcm" podStartSLOduration=1.392877229 podStartE2EDuration="4.345183927s" totalImagesPullingTime="2.952306698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:40:24.344890788 +0000 UTC m=+616.772348712" watchObservedRunningTime="2026-09-17 00:40:24.345183927 +0000 UTC m=+616.772641851"
Sep 17 00:40:25.987007 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:25.986953    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:40:25.987269 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:25.987043    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:40:26.341455 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:26.341368    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc" event={"ID":"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4","Type":"ContainerStarted","Data":"fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599"}
Sep 17 00:40:26.341607 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:26.341491    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:26.360650 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:26.360605    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc" podStartSLOduration=1.774755192 podStartE2EDuration="5.360591289s" totalImagesPullingTime="3.585836097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:40:26.35971196 +0000 UTC m=+618.787169884" watchObservedRunningTime="2026-09-17 00:40:26.360591289 +0000 UTC m=+618.788049210"
Sep 17 00:40:27.347565 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.347538    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-92mwc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 00:40:27.347910 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.347589    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc" podUID="95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:40:27.366058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.366033    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"]
Sep 17 00:40:27.369220 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.369203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.371160 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.371142    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qb7rb\""
Sep 17 00:40:27.379622 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.379590    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"]
Sep 17 00:40:27.451911 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.451879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.452127 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.451923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.452127 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.451942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.452127 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.451984    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.452127 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.452114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.452348 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.452157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.452348 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.452200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52w7w\" (UniqueName: \"kubernetes.io/projected/5a2ed0ab-dcc7-4537-9691-ed13d161497e-kube-api-access-52w7w\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.452348 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.452251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.452348 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.452276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.552991 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.552943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.553112 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.552999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.553112 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.553026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52w7w\" (UniqueName: \"kubernetes.io/projected/5a2ed0ab-dcc7-4537-9691-ed13d161497e-kube-api-access-52w7w\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.553112 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.553067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.553112 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.553089    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.553315 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.553141    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.553315 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.553172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.553315 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.553197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.553315 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.553230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.553507 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.553439    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.553628 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.553604    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.553679 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.553617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.558487 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.554069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.558487 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.554203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.558909 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.558888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.559297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.559275    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.561515 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.561494    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a2ed0ab-dcc7-4537-9691-ed13d161497e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.561732 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.561715    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52w7w\" (UniqueName: \"kubernetes.io/projected/5a2ed0ab-dcc7-4537-9691-ed13d161497e-kube-api-access-52w7w\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t\" (UID: \"5a2ed0ab-dcc7-4537-9691-ed13d161497e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.680434 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.680405    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:27.953271 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:27.953249    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"]
Sep 17 00:40:27.955246 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:40:27.955220    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2ed0ab_dcc7_4537_9691_ed13d161497e.slice/crio-6984fc12c8d77570d1647919c7c86a8efa7ad94b826bf8b912251878b348d665 WatchSource:0}: Error finding container 6984fc12c8d77570d1647919c7c86a8efa7ad94b826bf8b912251878b348d665: Status 404 returned error can't find the container with id 6984fc12c8d77570d1647919c7c86a8efa7ad94b826bf8b912251878b348d665
Sep 17 00:40:28.351488 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:28.351408    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t" event={"ID":"5a2ed0ab-dcc7-4537-9691-ed13d161497e","Type":"ContainerStarted","Data":"6984fc12c8d77570d1647919c7c86a8efa7ad94b826bf8b912251878b348d665"}
Sep 17 00:40:30.347025 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:30.346931    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:33.029872 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:33.029833    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:40:33.030167 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:33.029908    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:40:33.030167 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:33.029934    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:40:33.374829 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:33.374738    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t" event={"ID":"5a2ed0ab-dcc7-4537-9691-ed13d161497e","Type":"ContainerStarted","Data":"1c3feaac7b1073fcc7d23ca20c9b052158fcf8111002e65a731caf4e33b3c855"}
Sep 17 00:40:33.393835 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:33.393781    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t" podStartSLOduration=1.321423861 podStartE2EDuration="6.393764911s" totalImagesPullingTime="5.07234105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:40:33.391782131 +0000 UTC m=+625.819240053" watchObservedRunningTime="2026-09-17 00:40:33.393764911 +0000 UTC m=+625.821222833"
Sep 17 00:40:33.681045 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:33.681013    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:34.686447 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:34.686414    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:35.384604 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:35.384574    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:35.385536 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:35.385510    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t"
Sep 17 00:40:38.152908 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.152870    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"]
Sep 17 00:40:38.163345 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.163318    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.165978 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.165930    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"]
Sep 17 00:40:38.243610 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.243566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31671c0-3821-45d8-99dd-e7c68acad3b7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.243610 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.243612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a31671c0-3821-45d8-99dd-e7c68acad3b7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.243852 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.243643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.243852 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.243705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dnzn\" (UniqueName: \"kubernetes.io/projected/a31671c0-3821-45d8-99dd-e7c68acad3b7-kube-api-access-9dnzn\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.243852 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.243753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.243852 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.243799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.244092 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.243925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.345065 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.345020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31671c0-3821-45d8-99dd-e7c68acad3b7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.345065 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.345072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a31671c0-3821-45d8-99dd-e7c68acad3b7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.345288 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.345182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.345288 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.345216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dnzn\" (UniqueName: \"kubernetes.io/projected/a31671c0-3821-45d8-99dd-e7c68acad3b7-kube-api-access-9dnzn\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.345401 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.345345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.345457 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.345402    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.345614 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.345584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.345908 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.345877    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.347533 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.347506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31671c0-3821-45d8-99dd-e7c68acad3b7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.347652 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.347600    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a31671c0-3821-45d8-99dd-e7c68acad3b7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.347717 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.347691    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.348028 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.348011    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.352414 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.352389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31671c0-3821-45d8-99dd-e7c68acad3b7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.352664 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.352648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dnzn\" (UniqueName: \"kubernetes.io/projected/a31671c0-3821-45d8-99dd-e7c68acad3b7-kube-api-access-9dnzn\") pod \"istiod-openshift-gateway-5677ccb49b-72v28\" (UID: \"a31671c0-3821-45d8-99dd-e7c68acad3b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.473178 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.473093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:38.759025 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.759003    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"]
Sep 17 00:40:38.761083 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:40:38.761055    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31671c0_3821_45d8_99dd_e7c68acad3b7.slice/crio-edcc244e28c009f97a9f32336c082f0ef943d4d2d067d49b9c1c61cc0ba63fae WatchSource:0}: Error finding container edcc244e28c009f97a9f32336c082f0ef943d4d2d067d49b9c1c61cc0ba63fae: Status 404 returned error can't find the container with id edcc244e28c009f97a9f32336c082f0ef943d4d2d067d49b9c1c61cc0ba63fae
Sep 17 00:40:38.763785 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.763752    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:40:38.763853 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:38.763817    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:40:39.407131 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:39.407100    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28" event={"ID":"a31671c0-3821-45d8-99dd-e7c68acad3b7","Type":"ContainerStarted","Data":"31a01c7f7aca15e06cb404a9f1c49c81948d26235246785592e00a1735214806"}
Sep 17 00:40:39.407499 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:39.407144    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28" event={"ID":"a31671c0-3821-45d8-99dd-e7c68acad3b7","Type":"ContainerStarted","Data":"edcc244e28c009f97a9f32336c082f0ef943d4d2d067d49b9c1c61cc0ba63fae"}
Sep 17 00:40:39.407499 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:39.407305    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:39.409105 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:39.409082    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-72v28 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 00:40:39.409218 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:39.409124    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28" podUID="a31671c0-3821-45d8-99dd-e7c68acad3b7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:40:39.431008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:39.430944    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28" podStartSLOduration=1.4309304520000001 podStartE2EDuration="1.430930452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:40:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:40:39.428894135 +0000 UTC m=+631.856352059" watchObservedRunningTime="2026-09-17 00:40:39.430930452 +0000 UTC m=+631.858388375"
Sep 17 00:40:40.411899 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.411869    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-72v28"
Sep 17 00:40:40.474703 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.474667    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"]
Sep 17 00:40:40.474887 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.474851    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc" podUID="95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" containerName="discovery" containerID="cri-o://fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599" gracePeriod=30
Sep 17 00:40:40.724409 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.724386    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:40.866503 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.866475    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-token\") pod \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") "
Sep 17 00:40:40.866503 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.866511    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-ca-configmap\") pod \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") "
Sep 17 00:40:40.866696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.866541    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-local-certs\") pod \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") "
Sep 17 00:40:40.866696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.866572    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-kubeconfig\") pod \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") "
Sep 17 00:40:40.866794 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.866706    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh5dz\" (UniqueName: \"kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-kube-api-access-dh5dz\") pod \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") "
Sep 17 00:40:40.866794 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.866751    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-dns-cert\") pod \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") "
Sep 17 00:40:40.866899 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.866812    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-cacerts\") pod \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\" (UID: \"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4\") "
Sep 17 00:40:40.867114 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.867085    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" (UID: "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:40:40.869196 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.869170    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-token" (OuterVolumeSpecName: "istio-token") pod "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" (UID: "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:40:40.869328 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.869300    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-local-certs" (OuterVolumeSpecName: "local-certs") pod "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" (UID: "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:40.869419 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.869388    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" (UID: "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:40:40.869582 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.869540    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" (UID: "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:40:40.869663 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.869619    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-cacerts" (OuterVolumeSpecName: "cacerts") pod "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" (UID: "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:40:40.869663 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.869629    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-kube-api-access-dh5dz" (OuterVolumeSpecName: "kube-api-access-dh5dz") pod "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" (UID: "95b9fb19-b312-4e35-a8d7-c206ac5b8ef4"). InnerVolumeSpecName "kube-api-access-dh5dz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:40:40.968230 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.968138    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-local-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:40.968230 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.968164    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-kubeconfig\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:40.968230 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.968179    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh5dz\" (UniqueName: \"kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-kube-api-access-dh5dz\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:40.968230 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.968193    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-dns-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:40.968230 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.968205    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-cacerts\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:40.968522 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.968217    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-token\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:40.968522 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:40.968252    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4-istio-csr-ca-configmap\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:40:41.416681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:41.416644    2576 generic.go:356] "Generic (PLEG): container finished" podID="95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" containerID="fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599" exitCode=0
Sep 17 00:40:41.417075 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:41.416712    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"
Sep 17 00:40:41.417075 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:41.416741    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc" event={"ID":"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4","Type":"ContainerDied","Data":"fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599"}
Sep 17 00:40:41.417075 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:41.416822    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc" event={"ID":"95b9fb19-b312-4e35-a8d7-c206ac5b8ef4","Type":"ContainerDied","Data":"11d65e2bb002c8a2b91ce4753193eac0f8762435257eec15e9195f63c0521f9f"}
Sep 17 00:40:41.417075 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:41.416849    2576 scope.go:117] "RemoveContainer" containerID="fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599"
Sep 17 00:40:41.427180 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:41.427163    2576 scope.go:117] "RemoveContainer" containerID="fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599"
Sep 17 00:40:41.427439 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:40:41.427423    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599\": container with ID starting with fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599 not found: ID does not exist" containerID="fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599"
Sep 17 00:40:41.427485 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:41.427448    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599"} err="failed to get container status \"fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599\": rpc error: code = NotFound desc = could not find container \"fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599\": container with ID starting with fe31fac64b3d4ef3eef973804cb4bbedf9e0ff21b703e4a1823c67f825e53599 not found: ID does not exist"
Sep 17 00:40:41.454802 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:41.454780    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"]
Sep 17 00:40:41.460850 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:41.460825    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92mwc"]
Sep 17 00:40:42.140284 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:40:42.140254    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" path="/var/lib/kubelet/pods/95b9fb19-b312-4e35-a8d7-c206ac5b8ef4/volumes"
Sep 17 00:41:35.703106 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.703067    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"]
Sep 17 00:41:35.703512 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.703322    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" containerName="discovery"
Sep 17 00:41:35.703512 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.703333    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" containerName="discovery"
Sep 17 00:41:35.703512 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.703383    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="95b9fb19-b312-4e35-a8d7-c206ac5b8ef4" containerName="discovery"
Sep 17 00:41:35.706183 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.706167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:35.708591 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.708571    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 00:41:35.708724 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.708634    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 00:41:35.709472 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.709459    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-22bqm\""
Sep 17 00:41:35.714026 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.714007    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"]
Sep 17 00:41:35.801728 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.801693    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"]
Sep 17 00:41:35.805016 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.804995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:35.812206 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.812182    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"]
Sep 17 00:41:35.818273 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.818250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:35.818378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.818302    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxw22\" (UniqueName: \"kubernetes.io/projected/62da11cc-7183-48e7-8a60-ee96bdef83ba-kube-api-access-zxw22\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:35.818450 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.818405    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:35.900920 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.900878    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"]
Sep 17 00:41:35.905821 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.905795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:35.909517 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.909491    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"]
Sep 17 00:41:35.918921 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.918896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:35.919100 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.918943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:35.919100 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.919003    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:35.919100 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.919054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:35.919100 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.919080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfhlc\" (UniqueName: \"kubernetes.io/projected/051fb6e9-e737-4563-b36b-3bb2c7b017f3-kube-api-access-sfhlc\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:35.919281 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.919133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxw22\" (UniqueName: \"kubernetes.io/projected/62da11cc-7183-48e7-8a60-ee96bdef83ba-kube-api-access-zxw22\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:35.919771 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.919751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:35.919856 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.919755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:35.930290 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:35.930267    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxw22\" (UniqueName: \"kubernetes.io/projected/62da11cc-7183-48e7-8a60-ee96bdef83ba-kube-api-access-zxw22\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:36.002297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.002229    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"]
Sep 17 00:41:36.006087 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.006070    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:36.014832 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.014806    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"]
Sep 17 00:41:36.016034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.016012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:36.019988 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.019950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:36.020104 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.020047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d56bg\" (UniqueName: \"kubernetes.io/projected/cddf1736-3259-43e1-b8b3-78bcd3a7573d-kube-api-access-d56bg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:36.020104 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.020096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:36.020217 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.020142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:36.020276 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.020236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:36.020276 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.020264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfhlc\" (UniqueName: \"kubernetes.io/projected/051fb6e9-e737-4563-b36b-3bb2c7b017f3-kube-api-access-sfhlc\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:36.020522 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.020504    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:36.020589 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.020505    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:36.028593 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.028568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfhlc\" (UniqueName: \"kubernetes.io/projected/051fb6e9-e737-4563-b36b-3bb2c7b017f3-kube-api-access-sfhlc\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:36.114400 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.114362    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:36.120923 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.120901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:36.121005 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.120976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:36.121005 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.120996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:36.121096 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.121018    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lvkk\" (UniqueName: \"kubernetes.io/projected/65c63d95-a1c9-4987-84f0-62224cbd7196-kube-api-access-2lvkk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:36.121096 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.121041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d56bg\" (UniqueName: \"kubernetes.io/projected/cddf1736-3259-43e1-b8b3-78bcd3a7573d-kube-api-access-d56bg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:36.121096 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.121075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:36.121346 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.121316    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:36.121425 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.121383    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:36.128763 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.128744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d56bg\" (UniqueName: \"kubernetes.io/projected/cddf1736-3259-43e1-b8b3-78bcd3a7573d-kube-api-access-d56bg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:36.215542 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.215508    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:36.226043 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.226018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:36.226193 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.226101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:36.226193 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.226154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lvkk\" (UniqueName: \"kubernetes.io/projected/65c63d95-a1c9-4987-84f0-62224cbd7196-kube-api-access-2lvkk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:36.226435 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.226411    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:36.226675 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.226648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:36.236673 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.236644    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lvkk\" (UniqueName: \"kubernetes.io/projected/65c63d95-a1c9-4987-84f0-62224cbd7196-kube-api-access-2lvkk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:36.290938 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.290899    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"]
Sep 17 00:41:36.293637 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:41:36.293603    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62da11cc_7183_48e7_8a60_ee96bdef83ba.slice/crio-5af4fd1bdb8efde1a234b6ab8fc715683bb6df329ed1ff42c9fb5946ef28c241 WatchSource:0}: Error finding container 5af4fd1bdb8efde1a234b6ab8fc715683bb6df329ed1ff42c9fb5946ef28c241: Status 404 returned error can't find the container with id 5af4fd1bdb8efde1a234b6ab8fc715683bb6df329ed1ff42c9fb5946ef28c241
Sep 17 00:41:36.316067 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.316044    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:36.390560 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.390530    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"]
Sep 17 00:41:36.427817 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:41:36.427781    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051fb6e9_e737_4563_b36b_3bb2c7b017f3.slice/crio-b77abde47786fd756853bb53866a1cdc65d6065aa4cf60199e6169a44be920f3 WatchSource:0}: Error finding container b77abde47786fd756853bb53866a1cdc65d6065aa4cf60199e6169a44be920f3: Status 404 returned error can't find the container with id b77abde47786fd756853bb53866a1cdc65d6065aa4cf60199e6169a44be920f3
Sep 17 00:41:36.490268 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.490248    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"]
Sep 17 00:41:36.492231 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:41:36.492205    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcddf1736_3259_43e1_b8b3_78bcd3a7573d.slice/crio-82dfeb58ea52c3047ebb082470b8aaf8652c8c422ea02ae3736c22cbbc43f076 WatchSource:0}: Error finding container 82dfeb58ea52c3047ebb082470b8aaf8652c8c422ea02ae3736c22cbbc43f076: Status 404 returned error can't find the container with id 82dfeb58ea52c3047ebb082470b8aaf8652c8c422ea02ae3736c22cbbc43f076
Sep 17 00:41:36.587329 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.587301    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"]
Sep 17 00:41:36.588720 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:41:36.588693    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c63d95_a1c9_4987_84f0_62224cbd7196.slice/crio-4333a6e560a96a6a3374e158c6ba116325f1c076b8225da35395726d48f160b4 WatchSource:0}: Error finding container 4333a6e560a96a6a3374e158c6ba116325f1c076b8225da35395726d48f160b4: Status 404 returned error can't find the container with id 4333a6e560a96a6a3374e158c6ba116325f1c076b8225da35395726d48f160b4
Sep 17 00:41:36.661473 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.661447    2576 generic.go:356] "Generic (PLEG): container finished" podID="051fb6e9-e737-4563-b36b-3bb2c7b017f3" containerID="c0ced70fb53962fc8905848bf0cffc4d5b5378a46f1c65246d7a0ec67eb24e98" exitCode=0
Sep 17 00:41:36.661581 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.661550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q" event={"ID":"051fb6e9-e737-4563-b36b-3bb2c7b017f3","Type":"ContainerDied","Data":"c0ced70fb53962fc8905848bf0cffc4d5b5378a46f1c65246d7a0ec67eb24e98"}
Sep 17 00:41:36.661647 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.661598    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q" event={"ID":"051fb6e9-e737-4563-b36b-3bb2c7b017f3","Type":"ContainerStarted","Data":"b77abde47786fd756853bb53866a1cdc65d6065aa4cf60199e6169a44be920f3"}
Sep 17 00:41:36.663293 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.663266    2576 generic.go:356] "Generic (PLEG): container finished" podID="62da11cc-7183-48e7-8a60-ee96bdef83ba" containerID="fe68c9661370c8c0da8a76913741a901b56adbf152b1f695b270bf0d6104dcad" exitCode=0
Sep 17 00:41:36.663425 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.663298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95" event={"ID":"62da11cc-7183-48e7-8a60-ee96bdef83ba","Type":"ContainerDied","Data":"fe68c9661370c8c0da8a76913741a901b56adbf152b1f695b270bf0d6104dcad"}
Sep 17 00:41:36.663425 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.663337    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95" event={"ID":"62da11cc-7183-48e7-8a60-ee96bdef83ba","Type":"ContainerStarted","Data":"5af4fd1bdb8efde1a234b6ab8fc715683bb6df329ed1ff42c9fb5946ef28c241"}
Sep 17 00:41:36.665196 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.665177    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw" event={"ID":"65c63d95-a1c9-4987-84f0-62224cbd7196","Type":"ContainerStarted","Data":"ecf2ca4ca0c9a26e85f781f3287b500ce7c65ed4498f3d048b5473d7797a19b4"}
Sep 17 00:41:36.665279 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.665217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw" event={"ID":"65c63d95-a1c9-4987-84f0-62224cbd7196","Type":"ContainerStarted","Data":"4333a6e560a96a6a3374e158c6ba116325f1c076b8225da35395726d48f160b4"}
Sep 17 00:41:36.666994 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.666950    2576 generic.go:356] "Generic (PLEG): container finished" podID="cddf1736-3259-43e1-b8b3-78bcd3a7573d" containerID="ec106cff44032ca48303942b2f60c438502e80e1a4275a7e90850f8760514788" exitCode=0
Sep 17 00:41:36.667110 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.667045    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v" event={"ID":"cddf1736-3259-43e1-b8b3-78bcd3a7573d","Type":"ContainerDied","Data":"ec106cff44032ca48303942b2f60c438502e80e1a4275a7e90850f8760514788"}
Sep 17 00:41:36.667110 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:36.667086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v" event={"ID":"cddf1736-3259-43e1-b8b3-78bcd3a7573d","Type":"ContainerStarted","Data":"82dfeb58ea52c3047ebb082470b8aaf8652c8c422ea02ae3736c22cbbc43f076"}
Sep 17 00:41:37.673693 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:37.673657    2576 generic.go:356] "Generic (PLEG): container finished" podID="051fb6e9-e737-4563-b36b-3bb2c7b017f3" containerID="bf112188e0c3fb6e6b4a9e220dd5118ace71e7836c5997ba14fd462921add0ce" exitCode=0
Sep 17 00:41:37.674058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:37.673736    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q" event={"ID":"051fb6e9-e737-4563-b36b-3bb2c7b017f3","Type":"ContainerDied","Data":"bf112188e0c3fb6e6b4a9e220dd5118ace71e7836c5997ba14fd462921add0ce"}
Sep 17 00:41:37.675680 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:37.675658    2576 generic.go:356] "Generic (PLEG): container finished" podID="62da11cc-7183-48e7-8a60-ee96bdef83ba" containerID="e595461d0c7bacdbcbe604ee6d9190735dce3ad1fda0347fbee6b419e535941f" exitCode=0
Sep 17 00:41:37.675774 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:37.675730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95" event={"ID":"62da11cc-7183-48e7-8a60-ee96bdef83ba","Type":"ContainerDied","Data":"e595461d0c7bacdbcbe604ee6d9190735dce3ad1fda0347fbee6b419e535941f"}
Sep 17 00:41:37.677235 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:37.677212    2576 generic.go:356] "Generic (PLEG): container finished" podID="65c63d95-a1c9-4987-84f0-62224cbd7196" containerID="ecf2ca4ca0c9a26e85f781f3287b500ce7c65ed4498f3d048b5473d7797a19b4" exitCode=0
Sep 17 00:41:37.677344 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:37.677256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw" event={"ID":"65c63d95-a1c9-4987-84f0-62224cbd7196","Type":"ContainerDied","Data":"ecf2ca4ca0c9a26e85f781f3287b500ce7c65ed4498f3d048b5473d7797a19b4"}
Sep 17 00:41:38.685175 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:38.685140    2576 generic.go:356] "Generic (PLEG): container finished" podID="62da11cc-7183-48e7-8a60-ee96bdef83ba" containerID="e692b96fe89fdeccb4c9137824b9e56bef279a3653ab93e0165c08dec0ee39f3" exitCode=0
Sep 17 00:41:38.685641 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:38.685238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95" event={"ID":"62da11cc-7183-48e7-8a60-ee96bdef83ba","Type":"ContainerDied","Data":"e692b96fe89fdeccb4c9137824b9e56bef279a3653ab93e0165c08dec0ee39f3"}
Sep 17 00:41:38.686919 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:38.686895    2576 generic.go:356] "Generic (PLEG): container finished" podID="cddf1736-3259-43e1-b8b3-78bcd3a7573d" containerID="1496d6d372d6eff7646538bfcdb655b783fc029f966730b109a4f6cb39e46c75" exitCode=0
Sep 17 00:41:38.687041 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:38.686982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v" event={"ID":"cddf1736-3259-43e1-b8b3-78bcd3a7573d","Type":"ContainerDied","Data":"1496d6d372d6eff7646538bfcdb655b783fc029f966730b109a4f6cb39e46c75"}
Sep 17 00:41:38.689215 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:38.689195    2576 generic.go:356] "Generic (PLEG): container finished" podID="051fb6e9-e737-4563-b36b-3bb2c7b017f3" containerID="a5671db5901c755f9d7e02a44041b090d6a8274723a28f5bc77c5e6661415144" exitCode=0
Sep 17 00:41:38.689316 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:38.689223    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q" event={"ID":"051fb6e9-e737-4563-b36b-3bb2c7b017f3","Type":"ContainerDied","Data":"a5671db5901c755f9d7e02a44041b090d6a8274723a28f5bc77c5e6661415144"}
Sep 17 00:41:39.696588 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.696555    2576 generic.go:356] "Generic (PLEG): container finished" podID="65c63d95-a1c9-4987-84f0-62224cbd7196" containerID="847cee494e4fc07ca8c9fd9cf23c1e957cd9926ed25f66c75304c3155242de41" exitCode=0
Sep 17 00:41:39.697097 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.696643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw" event={"ID":"65c63d95-a1c9-4987-84f0-62224cbd7196","Type":"ContainerDied","Data":"847cee494e4fc07ca8c9fd9cf23c1e957cd9926ed25f66c75304c3155242de41"}
Sep 17 00:41:39.699274 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.699251    2576 generic.go:356] "Generic (PLEG): container finished" podID="cddf1736-3259-43e1-b8b3-78bcd3a7573d" containerID="3515ae33a90a282fe86238f69192a4e48a580c0e711aa9e48c0f1459d0d3c165" exitCode=0
Sep 17 00:41:39.699389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.699320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v" event={"ID":"cddf1736-3259-43e1-b8b3-78bcd3a7573d","Type":"ContainerDied","Data":"3515ae33a90a282fe86238f69192a4e48a580c0e711aa9e48c0f1459d0d3c165"}
Sep 17 00:41:39.849943 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.849920    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:39.853532 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.853510    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:39.959389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.959309    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxw22\" (UniqueName: \"kubernetes.io/projected/62da11cc-7183-48e7-8a60-ee96bdef83ba-kube-api-access-zxw22\") pod \"62da11cc-7183-48e7-8a60-ee96bdef83ba\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") "
Sep 17 00:41:39.959389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.959384    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-util\") pod \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") "
Sep 17 00:41:39.959613 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.959419    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfhlc\" (UniqueName: \"kubernetes.io/projected/051fb6e9-e737-4563-b36b-3bb2c7b017f3-kube-api-access-sfhlc\") pod \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") "
Sep 17 00:41:39.959613 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.959440    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-bundle\") pod \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\" (UID: \"051fb6e9-e737-4563-b36b-3bb2c7b017f3\") "
Sep 17 00:41:39.959613 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.959492    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-bundle\") pod \"62da11cc-7183-48e7-8a60-ee96bdef83ba\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") "
Sep 17 00:41:39.959613 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.959524    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-util\") pod \"62da11cc-7183-48e7-8a60-ee96bdef83ba\" (UID: \"62da11cc-7183-48e7-8a60-ee96bdef83ba\") "
Sep 17 00:41:39.960182 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.960153    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-bundle" (OuterVolumeSpecName: "bundle") pod "051fb6e9-e737-4563-b36b-3bb2c7b017f3" (UID: "051fb6e9-e737-4563-b36b-3bb2c7b017f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:39.960494 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.960467    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-bundle" (OuterVolumeSpecName: "bundle") pod "62da11cc-7183-48e7-8a60-ee96bdef83ba" (UID: "62da11cc-7183-48e7-8a60-ee96bdef83ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:39.961707 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.961683    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62da11cc-7183-48e7-8a60-ee96bdef83ba-kube-api-access-zxw22" (OuterVolumeSpecName: "kube-api-access-zxw22") pod "62da11cc-7183-48e7-8a60-ee96bdef83ba" (UID: "62da11cc-7183-48e7-8a60-ee96bdef83ba"). InnerVolumeSpecName "kube-api-access-zxw22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:41:39.961930 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.961911    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/051fb6e9-e737-4563-b36b-3bb2c7b017f3-kube-api-access-sfhlc" (OuterVolumeSpecName: "kube-api-access-sfhlc") pod "051fb6e9-e737-4563-b36b-3bb2c7b017f3" (UID: "051fb6e9-e737-4563-b36b-3bb2c7b017f3"). InnerVolumeSpecName "kube-api-access-sfhlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:41:39.965338 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.965302    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-util" (OuterVolumeSpecName: "util") pod "62da11cc-7183-48e7-8a60-ee96bdef83ba" (UID: "62da11cc-7183-48e7-8a60-ee96bdef83ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:39.965766 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:39.965744    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-util" (OuterVolumeSpecName: "util") pod "051fb6e9-e737-4563-b36b-3bb2c7b017f3" (UID: "051fb6e9-e737-4563-b36b-3bb2c7b017f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:40.060315 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.060283    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfhlc\" (UniqueName: \"kubernetes.io/projected/051fb6e9-e737-4563-b36b-3bb2c7b017f3-kube-api-access-sfhlc\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:40.060315 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.060312    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-bundle\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:40.060315 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.060323    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-bundle\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:40.060511 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.060331    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62da11cc-7183-48e7-8a60-ee96bdef83ba-util\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:40.060511 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.060339    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxw22\" (UniqueName: \"kubernetes.io/projected/62da11cc-7183-48e7-8a60-ee96bdef83ba-kube-api-access-zxw22\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:40.060511 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.060347    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/051fb6e9-e737-4563-b36b-3bb2c7b017f3-util\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:40.706716 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.706681    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95" event={"ID":"62da11cc-7183-48e7-8a60-ee96bdef83ba","Type":"ContainerDied","Data":"5af4fd1bdb8efde1a234b6ab8fc715683bb6df329ed1ff42c9fb5946ef28c241"}
Sep 17 00:41:40.707166 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.706740    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5af4fd1bdb8efde1a234b6ab8fc715683bb6df329ed1ff42c9fb5946ef28c241"
Sep 17 00:41:40.707166 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.706693    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847advq95"
Sep 17 00:41:40.708998 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.708972    2576 generic.go:356] "Generic (PLEG): container finished" podID="65c63d95-a1c9-4987-84f0-62224cbd7196" containerID="193bc9ecc1536610a8f733bc96ae4cac3a34c3e5a757b7907b547d72de564302" exitCode=0
Sep 17 00:41:40.709110 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.708989    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw" event={"ID":"65c63d95-a1c9-4987-84f0-62224cbd7196","Type":"ContainerDied","Data":"193bc9ecc1536610a8f733bc96ae4cac3a34c3e5a757b7907b547d72de564302"}
Sep 17 00:41:40.711083 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.711065    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q"
Sep 17 00:41:40.711206 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.711077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmvs7q" event={"ID":"051fb6e9-e737-4563-b36b-3bb2c7b017f3","Type":"ContainerDied","Data":"b77abde47786fd756853bb53866a1cdc65d6065aa4cf60199e6169a44be920f3"}
Sep 17 00:41:40.711206 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.711117    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b77abde47786fd756853bb53866a1cdc65d6065aa4cf60199e6169a44be920f3"
Sep 17 00:41:40.840192 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.840169    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:40.967556 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.967472    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d56bg\" (UniqueName: \"kubernetes.io/projected/cddf1736-3259-43e1-b8b3-78bcd3a7573d-kube-api-access-d56bg\") pod \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") "
Sep 17 00:41:40.967556 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.967514    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-util\") pod \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") "
Sep 17 00:41:40.967737 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.967652    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-bundle\") pod \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\" (UID: \"cddf1736-3259-43e1-b8b3-78bcd3a7573d\") "
Sep 17 00:41:40.968111 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.968081    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-bundle" (OuterVolumeSpecName: "bundle") pod "cddf1736-3259-43e1-b8b3-78bcd3a7573d" (UID: "cddf1736-3259-43e1-b8b3-78bcd3a7573d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:40.969655 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.969635    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cddf1736-3259-43e1-b8b3-78bcd3a7573d-kube-api-access-d56bg" (OuterVolumeSpecName: "kube-api-access-d56bg") pod "cddf1736-3259-43e1-b8b3-78bcd3a7573d" (UID: "cddf1736-3259-43e1-b8b3-78bcd3a7573d"). InnerVolumeSpecName "kube-api-access-d56bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:41:40.972906 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:40.972872    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-util" (OuterVolumeSpecName: "util") pod "cddf1736-3259-43e1-b8b3-78bcd3a7573d" (UID: "cddf1736-3259-43e1-b8b3-78bcd3a7573d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:41.068777 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.068748    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-bundle\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:41.068777 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.068772    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d56bg\" (UniqueName: \"kubernetes.io/projected/cddf1736-3259-43e1-b8b3-78bcd3a7573d-kube-api-access-d56bg\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:41.068777 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.068781    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cddf1736-3259-43e1-b8b3-78bcd3a7573d-util\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:41.717597 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.717566    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v"
Sep 17 00:41:41.717597 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.717576    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kn2v" event={"ID":"cddf1736-3259-43e1-b8b3-78bcd3a7573d","Type":"ContainerDied","Data":"82dfeb58ea52c3047ebb082470b8aaf8652c8c422ea02ae3736c22cbbc43f076"}
Sep 17 00:41:41.718045 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.717631    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82dfeb58ea52c3047ebb082470b8aaf8652c8c422ea02ae3736c22cbbc43f076"
Sep 17 00:41:41.838324 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.838299    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:41.976132 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.976044    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lvkk\" (UniqueName: \"kubernetes.io/projected/65c63d95-a1c9-4987-84f0-62224cbd7196-kube-api-access-2lvkk\") pod \"65c63d95-a1c9-4987-84f0-62224cbd7196\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") "
Sep 17 00:41:41.976132 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.976087    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-util\") pod \"65c63d95-a1c9-4987-84f0-62224cbd7196\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") "
Sep 17 00:41:41.976354 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.976135    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-bundle\") pod \"65c63d95-a1c9-4987-84f0-62224cbd7196\" (UID: \"65c63d95-a1c9-4987-84f0-62224cbd7196\") "
Sep 17 00:41:41.976665 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.976643    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-bundle" (OuterVolumeSpecName: "bundle") pod "65c63d95-a1c9-4987-84f0-62224cbd7196" (UID: "65c63d95-a1c9-4987-84f0-62224cbd7196"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:41.978324 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.978306    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65c63d95-a1c9-4987-84f0-62224cbd7196-kube-api-access-2lvkk" (OuterVolumeSpecName: "kube-api-access-2lvkk") pod "65c63d95-a1c9-4987-84f0-62224cbd7196" (UID: "65c63d95-a1c9-4987-84f0-62224cbd7196"). InnerVolumeSpecName "kube-api-access-2lvkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:41:41.983729 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:41.983702    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-util" (OuterVolumeSpecName: "util") pod "65c63d95-a1c9-4987-84f0-62224cbd7196" (UID: "65c63d95-a1c9-4987-84f0-62224cbd7196"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:42.076659 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:42.076634    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-bundle\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:42.076659 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:42.076657    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lvkk\" (UniqueName: \"kubernetes.io/projected/65c63d95-a1c9-4987-84f0-62224cbd7196-kube-api-access-2lvkk\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:42.076785 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:42.076667    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65c63d95-a1c9-4987-84f0-62224cbd7196-util\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:41:42.724021 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:42.723981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw" event={"ID":"65c63d95-a1c9-4987-84f0-62224cbd7196","Type":"ContainerDied","Data":"4333a6e560a96a6a3374e158c6ba116325f1c076b8225da35395726d48f160b4"}
Sep 17 00:41:42.724413 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:42.724029    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4333a6e560a96a6a3374e158c6ba116325f1c076b8225da35395726d48f160b4"
Sep 17 00:41:42.724413 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:42.723988    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7n98tw"
Sep 17 00:41:47.975507 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975470    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rqbzc"]
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975725    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cddf1736-3259-43e1-b8b3-78bcd3a7573d" containerName="pull"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975736    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cddf1736-3259-43e1-b8b3-78bcd3a7573d" containerName="pull"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975749    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62da11cc-7183-48e7-8a60-ee96bdef83ba" containerName="pull"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975754    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="62da11cc-7183-48e7-8a60-ee96bdef83ba" containerName="pull"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975763    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="051fb6e9-e737-4563-b36b-3bb2c7b017f3" containerName="util"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975769    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="051fb6e9-e737-4563-b36b-3bb2c7b017f3" containerName="util"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975774    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c63d95-a1c9-4987-84f0-62224cbd7196" containerName="pull"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975779    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c63d95-a1c9-4987-84f0-62224cbd7196" containerName="pull"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975785    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="051fb6e9-e737-4563-b36b-3bb2c7b017f3" containerName="extract"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975790    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="051fb6e9-e737-4563-b36b-3bb2c7b017f3" containerName="extract"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975797    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62da11cc-7183-48e7-8a60-ee96bdef83ba" containerName="extract"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975802    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="62da11cc-7183-48e7-8a60-ee96bdef83ba" containerName="extract"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975809    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cddf1736-3259-43e1-b8b3-78bcd3a7573d" containerName="extract"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975815    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cddf1736-3259-43e1-b8b3-78bcd3a7573d" containerName="extract"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975825    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c63d95-a1c9-4987-84f0-62224cbd7196" containerName="util"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975830    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c63d95-a1c9-4987-84f0-62224cbd7196" containerName="util"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975835    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c63d95-a1c9-4987-84f0-62224cbd7196" containerName="extract"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975840    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c63d95-a1c9-4987-84f0-62224cbd7196" containerName="extract"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975847    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cddf1736-3259-43e1-b8b3-78bcd3a7573d" containerName="util"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975852    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cddf1736-3259-43e1-b8b3-78bcd3a7573d" containerName="util"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975857    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="051fb6e9-e737-4563-b36b-3bb2c7b017f3" containerName="pull"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975862    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="051fb6e9-e737-4563-b36b-3bb2c7b017f3" containerName="pull"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975868    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62da11cc-7183-48e7-8a60-ee96bdef83ba" containerName="util"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975872    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="62da11cc-7183-48e7-8a60-ee96bdef83ba" containerName="util"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975911    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="051fb6e9-e737-4563-b36b-3bb2c7b017f3" containerName="extract"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975919    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="62da11cc-7183-48e7-8a60-ee96bdef83ba" containerName="extract"
Sep 17 00:41:47.975905 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975925    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cddf1736-3259-43e1-b8b3-78bcd3a7573d" containerName="extract"
Sep 17 00:41:47.976849 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.975930    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="65c63d95-a1c9-4987-84f0-62224cbd7196" containerName="extract"
Sep 17 00:41:47.979011 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.978996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rqbzc"
Sep 17 00:41:47.981618 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.981587    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 00:41:47.981618 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.981608    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 00:41:47.981791 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.981733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rfb4q\""
Sep 17 00:41:47.989465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:47.989444    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rqbzc"]
Sep 17 00:41:48.018262 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:48.018237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7z2j\" (UniqueName: \"kubernetes.io/projected/1f8a8f63-a361-4e35-ac0b-c5cb7e727e64-kube-api-access-h7z2j\") pod \"authorino-operator-76b478bd78-rqbzc\" (UID: \"1f8a8f63-a361-4e35-ac0b-c5cb7e727e64\") " pod="kuadrant-system/authorino-operator-76b478bd78-rqbzc"
Sep 17 00:41:48.118809 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:48.118776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7z2j\" (UniqueName: \"kubernetes.io/projected/1f8a8f63-a361-4e35-ac0b-c5cb7e727e64-kube-api-access-h7z2j\") pod \"authorino-operator-76b478bd78-rqbzc\" (UID: \"1f8a8f63-a361-4e35-ac0b-c5cb7e727e64\") " pod="kuadrant-system/authorino-operator-76b478bd78-rqbzc"
Sep 17 00:41:48.137749 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:48.137716    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7z2j\" (UniqueName: \"kubernetes.io/projected/1f8a8f63-a361-4e35-ac0b-c5cb7e727e64-kube-api-access-h7z2j\") pod \"authorino-operator-76b478bd78-rqbzc\" (UID: \"1f8a8f63-a361-4e35-ac0b-c5cb7e727e64\") " pod="kuadrant-system/authorino-operator-76b478bd78-rqbzc"
Sep 17 00:41:48.290441 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:48.290353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rqbzc"
Sep 17 00:41:48.561129 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:48.561077    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rqbzc"]
Sep 17 00:41:48.563487 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:41:48.563456    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8a8f63_a361_4e35_ac0b_c5cb7e727e64.slice/crio-a02b36f179e9dd32f5a6be0a05e466c470a6e8791e4652bef80ac3591cb4ae82 WatchSource:0}: Error finding container a02b36f179e9dd32f5a6be0a05e466c470a6e8791e4652bef80ac3591cb4ae82: Status 404 returned error can't find the container with id a02b36f179e9dd32f5a6be0a05e466c470a6e8791e4652bef80ac3591cb4ae82
Sep 17 00:41:48.752807 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:48.752773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rqbzc" event={"ID":"1f8a8f63-a361-4e35-ac0b-c5cb7e727e64","Type":"ContainerStarted","Data":"a02b36f179e9dd32f5a6be0a05e466c470a6e8791e4652bef80ac3591cb4ae82"}
Sep 17 00:41:51.770283 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:51.770247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rqbzc" event={"ID":"1f8a8f63-a361-4e35-ac0b-c5cb7e727e64","Type":"ContainerStarted","Data":"d615b908b69d7591f2d608ed28ee68241f051b7fd867e58efed82e5382f67a55"}
Sep 17 00:41:51.770676 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:51.770378    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-rqbzc"
Sep 17 00:41:51.791497 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:51.791443    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-rqbzc" podStartSLOduration=2.362386311 podStartE2EDuration="4.791424505s" totalImagesPullingTime="2.429038194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:41:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:41:51.789910348 +0000 UTC m=+704.217368271" watchObservedRunningTime="2026-09-17 00:41:51.791424505 +0000 UTC m=+704.218882430"
Sep 17 00:41:54.534287 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:54.534257    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm"]
Sep 17 00:41:54.537462 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:54.537445    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm"
Sep 17 00:41:54.539948 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:54.539918    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 17 00:41:54.540076 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:54.540012    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vpw9z\""
Sep 17 00:41:54.548380 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:54.548357    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm"]
Sep 17 00:41:54.567472 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:54.567447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh4vr\" (UniqueName: \"kubernetes.io/projected/3a6fa024-7376-44d9-b850-d5d5bddc64e3-kube-api-access-sh4vr\") pod \"dns-operator-controller-manager-7b84cd7c9c-6mvnm\" (UID: \"3a6fa024-7376-44d9-b850-d5d5bddc64e3\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm"
Sep 17 00:41:54.668160 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:54.668130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh4vr\" (UniqueName: \"kubernetes.io/projected/3a6fa024-7376-44d9-b850-d5d5bddc64e3-kube-api-access-sh4vr\") pod \"dns-operator-controller-manager-7b84cd7c9c-6mvnm\" (UID: \"3a6fa024-7376-44d9-b850-d5d5bddc64e3\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm"
Sep 17 00:41:54.679687 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:54.679664    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh4vr\" (UniqueName: \"kubernetes.io/projected/3a6fa024-7376-44d9-b850-d5d5bddc64e3-kube-api-access-sh4vr\") pod \"dns-operator-controller-manager-7b84cd7c9c-6mvnm\" (UID: \"3a6fa024-7376-44d9-b850-d5d5bddc64e3\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm"
Sep 17 00:41:54.847750 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:54.847683    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm"
Sep 17 00:41:55.119340 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:55.119317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm"]
Sep 17 00:41:55.121097 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:41:55.121073    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6fa024_7376_44d9_b850_d5d5bddc64e3.slice/crio-7f5e85deea76b558b18917beae935960ba0d621cb2d802fe8f8cff6f6115badc WatchSource:0}: Error finding container 7f5e85deea76b558b18917beae935960ba0d621cb2d802fe8f8cff6f6115badc: Status 404 returned error can't find the container with id 7f5e85deea76b558b18917beae935960ba0d621cb2d802fe8f8cff6f6115badc
Sep 17 00:41:55.789857 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:55.789821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm" event={"ID":"3a6fa024-7376-44d9-b850-d5d5bddc64e3","Type":"ContainerStarted","Data":"7f5e85deea76b558b18917beae935960ba0d621cb2d802fe8f8cff6f6115badc"}
Sep 17 00:41:56.567117 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:56.567081    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"]
Sep 17 00:41:56.570291 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:56.570275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:41:56.572651 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:56.572627    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-f5d62\""
Sep 17 00:41:56.579825 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:56.579800    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"]
Sep 17 00:41:56.583224 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:56.583199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvffc\" (UniqueName: \"kubernetes.io/projected/a2865934-2aa4-4254-89f1-4bc187e4b24f-kube-api-access-mvffc\") pod \"limitador-operator-controller-manager-74495c69f8-q57h8\" (UID: \"a2865934-2aa4-4254-89f1-4bc187e4b24f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:41:56.684184 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:56.684151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvffc\" (UniqueName: \"kubernetes.io/projected/a2865934-2aa4-4254-89f1-4bc187e4b24f-kube-api-access-mvffc\") pod \"limitador-operator-controller-manager-74495c69f8-q57h8\" (UID: \"a2865934-2aa4-4254-89f1-4bc187e4b24f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:41:56.692585 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:56.692552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvffc\" (UniqueName: \"kubernetes.io/projected/a2865934-2aa4-4254-89f1-4bc187e4b24f-kube-api-access-mvffc\") pod \"limitador-operator-controller-manager-74495c69f8-q57h8\" (UID: \"a2865934-2aa4-4254-89f1-4bc187e4b24f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:41:56.882139 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:56.882063    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:41:57.156245 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:57.156218    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"]
Sep 17 00:41:57.157976 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:41:57.157936    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2865934_2aa4_4254_89f1_4bc187e4b24f.slice/crio-6dcf31cec0874f5f4012356bfc9e038a39f037950dd01145146335e602d9e6ad WatchSource:0}: Error finding container 6dcf31cec0874f5f4012356bfc9e038a39f037950dd01145146335e602d9e6ad: Status 404 returned error can't find the container with id 6dcf31cec0874f5f4012356bfc9e038a39f037950dd01145146335e602d9e6ad
Sep 17 00:41:57.800398 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:57.800359    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8" event={"ID":"a2865934-2aa4-4254-89f1-4bc187e4b24f","Type":"ContainerStarted","Data":"6dcf31cec0874f5f4012356bfc9e038a39f037950dd01145146335e602d9e6ad"}
Sep 17 00:41:58.809164 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:58.809106    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm" event={"ID":"3a6fa024-7376-44d9-b850-d5d5bddc64e3","Type":"ContainerStarted","Data":"a6cd0ebf6909240c0f72bb7716fc67570914a52b20057dea8abd128cec4c3763"}
Sep 17 00:41:58.809615 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:58.809236    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm"
Sep 17 00:41:58.827724 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:58.827634    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm" podStartSLOduration=1.667222485 podStartE2EDuration="4.827619582s" totalImagesPullingTime="3.160397097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:41:58.825354911 +0000 UTC m=+711.252812836" watchObservedRunningTime="2026-09-17 00:41:58.827619582 +0000 UTC m=+711.255077512"
Sep 17 00:41:59.815602 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:59.815565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8" event={"ID":"a2865934-2aa4-4254-89f1-4bc187e4b24f","Type":"ContainerStarted","Data":"f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826"}
Sep 17 00:41:59.816086 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:59.815879    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:41:59.831599 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:41:59.831557    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8" podStartSLOduration=1.991416117 podStartE2EDuration="3.831544278s" totalImagesPullingTime="1.840128161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:41:59.830357879 +0000 UTC m=+712.257815804" watchObservedRunningTime="2026-09-17 00:41:59.831544278 +0000 UTC m=+712.259002200"
Sep 17 00:42:02.777682 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:02.777651    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-rqbzc"
Sep 17 00:42:09.817530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:09.817503    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6mvnm"
Sep 17 00:42:10.822052 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:10.822023    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:42:11.461541 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.461496    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"]
Sep 17 00:42:11.461863 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.461813    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8" podUID="a2865934-2aa4-4254-89f1-4bc187e4b24f" containerName="manager" containerID="cri-o://f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826" gracePeriod=2
Sep 17 00:42:11.464361 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:42:11.464330    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q57h8\" is forbidden: User \"system:node:ip-10-0-128-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-98.ec2.internal' and this object" podUID="a2865934-2aa4-4254-89f1-4bc187e4b24f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:42:11.465239 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.465212    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"]
Sep 17 00:42:11.507878 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.507843    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn"]
Sep 17 00:42:11.508148 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.508135    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2865934-2aa4-4254-89f1-4bc187e4b24f" containerName="manager"
Sep 17 00:42:11.508206 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.508149    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2865934-2aa4-4254-89f1-4bc187e4b24f" containerName="manager"
Sep 17 00:42:11.508240 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.508212    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2865934-2aa4-4254-89f1-4bc187e4b24f" containerName="manager"
Sep 17 00:42:11.511093 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.511076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn"
Sep 17 00:42:11.539599 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.539574    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn"]
Sep 17 00:42:11.565499 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:42:11.565465    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q57h8\" is forbidden: User \"system:node:ip-10-0-128-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-98.ec2.internal' and this object" podUID="a2865934-2aa4-4254-89f1-4bc187e4b24f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:42:11.603503 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.603473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6p4b\" (UniqueName: \"kubernetes.io/projected/bfba5377-ca9c-4080-b3b2-00855912929e-kube-api-access-w6p4b\") pod \"limitador-operator-controller-manager-74495c69f8-b2kkn\" (UID: \"bfba5377-ca9c-4080-b3b2-00855912929e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn"
Sep 17 00:42:11.704020 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.703985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6p4b\" (UniqueName: \"kubernetes.io/projected/bfba5377-ca9c-4080-b3b2-00855912929e-kube-api-access-w6p4b\") pod \"limitador-operator-controller-manager-74495c69f8-b2kkn\" (UID: \"bfba5377-ca9c-4080-b3b2-00855912929e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn"
Sep 17 00:42:11.707837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.707820    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:42:11.709750 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:42:11.709729    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q57h8\" is forbidden: User \"system:node:ip-10-0-128-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-98.ec2.internal' and this object" podUID="a2865934-2aa4-4254-89f1-4bc187e4b24f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:42:11.712434 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.712387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6p4b\" (UniqueName: \"kubernetes.io/projected/bfba5377-ca9c-4080-b3b2-00855912929e-kube-api-access-w6p4b\") pod \"limitador-operator-controller-manager-74495c69f8-b2kkn\" (UID: \"bfba5377-ca9c-4080-b3b2-00855912929e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn"
Sep 17 00:42:11.805177 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.805150    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvffc\" (UniqueName: \"kubernetes.io/projected/a2865934-2aa4-4254-89f1-4bc187e4b24f-kube-api-access-mvffc\") pod \"a2865934-2aa4-4254-89f1-4bc187e4b24f\" (UID: \"a2865934-2aa4-4254-89f1-4bc187e4b24f\") "
Sep 17 00:42:11.807330 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.807307    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2865934-2aa4-4254-89f1-4bc187e4b24f-kube-api-access-mvffc" (OuterVolumeSpecName: "kube-api-access-mvffc") pod "a2865934-2aa4-4254-89f1-4bc187e4b24f" (UID: "a2865934-2aa4-4254-89f1-4bc187e4b24f"). InnerVolumeSpecName "kube-api-access-mvffc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:42:11.843812 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.843787    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn"
Sep 17 00:42:11.873337 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.873303    2576 generic.go:356] "Generic (PLEG): container finished" podID="a2865934-2aa4-4254-89f1-4bc187e4b24f" containerID="f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826" exitCode=0
Sep 17 00:42:11.873485 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.873348    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:42:11.873485 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.873404    2576 scope.go:117] "RemoveContainer" containerID="f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826"
Sep 17 00:42:11.875398 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:42:11.875372    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q57h8\" is forbidden: User \"system:node:ip-10-0-128-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-98.ec2.internal' and this object" podUID="a2865934-2aa4-4254-89f1-4bc187e4b24f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:42:11.883520 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.883503    2576 scope.go:117] "RemoveContainer" containerID="f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826"
Sep 17 00:42:11.883583 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:42:11.883518    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q57h8\" is forbidden: User \"system:node:ip-10-0-128-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-98.ec2.internal' and this object" podUID="a2865934-2aa4-4254-89f1-4bc187e4b24f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q57h8"
Sep 17 00:42:11.883820 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:42:11.883804    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826\": container with ID starting with f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826 not found: ID does not exist" containerID="f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826"
Sep 17 00:42:11.883862 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.883828    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826"} err="failed to get container status \"f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826\": rpc error: code = NotFound desc = could not find container \"f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826\": container with ID starting with f303c273ea65989bff1ec999168f89e75e376e02a23aff2d7cec37d028235826 not found: ID does not exist"
Sep 17 00:42:11.906556 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:11.906526    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvffc\" (UniqueName: \"kubernetes.io/projected/a2865934-2aa4-4254-89f1-4bc187e4b24f-kube-api-access-mvffc\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:42:12.122371 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:12.122343    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn"]
Sep 17 00:42:12.124437 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:42:12.124408    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfba5377_ca9c_4080_b3b2_00855912929e.slice/crio-df5419d17860b5d7a2e42c37b9c2feccebdcb815d51534b1b09f31d4f8cbb9ab WatchSource:0}: Error finding container df5419d17860b5d7a2e42c37b9c2feccebdcb815d51534b1b09f31d4f8cbb9ab: Status 404 returned error can't find the container with id df5419d17860b5d7a2e42c37b9c2feccebdcb815d51534b1b09f31d4f8cbb9ab
Sep 17 00:42:12.139621 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:12.139597    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2865934-2aa4-4254-89f1-4bc187e4b24f" path="/var/lib/kubelet/pods/a2865934-2aa4-4254-89f1-4bc187e4b24f/volumes"
Sep 17 00:42:12.880231 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:12.880180    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn" event={"ID":"bfba5377-ca9c-4080-b3b2-00855912929e","Type":"ContainerStarted","Data":"7e25936a6b2abd36c2482399453835f3192afec77819589b7bd0c83172f5bc11"}
Sep 17 00:42:12.880620 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:12.880245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn" event={"ID":"bfba5377-ca9c-4080-b3b2-00855912929e","Type":"ContainerStarted","Data":"df5419d17860b5d7a2e42c37b9c2feccebdcb815d51534b1b09f31d4f8cbb9ab"}
Sep 17 00:42:12.880620 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:12.880276    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn"
Sep 17 00:42:23.888067 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:23.888039    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn"
Sep 17 00:42:23.904915 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:23.904854    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b2kkn" podStartSLOduration=12.904838919 podStartE2EDuration="12.904838919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:42:12.898688713 +0000 UTC m=+725.326146636" watchObservedRunningTime="2026-09-17 00:42:23.904838919 +0000 UTC m=+736.332296842"
Sep 17 00:42:43.341844 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:43.341812    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-5pmd4"]
Sep 17 00:42:43.345238 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:43.345223    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5pmd4"
Sep 17 00:42:43.347464 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:43.347435    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5bclt\""
Sep 17 00:42:43.350235 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:43.350208    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5pmd4"]
Sep 17 00:42:43.372126 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:43.372100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bmxj\" (UniqueName: \"kubernetes.io/projected/2b4e580c-408a-4c8d-9e61-f25d203bca67-kube-api-access-7bmxj\") pod \"authorino-59c974bd48-5pmd4\" (UID: \"2b4e580c-408a-4c8d-9e61-f25d203bca67\") " pod="kuadrant-system/authorino-59c974bd48-5pmd4"
Sep 17 00:42:43.472882 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:43.472853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bmxj\" (UniqueName: \"kubernetes.io/projected/2b4e580c-408a-4c8d-9e61-f25d203bca67-kube-api-access-7bmxj\") pod \"authorino-59c974bd48-5pmd4\" (UID: \"2b4e580c-408a-4c8d-9e61-f25d203bca67\") " pod="kuadrant-system/authorino-59c974bd48-5pmd4"
Sep 17 00:42:43.479822 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:43.479796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bmxj\" (UniqueName: \"kubernetes.io/projected/2b4e580c-408a-4c8d-9e61-f25d203bca67-kube-api-access-7bmxj\") pod \"authorino-59c974bd48-5pmd4\" (UID: \"2b4e580c-408a-4c8d-9e61-f25d203bca67\") " pod="kuadrant-system/authorino-59c974bd48-5pmd4"
Sep 17 00:42:43.655474 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:43.655449    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5pmd4"
Sep 17 00:42:43.922574 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:43.922547    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5pmd4"]
Sep 17 00:42:43.924600 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:42:43.924570    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b4e580c_408a_4c8d_9e61_f25d203bca67.slice/crio-988032abde4a0b4a5da777d6ac4b51807b5f69bde666ac54b5efa668b404147f WatchSource:0}: Error finding container 988032abde4a0b4a5da777d6ac4b51807b5f69bde666ac54b5efa668b404147f: Status 404 returned error can't find the container with id 988032abde4a0b4a5da777d6ac4b51807b5f69bde666ac54b5efa668b404147f
Sep 17 00:42:44.025531 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:44.025494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5pmd4" event={"ID":"2b4e580c-408a-4c8d-9e61-f25d203bca67","Type":"ContainerStarted","Data":"988032abde4a0b4a5da777d6ac4b51807b5f69bde666ac54b5efa668b404147f"}
Sep 17 00:42:47.042566 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:47.042531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5pmd4" event={"ID":"2b4e580c-408a-4c8d-9e61-f25d203bca67","Type":"ContainerStarted","Data":"3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1"}
Sep 17 00:42:47.056999 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:42:47.056940    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-5pmd4" podStartSLOduration=1.6705121699999999 podStartE2EDuration="4.056923758s" totalImagesPullingTime="2.386411588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:42:47.055337085 +0000 UTC m=+759.482795021" watchObservedRunningTime="2026-09-17 00:42:47.056923758 +0000 UTC m=+759.484381680"
Sep 17 00:43:20.199255 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.199223    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-56rd6"]
Sep 17 00:43:20.207290 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.207242    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-56rd6"
Sep 17 00:43:20.209105 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.209077    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-56rd6"]
Sep 17 00:43:20.331560 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.331528    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-56rd6"]
Sep 17 00:43:20.331771 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:20.331752    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9khc2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-56rd6" podUID="a9633b5e-f8f5-4bb2-a606-e39503a3c2ad"
Sep 17 00:43:20.350215 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.350189    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-2zm4d"]
Sep 17 00:43:20.352446 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.352427    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-2zm4d"
Sep 17 00:43:20.354512 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.354494    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 17 00:43:20.357349 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.357329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9khc2\" (UniqueName: \"kubernetes.io/projected/a9633b5e-f8f5-4bb2-a606-e39503a3c2ad-kube-api-access-9khc2\") pod \"authorino-557f876f69-56rd6\" (UID: \"a9633b5e-f8f5-4bb2-a606-e39503a3c2ad\") " pod="kuadrant-system/authorino-557f876f69-56rd6"
Sep 17 00:43:20.360811 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.360794    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-2zm4d"]
Sep 17 00:43:20.430185 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.430153    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-2zm4d"]
Sep 17 00:43:20.430383 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:20.430364    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4z494 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-2zm4d" podUID="94f06e93-fd1a-4ff3-bd6a-0530ebfac96b"
Sep 17 00:43:20.454798 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.454737    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b89f8f88d-pl6ll"]
Sep 17 00:43:20.457170 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.457149    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b89f8f88d-pl6ll"
Sep 17 00:43:20.457648 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.457634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z494\" (UniqueName: \"kubernetes.io/projected/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-kube-api-access-4z494\") pod \"authorino-6d4dfc649f-2zm4d\" (UID: \"94f06e93-fd1a-4ff3-bd6a-0530ebfac96b\") " pod="kuadrant-system/authorino-6d4dfc649f-2zm4d"
Sep 17 00:43:20.457702 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.457665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9khc2\" (UniqueName: \"kubernetes.io/projected/a9633b5e-f8f5-4bb2-a606-e39503a3c2ad-kube-api-access-9khc2\") pod \"authorino-557f876f69-56rd6\" (UID: \"a9633b5e-f8f5-4bb2-a606-e39503a3c2ad\") " pod="kuadrant-system/authorino-557f876f69-56rd6"
Sep 17 00:43:20.457702 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.457685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-tls-cert\") pod \"authorino-6d4dfc649f-2zm4d\" (UID: \"94f06e93-fd1a-4ff3-bd6a-0530ebfac96b\") " pod="kuadrant-system/authorino-6d4dfc649f-2zm4d"
Sep 17 00:43:20.463757 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.463736    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b89f8f88d-pl6ll"]
Sep 17 00:43:20.468574 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.468553    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9khc2\" (UniqueName: \"kubernetes.io/projected/a9633b5e-f8f5-4bb2-a606-e39503a3c2ad-kube-api-access-9khc2\") pod \"authorino-557f876f69-56rd6\" (UID: \"a9633b5e-f8f5-4bb2-a606-e39503a3c2ad\") " pod="kuadrant-system/authorino-557f876f69-56rd6"
Sep 17 00:43:20.558335 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.558303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/938323dd-aef4-4fc1-ba5d-33acbad6b678-tls-cert\") pod \"authorino-5b89f8f88d-pl6ll\" (UID: \"938323dd-aef4-4fc1-ba5d-33acbad6b678\") " pod="kuadrant-system/authorino-5b89f8f88d-pl6ll"
Sep 17 00:43:20.558513 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.558368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z494\" (UniqueName: \"kubernetes.io/projected/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-kube-api-access-4z494\") pod \"authorino-6d4dfc649f-2zm4d\" (UID: \"94f06e93-fd1a-4ff3-bd6a-0530ebfac96b\") " pod="kuadrant-system/authorino-6d4dfc649f-2zm4d"
Sep 17 00:43:20.558513 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.558416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzbd6\" (UniqueName: \"kubernetes.io/projected/938323dd-aef4-4fc1-ba5d-33acbad6b678-kube-api-access-rzbd6\") pod \"authorino-5b89f8f88d-pl6ll\" (UID: \"938323dd-aef4-4fc1-ba5d-33acbad6b678\") " pod="kuadrant-system/authorino-5b89f8f88d-pl6ll"
Sep 17 00:43:20.558513 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.558447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-tls-cert\") pod \"authorino-6d4dfc649f-2zm4d\" (UID: \"94f06e93-fd1a-4ff3-bd6a-0530ebfac96b\") " pod="kuadrant-system/authorino-6d4dfc649f-2zm4d"
Sep 17 00:43:20.560995 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.560978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-tls-cert\") pod \"authorino-6d4dfc649f-2zm4d\" (UID: \"94f06e93-fd1a-4ff3-bd6a-0530ebfac96b\") " pod="kuadrant-system/authorino-6d4dfc649f-2zm4d"
Sep 17 00:43:20.565180 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.565156    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z494\" (UniqueName: \"kubernetes.io/projected/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-kube-api-access-4z494\") pod \"authorino-6d4dfc649f-2zm4d\" (UID: \"94f06e93-fd1a-4ff3-bd6a-0530ebfac96b\") " pod="kuadrant-system/authorino-6d4dfc649f-2zm4d"
Sep 17 00:43:20.659116 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.659084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzbd6\" (UniqueName: \"kubernetes.io/projected/938323dd-aef4-4fc1-ba5d-33acbad6b678-kube-api-access-rzbd6\") pod \"authorino-5b89f8f88d-pl6ll\" (UID: \"938323dd-aef4-4fc1-ba5d-33acbad6b678\") " pod="kuadrant-system/authorino-5b89f8f88d-pl6ll"
Sep 17 00:43:20.659252 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.659140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/938323dd-aef4-4fc1-ba5d-33acbad6b678-tls-cert\") pod \"authorino-5b89f8f88d-pl6ll\" (UID: \"938323dd-aef4-4fc1-ba5d-33acbad6b678\") " pod="kuadrant-system/authorino-5b89f8f88d-pl6ll"
Sep 17 00:43:20.661499 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.661478    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/938323dd-aef4-4fc1-ba5d-33acbad6b678-tls-cert\") pod \"authorino-5b89f8f88d-pl6ll\" (UID: \"938323dd-aef4-4fc1-ba5d-33acbad6b678\") " pod="kuadrant-system/authorino-5b89f8f88d-pl6ll"
Sep 17 00:43:20.666763 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.666740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzbd6\" (UniqueName: \"kubernetes.io/projected/938323dd-aef4-4fc1-ba5d-33acbad6b678-kube-api-access-rzbd6\") pod \"authorino-5b89f8f88d-pl6ll\" (UID: \"938323dd-aef4-4fc1-ba5d-33acbad6b678\") " pod="kuadrant-system/authorino-5b89f8f88d-pl6ll"
Sep 17 00:43:20.766840 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:20.766782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b89f8f88d-pl6ll"
Sep 17 00:43:21.032920 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.032900    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b89f8f88d-pl6ll"]
Sep 17 00:43:21.034920 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:43:21.034892    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod938323dd_aef4_4fc1_ba5d_33acbad6b678.slice/crio-88068780717e26044c69d1c478e0168e5d74a98251fa13dd7959eaf36602dfa1 WatchSource:0}: Error finding container 88068780717e26044c69d1c478e0168e5d74a98251fa13dd7959eaf36602dfa1: Status 404 returned error can't find the container with id 88068780717e26044c69d1c478e0168e5d74a98251fa13dd7959eaf36602dfa1
Sep 17 00:43:21.208712 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.208674    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b89f8f88d-pl6ll" event={"ID":"938323dd-aef4-4fc1-ba5d-33acbad6b678","Type":"ContainerStarted","Data":"88068780717e26044c69d1c478e0168e5d74a98251fa13dd7959eaf36602dfa1"}
Sep 17 00:43:21.209110 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.208715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-2zm4d"
Sep 17 00:43:21.209110 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.208718    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-56rd6"
Sep 17 00:43:21.215512 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.215495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-2zm4d"
Sep 17 00:43:21.217515 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.217499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-56rd6"
Sep 17 00:43:21.365579 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.365503    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9khc2\" (UniqueName: \"kubernetes.io/projected/a9633b5e-f8f5-4bb2-a606-e39503a3c2ad-kube-api-access-9khc2\") pod \"a9633b5e-f8f5-4bb2-a606-e39503a3c2ad\" (UID: \"a9633b5e-f8f5-4bb2-a606-e39503a3c2ad\") "
Sep 17 00:43:21.365579 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.365530    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z494\" (UniqueName: \"kubernetes.io/projected/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-kube-api-access-4z494\") pod \"94f06e93-fd1a-4ff3-bd6a-0530ebfac96b\" (UID: \"94f06e93-fd1a-4ff3-bd6a-0530ebfac96b\") "
Sep 17 00:43:21.365795 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.365594    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-tls-cert\") pod \"94f06e93-fd1a-4ff3-bd6a-0530ebfac96b\" (UID: \"94f06e93-fd1a-4ff3-bd6a-0530ebfac96b\") "
Sep 17 00:43:21.367912 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.367881    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-kube-api-access-4z494" (OuterVolumeSpecName: "kube-api-access-4z494") pod "94f06e93-fd1a-4ff3-bd6a-0530ebfac96b" (UID: "94f06e93-fd1a-4ff3-bd6a-0530ebfac96b"). InnerVolumeSpecName "kube-api-access-4z494". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:43:21.367912 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.367892    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "94f06e93-fd1a-4ff3-bd6a-0530ebfac96b" (UID: "94f06e93-fd1a-4ff3-bd6a-0530ebfac96b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:43:21.368075 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.367914    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9633b5e-f8f5-4bb2-a606-e39503a3c2ad-kube-api-access-9khc2" (OuterVolumeSpecName: "kube-api-access-9khc2") pod "a9633b5e-f8f5-4bb2-a606-e39503a3c2ad" (UID: "a9633b5e-f8f5-4bb2-a606-e39503a3c2ad"). InnerVolumeSpecName "kube-api-access-9khc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:43:21.466822 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.466793    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-tls-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:43:21.466822 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.466818    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9khc2\" (UniqueName: \"kubernetes.io/projected/a9633b5e-f8f5-4bb2-a606-e39503a3c2ad-kube-api-access-9khc2\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:43:21.466822 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:21.466828    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z494\" (UniqueName: \"kubernetes.io/projected/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b-kube-api-access-4z494\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:43:22.215453 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.215420    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b89f8f88d-pl6ll" event={"ID":"938323dd-aef4-4fc1-ba5d-33acbad6b678","Type":"ContainerStarted","Data":"ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f"}
Sep 17 00:43:22.215453 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.215451    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-2zm4d"
Sep 17 00:43:22.215870 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.215505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-56rd6"
Sep 17 00:43:22.229917 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.229874    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b89f8f88d-pl6ll" podStartSLOduration=1.463342709 podStartE2EDuration="2.229859829s" totalImagesPullingTime="766.51712ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:43:22.228642453 +0000 UTC m=+794.656100378" watchObservedRunningTime="2026-09-17 00:43:22.229859829 +0000 UTC m=+794.657317751"
Sep 17 00:43:22.252569 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.252544    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-2zm4d"]
Sep 17 00:43:22.260174 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.260140    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5pmd4"]
Sep 17 00:43:22.260324 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.260303    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-5pmd4" podUID="2b4e580c-408a-4c8d-9e61-f25d203bca67" containerName="authorino" containerID="cri-o://3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1" gracePeriod=30
Sep 17 00:43:22.262559 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.262464    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-2zm4d"]
Sep 17 00:43:22.283950 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.283920    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-56rd6"]
Sep 17 00:43:22.285780 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.285758    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-56rd6"]
Sep 17 00:43:22.490543 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.490521    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5pmd4"
Sep 17 00:43:22.575034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.575008    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bmxj\" (UniqueName: \"kubernetes.io/projected/2b4e580c-408a-4c8d-9e61-f25d203bca67-kube-api-access-7bmxj\") pod \"2b4e580c-408a-4c8d-9e61-f25d203bca67\" (UID: \"2b4e580c-408a-4c8d-9e61-f25d203bca67\") "
Sep 17 00:43:22.577205 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.577173    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4e580c-408a-4c8d-9e61-f25d203bca67-kube-api-access-7bmxj" (OuterVolumeSpecName: "kube-api-access-7bmxj") pod "2b4e580c-408a-4c8d-9e61-f25d203bca67" (UID: "2b4e580c-408a-4c8d-9e61-f25d203bca67"). InnerVolumeSpecName "kube-api-access-7bmxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:43:22.675780 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:22.675687    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bmxj\" (UniqueName: \"kubernetes.io/projected/2b4e580c-408a-4c8d-9e61-f25d203bca67-kube-api-access-7bmxj\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:43:23.227264 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:23.227228    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b4e580c-408a-4c8d-9e61-f25d203bca67" containerID="3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1" exitCode=0
Sep 17 00:43:23.227703 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:23.227319    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5pmd4"
Sep 17 00:43:23.227703 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:23.227319    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5pmd4" event={"ID":"2b4e580c-408a-4c8d-9e61-f25d203bca67","Type":"ContainerDied","Data":"3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1"}
Sep 17 00:43:23.227703 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:23.227387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5pmd4" event={"ID":"2b4e580c-408a-4c8d-9e61-f25d203bca67","Type":"ContainerDied","Data":"988032abde4a0b4a5da777d6ac4b51807b5f69bde666ac54b5efa668b404147f"}
Sep 17 00:43:23.227703 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:23.227423    2576 scope.go:117] "RemoveContainer" containerID="3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1"
Sep 17 00:43:23.236824 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:23.236808    2576 scope.go:117] "RemoveContainer" containerID="3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1"
Sep 17 00:43:23.237092 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:23.237075    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1\": container with ID starting with 3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1 not found: ID does not exist" containerID="3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1"
Sep 17 00:43:23.237153 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:23.237098    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1"} err="failed to get container status \"3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1\": rpc error: code = NotFound desc = could not find container \"3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1\": container with ID starting with 3ae0b0f04119dd739186732b1f5a486315c791b64206488db0caf098df189ce1 not found: ID does not exist"
Sep 17 00:43:23.246371 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:23.246347    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5pmd4"]
Sep 17 00:43:23.249808 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:23.249785    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5pmd4"]
Sep 17 00:43:24.140775 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:24.140745    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b4e580c-408a-4c8d-9e61-f25d203bca67" path="/var/lib/kubelet/pods/2b4e580c-408a-4c8d-9e61-f25d203bca67/volumes"
Sep 17 00:43:24.141109 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:24.141096    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94f06e93-fd1a-4ff3-bd6a-0530ebfac96b" path="/var/lib/kubelet/pods/94f06e93-fd1a-4ff3-bd6a-0530ebfac96b/volumes"
Sep 17 00:43:24.141289 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:24.141277    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9633b5e-f8f5-4bb2-a606-e39503a3c2ad" path="/var/lib/kubelet/pods/a9633b5e-f8f5-4bb2-a606-e39503a3c2ad/volumes"
Sep 17 00:43:26.976407 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:26.976372    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f65648b77-6v6j4"]
Sep 17 00:43:26.976871 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:26.976800    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4e580c-408a-4c8d-9e61-f25d203bca67" containerName="authorino"
Sep 17 00:43:26.976871 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:26.976818    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4e580c-408a-4c8d-9e61-f25d203bca67" containerName="authorino"
Sep 17 00:43:26.976998 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:26.976908    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b4e580c-408a-4c8d-9e61-f25d203bca67" containerName="authorino"
Sep 17 00:43:26.978849 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:26.978828    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:26.980836 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:26.980815    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 00:43:26.980836 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:26.980827    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pmm2c\""
Sep 17 00:43:26.981001 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:26.980933    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 00:43:26.981558 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:26.981539    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 00:43:26.988803 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:26.988782    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f65648b77-6v6j4"]
Sep 17 00:43:27.110023 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.109991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-webhook-cert\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:27.110023 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.110021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:27.110216 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.110055    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4qc6\" (UniqueName: \"kubernetes.io/projected/0afb541e-fdca-407e-a65d-3d6bf15d2e15-kube-api-access-j4qc6\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:27.153111 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.153080    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-mtffs"]
Sep 17 00:43:27.155227 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.155207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:27.165709 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.165681    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-mtffs"]
Sep 17 00:43:27.211337 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.211300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-webhook-cert\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:27.211337 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.211335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:27.211568 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.211406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4qc6\" (UniqueName: \"kubernetes.io/projected/0afb541e-fdca-407e-a65d-3d6bf15d2e15-kube-api-access-j4qc6\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:27.211568 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:27.211450    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 17 00:43:27.211568 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:27.211522    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs podName:0afb541e-fdca-407e-a65d-3d6bf15d2e15 nodeName:}" failed. No retries permitted until 2026-09-17 00:43:27.71149915 +0000 UTC m=+800.138957074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs") pod "maas-controller-7f65648b77-6v6j4" (UID: "0afb541e-fdca-407e-a65d-3d6bf15d2e15") : secret "maas-controller-metrics-tls" not found
Sep 17 00:43:27.211568 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:27.211452    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 17 00:43:27.211568 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:27.211568    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-webhook-cert podName:0afb541e-fdca-407e-a65d-3d6bf15d2e15 nodeName:}" failed. No retries permitted until 2026-09-17 00:43:27.711557411 +0000 UTC m=+800.139015314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-webhook-cert") pod "maas-controller-7f65648b77-6v6j4" (UID: "0afb541e-fdca-407e-a65d-3d6bf15d2e15") : secret "maas-controller-webhook-cert" not found
Sep 17 00:43:27.221242 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.221216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4qc6\" (UniqueName: \"kubernetes.io/projected/0afb541e-fdca-407e-a65d-3d6bf15d2e15-kube-api-access-j4qc6\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:27.311878 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.311793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-webhook-cert\") pod \"maas-controller-7c6c7d56b5-mtffs\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") " pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:27.311878 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.311842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-metrics-certs\") pod \"maas-controller-7c6c7d56b5-mtffs\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") " pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:27.312088 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.311901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4pnx\" (UniqueName: \"kubernetes.io/projected/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-kube-api-access-c4pnx\") pod \"maas-controller-7c6c7d56b5-mtffs\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") " pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:27.413231 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.413195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-webhook-cert\") pod \"maas-controller-7c6c7d56b5-mtffs\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") " pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:27.413389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.413239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-metrics-certs\") pod \"maas-controller-7c6c7d56b5-mtffs\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") " pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:27.413389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.413262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4pnx\" (UniqueName: \"kubernetes.io/projected/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-kube-api-access-c4pnx\") pod \"maas-controller-7c6c7d56b5-mtffs\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") " pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:27.413389 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:27.413365    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 17 00:43:27.413523 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:27.413441    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-metrics-certs podName:b934b2c7-5cd1-46e9-8705-1e15bdfc7454 nodeName:}" failed. No retries permitted until 2026-09-17 00:43:27.913419744 +0000 UTC m=+800.340877663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-metrics-certs") pod "maas-controller-7c6c7d56b5-mtffs" (UID: "b934b2c7-5cd1-46e9-8705-1e15bdfc7454") : secret "maas-controller-metrics-tls" not found
Sep 17 00:43:27.415771 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.415754    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-webhook-cert\") pod \"maas-controller-7c6c7d56b5-mtffs\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") " pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:27.421416 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.421393    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4pnx\" (UniqueName: \"kubernetes.io/projected/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-kube-api-access-c4pnx\") pod \"maas-controller-7c6c7d56b5-mtffs\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") " pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:27.715772 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.715734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-webhook-cert\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:27.715772 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.715773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:27.716045 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:27.715879    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 17 00:43:27.716045 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:27.715945    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs podName:0afb541e-fdca-407e-a65d-3d6bf15d2e15 nodeName:}" failed. No retries permitted until 2026-09-17 00:43:28.71592727 +0000 UTC m=+801.143385188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs") pod "maas-controller-7f65648b77-6v6j4" (UID: "0afb541e-fdca-407e-a65d-3d6bf15d2e15") : secret "maas-controller-metrics-tls" not found
Sep 17 00:43:27.718405 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.718382    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-webhook-cert\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:27.916862 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.916826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-metrics-certs\") pod \"maas-controller-7c6c7d56b5-mtffs\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") " pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:27.919293 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:27.919269    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-metrics-certs\") pod \"maas-controller-7c6c7d56b5-mtffs\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") " pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:28.065014 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:28.064893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:28.333236 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:28.333214    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-mtffs"]
Sep 17 00:43:28.334710 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:43:28.334685    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb934b2c7_5cd1_46e9_8705_1e15bdfc7454.slice/crio-cc57c38a7b94eec716fb9283df0be7d2e731e99dc4df25d6d00a69fec8d07471 WatchSource:0}: Error finding container cc57c38a7b94eec716fb9283df0be7d2e731e99dc4df25d6d00a69fec8d07471: Status 404 returned error can't find the container with id cc57c38a7b94eec716fb9283df0be7d2e731e99dc4df25d6d00a69fec8d07471
Sep 17 00:43:28.723525 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:28.723487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:28.725977 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:28.725937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs\") pod \"maas-controller-7f65648b77-6v6j4\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") " pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:28.789977 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:28.789932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:29.060173 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:29.060144    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f65648b77-6v6j4"]
Sep 17 00:43:29.062378 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:43:29.062349    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afb541e_fdca_407e_a65d_3d6bf15d2e15.slice/crio-31fc4259564f8d512205df463699ed14ce88927e4f57dee503a0030ff2884104 WatchSource:0}: Error finding container 31fc4259564f8d512205df463699ed14ce88927e4f57dee503a0030ff2884104: Status 404 returned error can't find the container with id 31fc4259564f8d512205df463699ed14ce88927e4f57dee503a0030ff2884104
Sep 17 00:43:29.258558 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:29.258524    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs" event={"ID":"b934b2c7-5cd1-46e9-8705-1e15bdfc7454","Type":"ContainerStarted","Data":"cc57c38a7b94eec716fb9283df0be7d2e731e99dc4df25d6d00a69fec8d07471"}
Sep 17 00:43:29.259989 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:29.259939    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f65648b77-6v6j4" event={"ID":"0afb541e-fdca-407e-a65d-3d6bf15d2e15","Type":"ContainerStarted","Data":"31fc4259564f8d512205df463699ed14ce88927e4f57dee503a0030ff2884104"}
Sep 17 00:43:31.272914 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:31.272876    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f65648b77-6v6j4" event={"ID":"0afb541e-fdca-407e-a65d-3d6bf15d2e15","Type":"ContainerStarted","Data":"10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233"}
Sep 17 00:43:31.273411 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:31.273072    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:31.274499 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:31.274476    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs" event={"ID":"b934b2c7-5cd1-46e9-8705-1e15bdfc7454","Type":"ContainerStarted","Data":"b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4"}
Sep 17 00:43:31.274601 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:31.274530    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:31.289740 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:31.289688    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f65648b77-6v6j4" podStartSLOduration=3.307269178 podStartE2EDuration="5.289670416s" totalImagesPullingTime="1.982401238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:43:31.289465681 +0000 UTC m=+803.716923605" watchObservedRunningTime="2026-09-17 00:43:31.289670416 +0000 UTC m=+803.717128340"
Sep 17 00:43:31.307526 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:31.307443    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs" podStartSLOduration=1.600915861 podStartE2EDuration="4.30742801s" totalImagesPullingTime="2.706512149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:43:31.306084584 +0000 UTC m=+803.733542513" watchObservedRunningTime="2026-09-17 00:43:31.30742801 +0000 UTC m=+803.734885932"
Sep 17 00:43:42.281272 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.281243    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 00:43:42.281633 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.281407    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:42.342359 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.342319    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f65648b77-6v6j4"]
Sep 17 00:43:42.342534 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.342507    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f65648b77-6v6j4" podUID="0afb541e-fdca-407e-a65d-3d6bf15d2e15" containerName="manager" containerID="cri-o://10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233" gracePeriod=30
Sep 17 00:43:42.583900 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.583875    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:42.742636 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.742601    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs\") pod \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") "
Sep 17 00:43:42.742795 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.742675    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4qc6\" (UniqueName: \"kubernetes.io/projected/0afb541e-fdca-407e-a65d-3d6bf15d2e15-kube-api-access-j4qc6\") pod \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") "
Sep 17 00:43:42.742795 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.742725    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-webhook-cert\") pod \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\" (UID: \"0afb541e-fdca-407e-a65d-3d6bf15d2e15\") "
Sep 17 00:43:42.745028 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.744999    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0afb541e-fdca-407e-a65d-3d6bf15d2e15" (UID: "0afb541e-fdca-407e-a65d-3d6bf15d2e15"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:43:42.745028 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.745014    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afb541e-fdca-407e-a65d-3d6bf15d2e15-kube-api-access-j4qc6" (OuterVolumeSpecName: "kube-api-access-j4qc6") pod "0afb541e-fdca-407e-a65d-3d6bf15d2e15" (UID: "0afb541e-fdca-407e-a65d-3d6bf15d2e15"). InnerVolumeSpecName "kube-api-access-j4qc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:43:42.745028 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.745020    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0afb541e-fdca-407e-a65d-3d6bf15d2e15" (UID: "0afb541e-fdca-407e-a65d-3d6bf15d2e15"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:43:42.844213 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.844139    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4qc6\" (UniqueName: \"kubernetes.io/projected/0afb541e-fdca-407e-a65d-3d6bf15d2e15-kube-api-access-j4qc6\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:43:42.844213 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.844174    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-webhook-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:43:42.844213 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:42.844184    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afb541e-fdca-407e-a65d-3d6bf15d2e15-metrics-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:43:43.338241 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:43.338202    2576 generic.go:356] "Generic (PLEG): container finished" podID="0afb541e-fdca-407e-a65d-3d6bf15d2e15" containerID="10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233" exitCode=0
Sep 17 00:43:43.338609 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:43.338246    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f65648b77-6v6j4"
Sep 17 00:43:43.338609 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:43.338288    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f65648b77-6v6j4" event={"ID":"0afb541e-fdca-407e-a65d-3d6bf15d2e15","Type":"ContainerDied","Data":"10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233"}
Sep 17 00:43:43.338609 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:43.338338    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f65648b77-6v6j4" event={"ID":"0afb541e-fdca-407e-a65d-3d6bf15d2e15","Type":"ContainerDied","Data":"31fc4259564f8d512205df463699ed14ce88927e4f57dee503a0030ff2884104"}
Sep 17 00:43:43.338609 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:43.338365    2576 scope.go:117] "RemoveContainer" containerID="10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233"
Sep 17 00:43:43.347445 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:43.347284    2576 scope.go:117] "RemoveContainer" containerID="10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233"
Sep 17 00:43:43.347573 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:43:43.347555    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233\": container with ID starting with 10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233 not found: ID does not exist" containerID="10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233"
Sep 17 00:43:43.347618 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:43.347583    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233"} err="failed to get container status \"10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233\": rpc error: code = NotFound desc = could not find container \"10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233\": container with ID starting with 10dcba790dea016e89f51d10ba3fee9ebd70a57d36d20f8f2af2688ddbcf6233 not found: ID does not exist"
Sep 17 00:43:43.357444 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:43.357424    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f65648b77-6v6j4"]
Sep 17 00:43:43.362528 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:43.362493    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f65648b77-6v6j4"]
Sep 17 00:43:44.145090 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:43:44.145051    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0afb541e-fdca-407e-a65d-3d6bf15d2e15" path="/var/lib/kubelet/pods/0afb541e-fdca-407e-a65d-3d6bf15d2e15/volumes"
Sep 17 00:44:04.300732 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.300688    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"]
Sep 17 00:44:04.301328 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.301121    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afb541e-fdca-407e-a65d-3d6bf15d2e15" containerName="manager"
Sep 17 00:44:04.301328 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.301139    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afb541e-fdca-407e-a65d-3d6bf15d2e15" containerName="manager"
Sep 17 00:44:04.301328 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.301218    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0afb541e-fdca-407e-a65d-3d6bf15d2e15" containerName="manager"
Sep 17 00:44:04.304071 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.304052    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.306214 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.306189    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 00:44:04.307173 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.307150    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 00:44:04.307320 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.307294    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 00:44:04.307434 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.307384    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 17 00:44:04.313554 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.313532    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"]
Sep 17 00:44:04.408385 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.408358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/736c1eda-6051-44a9-a80f-3cdd4e0201d7-openshift-service-ca\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.408385 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.408388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-metrics-certs\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.408600 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.408426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snw7w\" (UniqueName: \"kubernetes.io/projected/736c1eda-6051-44a9-a80f-3cdd4e0201d7-kube-api-access-snw7w\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.408600 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.408514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-maas-api-tls\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.509645 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.509614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-maas-api-tls\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.509812 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.509676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/736c1eda-6051-44a9-a80f-3cdd4e0201d7-openshift-service-ca\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.509812 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.509692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-metrics-certs\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.509812 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.509730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snw7w\" (UniqueName: \"kubernetes.io/projected/736c1eda-6051-44a9-a80f-3cdd4e0201d7-kube-api-access-snw7w\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.509916 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:44:04.509841    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 17 00:44:04.509916 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:44:04.509907    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-metrics-certs podName:736c1eda-6051-44a9-a80f-3cdd4e0201d7 nodeName:}" failed. No retries permitted until 2026-09-17 00:44:05.00988795 +0000 UTC m=+837.437345854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-metrics-certs") pod "maas-api-cf64cbd4c-wp8h8" (UID: "736c1eda-6051-44a9-a80f-3cdd4e0201d7") : secret "maas-api-metrics-tls" not found
Sep 17 00:44:04.510426 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.510409    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/736c1eda-6051-44a9-a80f-3cdd4e0201d7-openshift-service-ca\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.512321 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.512289    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-maas-api-tls\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.517616 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.517594    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snw7w\" (UniqueName: \"kubernetes.io/projected/736c1eda-6051-44a9-a80f-3cdd4e0201d7-kube-api-access-snw7w\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:04.875245 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.875210    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"]
Sep 17 00:44:04.878693 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.878672    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"
Sep 17 00:44:04.881317 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.881294    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 17 00:44:04.881458 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.881294    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9bt65\""
Sep 17 00:44:04.888893 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.888871    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"]
Sep 17 00:44:04.913715 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.913684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpx8w\" (UniqueName: \"kubernetes.io/projected/7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f-kube-api-access-bpx8w\") pod \"payload-processing-5b54b7fbb7-7mk8t\" (UID: \"7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"
Sep 17 00:44:04.913858 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:04.913770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7mk8t\" (UID: \"7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"
Sep 17 00:44:05.014415 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:05.014386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpx8w\" (UniqueName: \"kubernetes.io/projected/7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f-kube-api-access-bpx8w\") pod \"payload-processing-5b54b7fbb7-7mk8t\" (UID: \"7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"
Sep 17 00:44:05.014595 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:05.014436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7mk8t\" (UID: \"7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"
Sep 17 00:44:05.014595 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:05.014464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-metrics-certs\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:05.015233 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:05.015210    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7mk8t\" (UID: \"7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"
Sep 17 00:44:05.017336 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:05.017310    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-metrics-certs\") pod \"maas-api-cf64cbd4c-wp8h8\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") " pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:05.028930 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:05.028894    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpx8w\" (UniqueName: \"kubernetes.io/projected/7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f-kube-api-access-bpx8w\") pod \"payload-processing-5b54b7fbb7-7mk8t\" (UID: \"7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"
Sep 17 00:44:05.190824 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:05.190776    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"
Sep 17 00:44:05.215754 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:05.215700    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:05.474464 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:05.474438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"]
Sep 17 00:44:05.476056 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:44:05.476030    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7adbe5fa_eb75_423f_9a36_e31e2b4f4e4f.slice/crio-e198b8ad260ecdbcf28b706a1da69a848c273787d6fd9b52d0dee9181b8d3d2c WatchSource:0}: Error finding container e198b8ad260ecdbcf28b706a1da69a848c273787d6fd9b52d0dee9181b8d3d2c: Status 404 returned error can't find the container with id e198b8ad260ecdbcf28b706a1da69a848c273787d6fd9b52d0dee9181b8d3d2c
Sep 17 00:44:05.478227 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:05.478208    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:44:05.504116 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:05.504085    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"]
Sep 17 00:44:05.507894 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:44:05.507859    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736c1eda_6051_44a9_a80f_3cdd4e0201d7.slice/crio-7f49105a70f203e4117545181fbdadd3cdc5ee177116228b6cb3371a702a0e55 WatchSource:0}: Error finding container 7f49105a70f203e4117545181fbdadd3cdc5ee177116228b6cb3371a702a0e55: Status 404 returned error can't find the container with id 7f49105a70f203e4117545181fbdadd3cdc5ee177116228b6cb3371a702a0e55
Sep 17 00:44:06.457919 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:06.457878    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8" event={"ID":"736c1eda-6051-44a9-a80f-3cdd4e0201d7","Type":"ContainerStarted","Data":"7f49105a70f203e4117545181fbdadd3cdc5ee177116228b6cb3371a702a0e55"}
Sep 17 00:44:06.459524 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:06.459489    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t" event={"ID":"7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f","Type":"ContainerStarted","Data":"e198b8ad260ecdbcf28b706a1da69a848c273787d6fd9b52d0dee9181b8d3d2c"}
Sep 17 00:44:07.466978 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:07.466865    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8" event={"ID":"736c1eda-6051-44a9-a80f-3cdd4e0201d7","Type":"ContainerStarted","Data":"fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1"}
Sep 17 00:44:07.467390 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:07.466987    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:07.468414 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:07.468390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t" event={"ID":"7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f","Type":"ContainerStarted","Data":"8280f2369a96bf09c8cb134e055185d62f5972e66a6c49affb9b78b289518bd2"}
Sep 17 00:44:07.468533 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:07.468514    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"
Sep 17 00:44:07.482953 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:07.482910    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8" podStartSLOduration=1.742372485 podStartE2EDuration="3.482896374s" totalImagesPullingTime="1.740523889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:44:07.481606893 +0000 UTC m=+839.909064829" watchObservedRunningTime="2026-09-17 00:44:07.482896374 +0000 UTC m=+839.910354296"
Sep 17 00:44:07.497487 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:07.497444    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t" podStartSLOduration=1.771847756 podStartE2EDuration="3.497427866s" totalImagesPullingTime="1.72558011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:44:07.495181904 +0000 UTC m=+839.922639851" watchObservedRunningTime="2026-09-17 00:44:07.497427866 +0000 UTC m=+839.924885789"
Sep 17 00:44:13.478676 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:13.478644    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 00:44:18.475510 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:44:18.475476    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-7mk8t"
Sep 17 00:45:46.792634 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.792596    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"]
Sep 17 00:45:46.801492 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.801464    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:46.802378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.802351    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"]
Sep 17 00:45:46.804623 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.804602    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vlt7q\""
Sep 17 00:45:46.805121 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.804727    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 00:45:46.805121 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.804879    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 17 00:45:46.805121 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.804748    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 00:45:46.937741 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.937700    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2js9\" (UniqueName: \"kubernetes.io/projected/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-kube-api-access-r2js9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:46.937741 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.937744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:46.938040 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.937893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:46.938040 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.937930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:46.938040 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.938036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:46.938190 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:46.938074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.039143 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.039104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.039143 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.039146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.039372 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.039184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.039372 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.039210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.039372 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.039234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2js9\" (UniqueName: \"kubernetes.io/projected/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-kube-api-access-r2js9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.039372 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.039268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.039696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.039669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.039763 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.039733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.039822 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.039740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.041598 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.041578    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.041867 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.041850    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.046263 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.046212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2js9\" (UniqueName: \"kubernetes.io/projected/6d6791cd-5d02-4bcc-b9ad-76f5cede7b36-kube-api-access-r2js9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2hhn\" (UID: \"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.113582 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.113552    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:47.383886 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.383857    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"]
Sep 17 00:45:47.385547 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:45:47.385517    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6791cd_5d02_4bcc_b9ad_76f5cede7b36.slice/crio-cb64aba0a2f0f63944beaf8f5521d43dadafb982a97876bfb664bbb4eb121e27 WatchSource:0}: Error finding container cb64aba0a2f0f63944beaf8f5521d43dadafb982a97876bfb664bbb4eb121e27: Status 404 returned error can't find the container with id cb64aba0a2f0f63944beaf8f5521d43dadafb982a97876bfb664bbb4eb121e27
Sep 17 00:45:47.969979 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:47.969923    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn" event={"ID":"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36","Type":"ContainerStarted","Data":"cb64aba0a2f0f63944beaf8f5521d43dadafb982a97876bfb664bbb4eb121e27"}
Sep 17 00:45:48.977823 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:48.977778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn" event={"ID":"6d6791cd-5d02-4bcc-b9ad-76f5cede7b36","Type":"ContainerStarted","Data":"e9c73c74e5c32fc55e8fd4daa699ec3d143bf03e96a9a5621de092c2a3ce57da"}
Sep 17 00:45:48.995793 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:48.995725    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn" podStartSLOduration=2.030657505 podStartE2EDuration="2.995701109s" totalImagesPullingTime="965.043604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:45:48.992608179 +0000 UTC m=+941.420066115" watchObservedRunningTime="2026-09-17 00:45:48.995701109 +0000 UTC m=+941.423159034"
Sep 17 00:45:57.114024 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:57.113986    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:57.114484 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:57.114052    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:57.126486 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:57.126453    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:45:58.033596 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:45:58.033569    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2hhn"
Sep 17 00:46:15.195306 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.195274    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"]
Sep 17 00:46:15.198645 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.198623    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.201048 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.201028    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 17 00:46:15.212090 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.212061    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"]
Sep 17 00:46:15.267037 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.267009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.267207 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.267051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.267207 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.267094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkxd6\" (UniqueName: \"kubernetes.io/projected/001305e4-e2d5-447f-bad3-79b263cc1290-kube-api-access-wkxd6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.267207 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.267156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/001305e4-e2d5-447f-bad3-79b263cc1290-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.267207 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.267203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.267473 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.267261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.368502 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.368473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkxd6\" (UniqueName: \"kubernetes.io/projected/001305e4-e2d5-447f-bad3-79b263cc1290-kube-api-access-wkxd6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.368657 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.368511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/001305e4-e2d5-447f-bad3-79b263cc1290-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.368657 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.368539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.368657 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.368585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.368657 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.368621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.368657 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.368647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.369003 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.368945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.369123 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.368999    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.369123 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.369092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.371415 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.371393    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/001305e4-e2d5-447f-bad3-79b263cc1290-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.371932 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.371910    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/001305e4-e2d5-447f-bad3-79b263cc1290-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.375932 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.375907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkxd6\" (UniqueName: \"kubernetes.io/projected/001305e4-e2d5-447f-bad3-79b263cc1290-kube-api-access-wkxd6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fzpd\" (UID: \"001305e4-e2d5-447f-bad3-79b263cc1290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.509019 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.508937    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:15.778927 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:15.778901    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"]
Sep 17 00:46:15.780467 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:46:15.780441    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001305e4_e2d5_447f_bad3_79b263cc1290.slice/crio-72a4dd1ffac5211f5d103592a8cf6c670ae1b05d200788bcd1675da19332029b WatchSource:0}: Error finding container 72a4dd1ffac5211f5d103592a8cf6c670ae1b05d200788bcd1675da19332029b: Status 404 returned error can't find the container with id 72a4dd1ffac5211f5d103592a8cf6c670ae1b05d200788bcd1675da19332029b
Sep 17 00:46:16.112872 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:16.112774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd" event={"ID":"001305e4-e2d5-447f-bad3-79b263cc1290","Type":"ContainerStarted","Data":"8c914d999cccfbef13efb36800df635aabaefc43cf4e2e4296516633f9555c80"}
Sep 17 00:46:16.112872 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:16.112836    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd" event={"ID":"001305e4-e2d5-447f-bad3-79b263cc1290","Type":"ContainerStarted","Data":"72a4dd1ffac5211f5d103592a8cf6c670ae1b05d200788bcd1675da19332029b"}
Sep 17 00:46:16.128566 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:16.128523    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd" podStartSLOduration=0.972488785 podStartE2EDuration="1.128506876s" totalImagesPullingTime="156.018091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:46:16.127350853 +0000 UTC m=+968.554808777" watchObservedRunningTime="2026-09-17 00:46:16.128506876 +0000 UTC m=+968.555964808"
Sep 17 00:46:25.510015 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:25.509973    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:25.510594 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:25.510037    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:25.522571 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:25.522549    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:26.173982 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:26.173939    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fzpd"
Sep 17 00:46:31.790456 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:31.790369    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"]
Sep 17 00:46:31.794452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:31.794431    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:31.796617 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:31.796598    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 17 00:46:31.804078 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:31.804056    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"]
Sep 17 00:46:31.912634 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:31.912599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:31.912838 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:31.912645    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:31.912838 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:31.912665    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:31.912838 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:31.912752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0479218-e479-446d-ab22-c7ed691dee84-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:31.912838 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:31.912809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4qxl\" (UniqueName: \"kubernetes.io/projected/c0479218-e479-446d-ab22-c7ed691dee84-kube-api-access-w4qxl\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:31.913017 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:31.912866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.014291 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.014260    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.014291 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.014296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.014481 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.014314    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.014481 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.014337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0479218-e479-446d-ab22-c7ed691dee84-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.014481 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.014379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4qxl\" (UniqueName: \"kubernetes.io/projected/c0479218-e479-446d-ab22-c7ed691dee84-kube-api-access-w4qxl\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.014481 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.014408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.014670 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.014628    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.014726 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.014699    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.014726 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.014718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.016730 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.016708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0479218-e479-446d-ab22-c7ed691dee84-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.017075 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.017058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0479218-e479-446d-ab22-c7ed691dee84-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.022029 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.022004    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4qxl\" (UniqueName: \"kubernetes.io/projected/c0479218-e479-446d-ab22-c7ed691dee84-kube-api-access-w4qxl\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v\" (UID: \"c0479218-e479-446d-ab22-c7ed691dee84\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.105184 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.105116    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:32.376372 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:32.376348    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"]
Sep 17 00:46:32.378328 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:46:32.378302    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0479218_e479_446d_ab22_c7ed691dee84.slice/crio-7104f1fca4ed12f33bec681ce360d2ed284c9bd58dd20bb3ed3a50334ace292b WatchSource:0}: Error finding container 7104f1fca4ed12f33bec681ce360d2ed284c9bd58dd20bb3ed3a50334ace292b: Status 404 returned error can't find the container with id 7104f1fca4ed12f33bec681ce360d2ed284c9bd58dd20bb3ed3a50334ace292b
Sep 17 00:46:33.198716 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:33.198683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v" event={"ID":"c0479218-e479-446d-ab22-c7ed691dee84","Type":"ContainerStarted","Data":"2b8e998f13fbddfa06536a2622db3db5261bed9695e375fe8d28ddcb1b86773e"}
Sep 17 00:46:33.199109 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:33.198722    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v" event={"ID":"c0479218-e479-446d-ab22-c7ed691dee84","Type":"ContainerStarted","Data":"7104f1fca4ed12f33bec681ce360d2ed284c9bd58dd20bb3ed3a50334ace292b"}
Sep 17 00:46:33.215625 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:33.215570    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v" podStartSLOduration=2.046531939 podStartE2EDuration="2.215554679s" totalImagesPullingTime="169.02274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:46:33.214198253 +0000 UTC m=+985.641656190" watchObservedRunningTime="2026-09-17 00:46:33.215554679 +0000 UTC m=+985.643012602"
Sep 17 00:46:42.105701 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:42.105667    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:42.106098 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:42.105724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:42.118146 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:42.118123    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:46:42.262401 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:46:42.262373    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v"
Sep 17 00:47:39.568828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:39.568783    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b89f8f88d-pl6ll"]
Sep 17 00:47:39.569788 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:39.569072    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5b89f8f88d-pl6ll" podUID="938323dd-aef4-4fc1-ba5d-33acbad6b678" containerName="authorino" containerID="cri-o://ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f" gracePeriod=30
Sep 17 00:47:39.813490 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:39.813470    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b89f8f88d-pl6ll"
Sep 17 00:47:39.880628 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:39.880552    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/938323dd-aef4-4fc1-ba5d-33acbad6b678-tls-cert\") pod \"938323dd-aef4-4fc1-ba5d-33acbad6b678\" (UID: \"938323dd-aef4-4fc1-ba5d-33acbad6b678\") "
Sep 17 00:47:39.880628 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:39.880593    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzbd6\" (UniqueName: \"kubernetes.io/projected/938323dd-aef4-4fc1-ba5d-33acbad6b678-kube-api-access-rzbd6\") pod \"938323dd-aef4-4fc1-ba5d-33acbad6b678\" (UID: \"938323dd-aef4-4fc1-ba5d-33acbad6b678\") "
Sep 17 00:47:39.882756 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:39.882729    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/938323dd-aef4-4fc1-ba5d-33acbad6b678-kube-api-access-rzbd6" (OuterVolumeSpecName: "kube-api-access-rzbd6") pod "938323dd-aef4-4fc1-ba5d-33acbad6b678" (UID: "938323dd-aef4-4fc1-ba5d-33acbad6b678"). InnerVolumeSpecName "kube-api-access-rzbd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:39.890513 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:39.890490    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/938323dd-aef4-4fc1-ba5d-33acbad6b678-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "938323dd-aef4-4fc1-ba5d-33acbad6b678" (UID: "938323dd-aef4-4fc1-ba5d-33acbad6b678"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:47:39.981953 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:39.981921    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzbd6\" (UniqueName: \"kubernetes.io/projected/938323dd-aef4-4fc1-ba5d-33acbad6b678-kube-api-access-rzbd6\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:47:39.981953 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:39.981947    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/938323dd-aef4-4fc1-ba5d-33acbad6b678-tls-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:47:40.543913 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:40.543823    2576 generic.go:356] "Generic (PLEG): container finished" podID="938323dd-aef4-4fc1-ba5d-33acbad6b678" containerID="ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f" exitCode=0
Sep 17 00:47:40.543913 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:40.543859    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b89f8f88d-pl6ll"
Sep 17 00:47:40.544150 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:40.543946    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b89f8f88d-pl6ll" event={"ID":"938323dd-aef4-4fc1-ba5d-33acbad6b678","Type":"ContainerDied","Data":"ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f"}
Sep 17 00:47:40.544150 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:40.544007    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b89f8f88d-pl6ll" event={"ID":"938323dd-aef4-4fc1-ba5d-33acbad6b678","Type":"ContainerDied","Data":"88068780717e26044c69d1c478e0168e5d74a98251fa13dd7959eaf36602dfa1"}
Sep 17 00:47:40.544150 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:40.544029    2576 scope.go:117] "RemoveContainer" containerID="ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f"
Sep 17 00:47:40.553761 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:40.553742    2576 scope.go:117] "RemoveContainer" containerID="ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f"
Sep 17 00:47:40.554051 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:47:40.554030    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f\": container with ID starting with ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f not found: ID does not exist" containerID="ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f"
Sep 17 00:47:40.554131 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:40.554058    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f"} err="failed to get container status \"ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f\": rpc error: code = NotFound desc = could not find container \"ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f\": container with ID starting with ba9e5377abb1d8e49f628263dcb81de948d955d815af91667d0e2ab281b3481f not found: ID does not exist"
Sep 17 00:47:40.559810 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:40.559788    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b89f8f88d-pl6ll"]
Sep 17 00:47:40.565282 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:40.565262    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b89f8f88d-pl6ll"]
Sep 17 00:47:42.141056 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:42.141024    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="938323dd-aef4-4fc1-ba5d-33acbad6b678" path="/var/lib/kubelet/pods/938323dd-aef4-4fc1-ba5d-33acbad6b678/volumes"
Sep 17 00:47:56.750273 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.750242    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"]
Sep 17 00:47:56.750644 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.750559    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="938323dd-aef4-4fc1-ba5d-33acbad6b678" containerName="authorino"
Sep 17 00:47:56.750644 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.750570    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="938323dd-aef4-4fc1-ba5d-33acbad6b678" containerName="authorino"
Sep 17 00:47:56.750644 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.750639    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="938323dd-aef4-4fc1-ba5d-33acbad6b678" containerName="authorino"
Sep 17 00:47:56.755195 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.755172    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.757438 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.757416    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-a79f56-openshift-default-dockercfg-g2xz6\""
Sep 17 00:47:56.763463 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.763438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"]
Sep 17 00:47:56.829406 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.829374    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5860f81-b169-4806-a905-371e98117a98-istio-podinfo\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.829600 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.829425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5860f81-b169-4806-a905-371e98117a98-istiod-ca-cert\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.829600 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.829462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-socket\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.829600 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.829495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cbbr\" (UniqueName: \"kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-kube-api-access-6cbbr\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.829600 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.829540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-certs\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.829600 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.829586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-envoy\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.829802 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.829651    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-istio-token\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.829802 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.829679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-data\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.829802 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.829720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-credential-socket\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.931112 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.931074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-istio-token\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.931318 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.931129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-data\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.931318 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.931170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-credential-socket\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.931318 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.931235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5860f81-b169-4806-a905-371e98117a98-istio-podinfo\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.931318 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.931274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5860f81-b169-4806-a905-371e98117a98-istiod-ca-cert\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.931318 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.931316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-socket\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.931580 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.931353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cbbr\" (UniqueName: \"kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-kube-api-access-6cbbr\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.931652 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.931624    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-certs\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.931712 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.931664    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-data\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.931712 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.931669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-envoy\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.931994 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.931844    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-socket\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.932154 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.932130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-certs\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.932262 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.932237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-credential-socket\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.932411 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.932386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5860f81-b169-4806-a905-371e98117a98-istiod-ca-cert\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.934346 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.934311    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5860f81-b169-4806-a905-371e98117a98-istio-podinfo\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.934462 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.934442    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-envoy\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.939441 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.939421    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-istio-token\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:56.939556 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:56.939460    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cbbr\" (UniqueName: \"kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-kube-api-access-6cbbr\") pod \"e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") " pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:57.067562 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:57.067475    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:57.343342 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:57.343317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"]
Sep 17 00:47:57.345177 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:47:57.345150    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5860f81_b169_4806_a905_371e98117a98.slice/crio-c95aa2633d0d412ff489098c2fc13909273d14c2c4b6b1ac5744c9cd1c34c5f1 WatchSource:0}: Error finding container c95aa2633d0d412ff489098c2fc13909273d14c2c4b6b1ac5744c9cd1c34c5f1: Status 404 returned error can't find the container with id c95aa2633d0d412ff489098c2fc13909273d14c2c4b6b1ac5744c9cd1c34c5f1
Sep 17 00:47:57.347362 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:57.347329    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:47:57.347468 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:57.347403    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:47:57.347468 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:57.347432    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:47:57.634018 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:57.633912    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" event={"ID":"a5860f81-b169-4806-a905-371e98117a98","Type":"ContainerStarted","Data":"e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce"}
Sep 17 00:47:57.634018 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:57.633974    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" event={"ID":"a5860f81-b169-4806-a905-371e98117a98","Type":"ContainerStarted","Data":"c95aa2633d0d412ff489098c2fc13909273d14c2c4b6b1ac5744c9cd1c34c5f1"}
Sep 17 00:47:57.652301 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:57.652254    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" podStartSLOduration=1.652238678 podStartE2EDuration="1.652238678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:47:57.65014652 +0000 UTC m=+1070.077604467" watchObservedRunningTime="2026-09-17 00:47:57.652238678 +0000 UTC m=+1070.079696600"
Sep 17 00:47:58.067740 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:58.067710    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:58.072541 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:58.072517    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:58.639188 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:58.639159    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:47:58.640298 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:47:58.640276    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:48:00.728620 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.728592    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"]
Sep 17 00:48:00.732173 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.732154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:00.734779 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.734619    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-a79f56-serving-cert\""
Sep 17 00:48:00.734875 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.734820    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gxvb4\""
Sep 17 00:48:00.744575 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.744555    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"]
Sep 17 00:48:00.761042 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.761017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:00.761185 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.761052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-metrics-certs\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:00.761185 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.761088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrh6t\" (UniqueName: \"kubernetes.io/projected/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-kube-api-access-nrh6t\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:00.761314 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.761197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:00.861806 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.861770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:00.861806 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.861805    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-metrics-certs\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:00.862080 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.861837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrh6t\" (UniqueName: \"kubernetes.io/projected/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-kube-api-access-nrh6t\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:00.862080 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.861896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:00.862080 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:48:00.861919    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-serving-cert: secret "maas-api-e2e-worker-w0-a79f56-serving-cert" not found
Sep 17 00:48:00.862080 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:48:00.862010    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-maas-api-tls podName:2e118ff2-c805-45c3-b170-0f55f7b3f6b2 nodeName:}" failed. No retries permitted until 2026-09-17 00:48:01.361988153 +0000 UTC m=+1073.789446055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-maas-api-tls") pod "maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7" (UID: "2e118ff2-c805-45c3-b170-0f55f7b3f6b2") : secret "maas-api-e2e-worker-w0-a79f56-serving-cert" not found
Sep 17 00:48:00.862644 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.862628    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:00.864397 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.864369    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-metrics-certs\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:00.869736 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:00.869713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrh6t\" (UniqueName: \"kubernetes.io/projected/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-kube-api-access-nrh6t\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:01.365882 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.365839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:01.368351 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.368326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:01.644573 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.644489    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:01.729100 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.729040    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"]
Sep 17 00:48:01.733907 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.733883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.736228 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.736170    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e491c5-serving-cert\""
Sep 17 00:48:01.742484 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.742425    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"]
Sep 17 00:48:01.768878 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.768850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-maas-api-tls\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.769039 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.768902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc890b2-6240-4493-aacf-0441e06a4a30-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.769039 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.769010    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-metrics-certs\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.769128 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.769052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9c6r\" (UniqueName: \"kubernetes.io/projected/5fc890b2-6240-4493-aacf-0441e06a4a30-kube-api-access-l9c6r\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.869595 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.869560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-maas-api-tls\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.869775 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.869622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc890b2-6240-4493-aacf-0441e06a4a30-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.869775 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.869655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-metrics-certs\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.869775 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.869685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c6r\" (UniqueName: \"kubernetes.io/projected/5fc890b2-6240-4493-aacf-0441e06a4a30-kube-api-access-l9c6r\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.869775 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:48:01.869708    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-serving-cert: secret "maas-api-e2e-inf-a-e491c5-serving-cert" not found
Sep 17 00:48:01.869775 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:48:01.869776    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-maas-api-tls podName:5fc890b2-6240-4493-aacf-0441e06a4a30 nodeName:}" failed. No retries permitted until 2026-09-17 00:48:02.369754667 +0000 UTC m=+1074.797212570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-maas-api-tls") pod "maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c" (UID: "5fc890b2-6240-4493-aacf-0441e06a4a30") : secret "maas-api-e2e-inf-a-e491c5-serving-cert" not found
Sep 17 00:48:01.870381 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.870356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc890b2-6240-4493-aacf-0441e06a4a30-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.872337 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.872316    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-metrics-certs\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.877651 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.877625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9c6r\" (UniqueName: \"kubernetes.io/projected/5fc890b2-6240-4493-aacf-0441e06a4a30-kube-api-access-l9c6r\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:01.926986 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:01.920912    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"]
Sep 17 00:48:02.374671 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.374576    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-maas-api-tls\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:02.377545 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.377512    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-maas-api-tls\") pod \"maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:02.377698 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.377676    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"]
Sep 17 00:48:02.381202 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.381182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:48:02.383439 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.383409    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-e491c5-dockercfg-tl6fh\""
Sep 17 00:48:02.383581 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.383463    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-e491c5\""
Sep 17 00:48:02.391013 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.390988    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"]
Sep 17 00:48:02.475171 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.475134    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8db8f98-a9cb-4aa3-883b-14731ada7445-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h\" (UID: \"d8db8f98-a9cb-4aa3-883b-14731ada7445\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:48:02.475351 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.475181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtfwk\" (UniqueName: \"kubernetes.io/projected/d8db8f98-a9cb-4aa3-883b-14731ada7445-kube-api-access-wtfwk\") pod \"payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h\" (UID: \"d8db8f98-a9cb-4aa3-883b-14731ada7445\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:48:02.576458 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.576424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8db8f98-a9cb-4aa3-883b-14731ada7445-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h\" (UID: \"d8db8f98-a9cb-4aa3-883b-14731ada7445\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:48:02.576458 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.576459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtfwk\" (UniqueName: \"kubernetes.io/projected/d8db8f98-a9cb-4aa3-883b-14731ada7445-kube-api-access-wtfwk\") pod \"payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h\" (UID: \"d8db8f98-a9cb-4aa3-883b-14731ada7445\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:48:02.577278 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.577255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8db8f98-a9cb-4aa3-883b-14731ada7445-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h\" (UID: \"d8db8f98-a9cb-4aa3-883b-14731ada7445\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:48:02.584223 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.584190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtfwk\" (UniqueName: \"kubernetes.io/projected/d8db8f98-a9cb-4aa3-883b-14731ada7445-kube-api-access-wtfwk\") pod \"payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h\" (UID: \"d8db8f98-a9cb-4aa3-883b-14731ada7445\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:48:02.649458 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.649431    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:02.664831 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.664799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7" event={"ID":"2e118ff2-c805-45c3-b170-0f55f7b3f6b2","Type":"ContainerStarted","Data":"02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468"}
Sep 17 00:48:02.664979 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.664853    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7" event={"ID":"2e118ff2-c805-45c3-b170-0f55f7b3f6b2","Type":"ContainerStarted","Data":"cb8724c97d9fbd038f4f3a1523ea3176a201f064bd70c67596f02435e659de56"}
Sep 17 00:48:02.664979 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.664880    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:02.680262 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.680211    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7" podStartSLOduration=2.215463989 podStartE2EDuration="2.680195762s" totalImagesPullingTime="464.731773ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:48:02.679042039 +0000 UTC m=+1075.106499965" watchObservedRunningTime="2026-09-17 00:48:02.680195762 +0000 UTC m=+1075.107653732"
Sep 17 00:48:02.696442 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.696418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:48:02.926026 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.925993    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"]
Sep 17 00:48:02.927369 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:48:02.927346    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc890b2_6240_4493_aacf_0441e06a4a30.slice/crio-845878771ea4024aa498e0d6f7ead4281c449f02c14a8385e2403f89a4179eb4 WatchSource:0}: Error finding container 845878771ea4024aa498e0d6f7ead4281c449f02c14a8385e2403f89a4179eb4: Status 404 returned error can't find the container with id 845878771ea4024aa498e0d6f7ead4281c449f02c14a8385e2403f89a4179eb4
Sep 17 00:48:02.979323 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:02.979299    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"]
Sep 17 00:48:02.981598 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:48:02.981570    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8db8f98_a9cb_4aa3_883b_14731ada7445.slice/crio-4ddad254158795343a85a6648fb7c412f91472d00b84064b257a60c88c025176 WatchSource:0}: Error finding container 4ddad254158795343a85a6648fb7c412f91472d00b84064b257a60c88c025176: Status 404 returned error can't find the container with id 4ddad254158795343a85a6648fb7c412f91472d00b84064b257a60c88c025176
Sep 17 00:48:03.238712 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.238692    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"]
Sep 17 00:48:03.242032 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.242013    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:48:03.244657 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.244633    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-f40754\""
Sep 17 00:48:03.244768 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.244746    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-f40754-dockercfg-d8z56\""
Sep 17 00:48:03.252638 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.252610    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"]
Sep 17 00:48:03.282920 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.282888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh\" (UID: \"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:48:03.283077 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.282980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfgqr\" (UniqueName: \"kubernetes.io/projected/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-kube-api-access-xfgqr\") pod \"payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh\" (UID: \"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:48:03.383945 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.383909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfgqr\" (UniqueName: \"kubernetes.io/projected/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-kube-api-access-xfgqr\") pod \"payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh\" (UID: \"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:48:03.384147 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.384077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh\" (UID: \"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:48:03.384775 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.384752    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh\" (UID: \"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:48:03.392408 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.392381    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfgqr\" (UniqueName: \"kubernetes.io/projected/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-kube-api-access-xfgqr\") pod \"payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh\" (UID: \"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:48:03.572026 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.571923    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:48:03.676679 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.676557    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c" event={"ID":"5fc890b2-6240-4493-aacf-0441e06a4a30","Type":"ContainerStarted","Data":"7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10"}
Sep 17 00:48:03.676883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.676832    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:03.676883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.676870    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c" event={"ID":"5fc890b2-6240-4493-aacf-0441e06a4a30","Type":"ContainerStarted","Data":"845878771ea4024aa498e0d6f7ead4281c449f02c14a8385e2403f89a4179eb4"}
Sep 17 00:48:03.678715 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.678691    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h" event={"ID":"d8db8f98-a9cb-4aa3-883b-14731ada7445","Type":"ContainerStarted","Data":"554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267"}
Sep 17 00:48:03.678844 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.678732    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h" event={"ID":"d8db8f98-a9cb-4aa3-883b-14731ada7445","Type":"ContainerStarted","Data":"4ddad254158795343a85a6648fb7c412f91472d00b84064b257a60c88c025176"}
Sep 17 00:48:03.678844 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.678787    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:48:03.692106 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.692059    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c" podStartSLOduration=2.38735718 podStartE2EDuration="2.692040609s" totalImagesPullingTime="304.683429ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:48:03.690753932 +0000 UTC m=+1076.118211851" watchObservedRunningTime="2026-09-17 00:48:03.692040609 +0000 UTC m=+1076.119498537"
Sep 17 00:48:03.707496 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.707456    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h" podStartSLOduration=1.707444529 podStartE2EDuration="1.707444529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:48:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:48:03.705984542 +0000 UTC m=+1076.133442466" watchObservedRunningTime="2026-09-17 00:48:03.707444529 +0000 UTC m=+1076.134902451"
Sep 17 00:48:03.845998 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:03.845949    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"]
Sep 17 00:48:03.846780 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:48:03.846751    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0d4e01_7fa0_4f01_b9c6_c1032f3e6ea8.slice/crio-244ab5187750c6b859646ee4375fae9ddf1a6254abdac8243a9d251ab70daff1 WatchSource:0}: Error finding container 244ab5187750c6b859646ee4375fae9ddf1a6254abdac8243a9d251ab70daff1: Status 404 returned error can't find the container with id 244ab5187750c6b859646ee4375fae9ddf1a6254abdac8243a9d251ab70daff1
Sep 17 00:48:04.696192 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:04.696157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh" event={"ID":"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8","Type":"ContainerStarted","Data":"f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f"}
Sep 17 00:48:04.696638 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:04.696245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh" event={"ID":"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8","Type":"ContainerStarted","Data":"244ab5187750c6b859646ee4375fae9ddf1a6254abdac8243a9d251ab70daff1"}
Sep 17 00:48:04.696638 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:04.696372    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:48:04.713411 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:04.713357    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh" podStartSLOduration=1.7133423429999999 podStartE2EDuration="1.713342343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:48:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:48:04.711213171 +0000 UTC m=+1077.138671095" watchObservedRunningTime="2026-09-17 00:48:04.713342343 +0000 UTC m=+1077.140800291"
Sep 17 00:48:04.996226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:04.996133    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"]
Sep 17 00:48:04.999779 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:04.999756    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.002732 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.002711    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-6af38a-openshift-default-dockercfg-jgt5j\""
Sep 17 00:48:05.010297 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.010272    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"]
Sep 17 00:48:05.100871 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.100828    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-envoy\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.101125 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.100894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-podinfo\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.101125 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.100926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-data\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.101125 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.100983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b689e1ca-de94-45ab-bedc-ee664d76a62a-istiod-ca-cert\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.101125 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.101030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-socket\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.101125 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.101056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-credential-socket\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.101125 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.101102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2f75\" (UniqueName: \"kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-kube-api-access-g2f75\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.101387 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.101135    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-certs\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.101387 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.101183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-token\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.202447 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.202413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b689e1ca-de94-45ab-bedc-ee664d76a62a-istiod-ca-cert\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.202638 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.202462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-socket\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.202638 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.202489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-credential-socket\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.202638 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.202537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2f75\" (UniqueName: \"kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-kube-api-access-g2f75\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.202638 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.202574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-certs\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.202638 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.202599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-token\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.202897 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.202663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-envoy\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.202897 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.202728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-podinfo\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.202897 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.202765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-data\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.203214 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.203188    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-data\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.203293 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.203226    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-certs\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.203293 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.203245    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b689e1ca-de94-45ab-bedc-ee664d76a62a-istiod-ca-cert\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.203496 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.203445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-credential-socket\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.203691 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.203667    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-socket\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.206059 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.205886    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-envoy\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.206205 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.206117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-podinfo\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.213307 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.213274    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-token\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.213418 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.213368    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2f75\" (UniqueName: \"kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-kube-api-access-g2f75\") pod \"e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") " pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.314237 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.314143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:05.600575 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.600544    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"]
Sep 17 00:48:05.602136 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:48:05.602103    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb689e1ca_de94_45ab_bedc_ee664d76a62a.slice/crio-586a5b0eaee98da9d6411885c04400c5d499fc78afae52e0430c2b48c73a087a WatchSource:0}: Error finding container 586a5b0eaee98da9d6411885c04400c5d499fc78afae52e0430c2b48c73a087a: Status 404 returned error can't find the container with id 586a5b0eaee98da9d6411885c04400c5d499fc78afae52e0430c2b48c73a087a
Sep 17 00:48:05.604863 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.604824    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:48:05.605003 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.604919    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:48:05.605087 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.605008    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:48:05.705282 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.705239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" event={"ID":"b689e1ca-de94-45ab-bedc-ee664d76a62a","Type":"ContainerStarted","Data":"b485ae7c1c2cb5bc073222bacbf24632acfc40640a1c73746ce79dc82a7e89d0"}
Sep 17 00:48:05.705740 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.705308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" event={"ID":"b689e1ca-de94-45ab-bedc-ee664d76a62a","Type":"ContainerStarted","Data":"586a5b0eaee98da9d6411885c04400c5d499fc78afae52e0430c2b48c73a087a"}
Sep 17 00:48:05.725952 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:05.725817    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" podStartSLOduration=1.7257974539999998 podStartE2EDuration="1.725797454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:48:05.72511269 +0000 UTC m=+1078.152570626" watchObservedRunningTime="2026-09-17 00:48:05.725797454 +0000 UTC m=+1078.153255379"
Sep 17 00:48:06.314567 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:06.314534    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:06.319422 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:06.319399    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:06.711509 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:06.711474    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:06.712456 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:06.712439    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:08.684748 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:08.684717    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:48:09.701704 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:09.701677    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:48:10.690386 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:10.690346    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"]
Sep 17 00:48:10.701786 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:10.701751    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:10.703248 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:10.703224    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"]
Sep 17 00:48:10.704143 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:10.704123    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8fd93c3d\""
Sep 17 00:48:10.704407 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:10.704391    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8fd93c3d-dockercfg-pwbbj\""
Sep 17 00:48:10.757565 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:10.757530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27svx\" (UniqueName: \"kubernetes.io/projected/c7ba392c-8575-4865-a524-25a05f31471d-kube-api-access-27svx\") pod \"payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92\" (UID: \"c7ba392c-8575-4865-a524-25a05f31471d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:10.757565 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:10.757569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ba392c-8575-4865-a524-25a05f31471d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92\" (UID: \"c7ba392c-8575-4865-a524-25a05f31471d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:10.858821 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:10.858783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27svx\" (UniqueName: \"kubernetes.io/projected/c7ba392c-8575-4865-a524-25a05f31471d-kube-api-access-27svx\") pod \"payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92\" (UID: \"c7ba392c-8575-4865-a524-25a05f31471d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:10.859154 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:10.858840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ba392c-8575-4865-a524-25a05f31471d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92\" (UID: \"c7ba392c-8575-4865-a524-25a05f31471d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:10.859853 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:10.859822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ba392c-8575-4865-a524-25a05f31471d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92\" (UID: \"c7ba392c-8575-4865-a524-25a05f31471d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:10.868793 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:10.868759    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27svx\" (UniqueName: \"kubernetes.io/projected/c7ba392c-8575-4865-a524-25a05f31471d-kube-api-access-27svx\") pod \"payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92\" (UID: \"c7ba392c-8575-4865-a524-25a05f31471d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:11.013721 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.013626    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:11.296719 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.296617    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"]
Sep 17 00:48:11.300508 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:48:11.300475    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ba392c_8575_4865_a524_25a05f31471d.slice/crio-3249a038a4f54120a8bef95b3ce00b1d7bee586fc6f6c89b21eadcb7d5c96f7c WatchSource:0}: Error finding container 3249a038a4f54120a8bef95b3ce00b1d7bee586fc6f6c89b21eadcb7d5c96f7c: Status 404 returned error can't find the container with id 3249a038a4f54120a8bef95b3ce00b1d7bee586fc6f6c89b21eadcb7d5c96f7c
Sep 17 00:48:11.748480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.748432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92" event={"ID":"c7ba392c-8575-4865-a524-25a05f31471d","Type":"ContainerStarted","Data":"f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e"}
Sep 17 00:48:11.748951 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.748672    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:11.748951 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.748732    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92" event={"ID":"c7ba392c-8575-4865-a524-25a05f31471d","Type":"ContainerStarted","Data":"3249a038a4f54120a8bef95b3ce00b1d7bee586fc6f6c89b21eadcb7d5c96f7c"}
Sep 17 00:48:11.765927 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.765882    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92" podStartSLOduration=1.765864728 podStartE2EDuration="1.765864728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:48:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:48:11.763997713 +0000 UTC m=+1084.191455637" watchObservedRunningTime="2026-09-17 00:48:11.765864728 +0000 UTC m=+1084.193322651"
Sep 17 00:48:11.881062 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.880375    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"]
Sep 17 00:48:11.884714 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.884686    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:48:11.888873 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.888840    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-6af38a\""
Sep 17 00:48:11.897124 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.897090    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"]
Sep 17 00:48:11.920406 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.920377    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"]
Sep 17 00:48:11.923809 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.923793    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:48:11.927065 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.927033    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-6af38a-dockercfg-dnm97\""
Sep 17 00:48:11.936178 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.936157    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"]
Sep 17 00:48:11.969283 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.969258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dnml\" (UniqueName: \"kubernetes.io/projected/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-kube-api-access-2dnml\") pod \"payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk\" (UID: \"463c5cc2-8e29-45ca-9f90-b3ca01dc0548\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:48:11.969405 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.969309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk\" (UID: \"463c5cc2-8e29-45ca-9f90-b3ca01dc0548\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:48:11.969405 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.969385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb0ccb70-75b1-4809-be1a-dabdc1373517-plugins-config-volume\") pod \"payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf\" (UID: \"fb0ccb70-75b1-4809-be1a-dabdc1373517\") " pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:48:11.969515 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:11.969425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bslf2\" (UniqueName: \"kubernetes.io/projected/fb0ccb70-75b1-4809-be1a-dabdc1373517-kube-api-access-bslf2\") pod \"payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf\" (UID: \"fb0ccb70-75b1-4809-be1a-dabdc1373517\") " pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:48:12.070692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.070587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dnml\" (UniqueName: \"kubernetes.io/projected/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-kube-api-access-2dnml\") pod \"payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk\" (UID: \"463c5cc2-8e29-45ca-9f90-b3ca01dc0548\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:48:12.070692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.070674    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk\" (UID: \"463c5cc2-8e29-45ca-9f90-b3ca01dc0548\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:48:12.070935 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.070710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb0ccb70-75b1-4809-be1a-dabdc1373517-plugins-config-volume\") pod \"payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf\" (UID: \"fb0ccb70-75b1-4809-be1a-dabdc1373517\") " pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:48:12.070935 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.070738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bslf2\" (UniqueName: \"kubernetes.io/projected/fb0ccb70-75b1-4809-be1a-dabdc1373517-kube-api-access-bslf2\") pod \"payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf\" (UID: \"fb0ccb70-75b1-4809-be1a-dabdc1373517\") " pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:48:12.072038 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.071925    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb0ccb70-75b1-4809-be1a-dabdc1373517-plugins-config-volume\") pod \"payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf\" (UID: \"fb0ccb70-75b1-4809-be1a-dabdc1373517\") " pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:48:12.072038 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.071947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk\" (UID: \"463c5cc2-8e29-45ca-9f90-b3ca01dc0548\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:48:12.079296 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.079270    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bslf2\" (UniqueName: \"kubernetes.io/projected/fb0ccb70-75b1-4809-be1a-dabdc1373517-kube-api-access-bslf2\") pod \"payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf\" (UID: \"fb0ccb70-75b1-4809-be1a-dabdc1373517\") " pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:48:12.079474 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.079444    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dnml\" (UniqueName: \"kubernetes.io/projected/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-kube-api-access-2dnml\") pod \"payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk\" (UID: \"463c5cc2-8e29-45ca-9f90-b3ca01dc0548\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:48:12.208657 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.208627    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:48:12.233996 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.233969    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:48:12.496508 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:48:12.496476    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463c5cc2_8e29_45ca_9f90_b3ca01dc0548.slice/crio-3674b2e756fccaad62d744e93a02e088136ecf42dcfd0d45ba057d2864274553 WatchSource:0}: Error finding container 3674b2e756fccaad62d744e93a02e088136ecf42dcfd0d45ba057d2864274553: Status 404 returned error can't find the container with id 3674b2e756fccaad62d744e93a02e088136ecf42dcfd0d45ba057d2864274553
Sep 17 00:48:12.497265 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.497237    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"]
Sep 17 00:48:12.554658 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.554630    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"]
Sep 17 00:48:12.555912 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:48:12.555887    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb0ccb70_75b1_4809_be1a_dabdc1373517.slice/crio-e8dbe3a39209764e4edd967c9f0f3e488180be1d05d4747c619e3a3aabe7a010 WatchSource:0}: Error finding container e8dbe3a39209764e4edd967c9f0f3e488180be1d05d4747c619e3a3aabe7a010: Status 404 returned error can't find the container with id e8dbe3a39209764e4edd967c9f0f3e488180be1d05d4747c619e3a3aabe7a010
Sep 17 00:48:12.756568 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.756532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk" event={"ID":"463c5cc2-8e29-45ca-9f90-b3ca01dc0548","Type":"ContainerStarted","Data":"1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2"}
Sep 17 00:48:12.757061 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.756586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk" event={"ID":"463c5cc2-8e29-45ca-9f90-b3ca01dc0548","Type":"ContainerStarted","Data":"3674b2e756fccaad62d744e93a02e088136ecf42dcfd0d45ba057d2864274553"}
Sep 17 00:48:12.757061 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.756671    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:48:12.758417 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.758390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf" event={"ID":"fb0ccb70-75b1-4809-be1a-dabdc1373517","Type":"ContainerStarted","Data":"0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d"}
Sep 17 00:48:12.758533 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.758440    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf" event={"ID":"fb0ccb70-75b1-4809-be1a-dabdc1373517","Type":"ContainerStarted","Data":"e8dbe3a39209764e4edd967c9f0f3e488180be1d05d4747c619e3a3aabe7a010"}
Sep 17 00:48:12.787374 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:12.787136    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk" podStartSLOduration=1.787115255 podStartE2EDuration="1.787115255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:48:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:48:12.78231303 +0000 UTC m=+1085.209770955" watchObservedRunningTime="2026-09-17 00:48:12.787115255 +0000 UTC m=+1085.214573181"
Sep 17 00:48:13.764168 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:13.764126    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:48:14.701257 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:14.701162    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:48:14.718022 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:14.717952    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf" podStartSLOduration=3.717933196 podStartE2EDuration="3.717933196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:48:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:48:12.800109226 +0000 UTC m=+1085.227567150" watchObservedRunningTime="2026-09-17 00:48:14.717933196 +0000 UTC m=+1087.145391119"
Sep 17 00:48:15.707853 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:15.707716    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:48:19.818858 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:19.818824    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5860f81-b169-4806-a905-371e98117a98" containerID="e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce" exitCode=0
Sep 17 00:48:19.819412 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:19.818900    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" event={"ID":"a5860f81-b169-4806-a905-371e98117a98","Type":"ContainerDied","Data":"e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce"}
Sep 17 00:48:19.819492 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:19.819424    2576 scope.go:117] "RemoveContainer" containerID="e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce"
Sep 17 00:48:19.820560 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:19.820531    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:48:19.820642 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:19.820612    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:48:19.820696 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:19.820645    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:48:20.826975 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:20.826929    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" event={"ID":"a5860f81-b169-4806-a905-371e98117a98","Type":"ContainerStarted","Data":"4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3"}
Sep 17 00:48:21.068746 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:21.068714    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:48:21.068979 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:21.068934    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 17 00:48:21.069127 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:21.069014    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 17 00:48:22.068532 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:22.068494    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 17 00:48:22.068936 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:22.068551    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 17 00:48:22.761634 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:22.761605    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:23.068383 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:23.068301    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 17 00:48:23.068383 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:23.068354    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 17 00:48:23.765702 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:23.765675    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:48:24.067972 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:24.067870    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 17 00:48:24.067972 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:24.067928    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 17 00:48:24.790520 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:24.790478    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:48:25.068589 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:25.068506    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 17 00:48:25.068750 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:25.068581    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 17 00:48:26.130360 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:26.130310    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:48:26.131250 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:26.131225    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:48:26.132067 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:26.132017    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:48:27.315695 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.315661    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"]
Sep 17 00:48:27.319322 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.319305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:48:27.321464 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.321435    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-e421ba\""
Sep 17 00:48:27.321634 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.321615    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-e421ba-dockercfg-85fhj\""
Sep 17 00:48:27.330471 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.330408    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"]
Sep 17 00:48:27.463552 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.463516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44be4eda-81b6-4163-9cb2-7daed82b049f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6\" (UID: \"44be4eda-81b6-4163-9cb2-7daed82b049f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:48:27.463552 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.463552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk6mt\" (UniqueName: \"kubernetes.io/projected/44be4eda-81b6-4163-9cb2-7daed82b049f-kube-api-access-rk6mt\") pod \"payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6\" (UID: \"44be4eda-81b6-4163-9cb2-7daed82b049f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:48:27.564288 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.564249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44be4eda-81b6-4163-9cb2-7daed82b049f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6\" (UID: \"44be4eda-81b6-4163-9cb2-7daed82b049f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:48:27.564288 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.564287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk6mt\" (UniqueName: \"kubernetes.io/projected/44be4eda-81b6-4163-9cb2-7daed82b049f-kube-api-access-rk6mt\") pod \"payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6\" (UID: \"44be4eda-81b6-4163-9cb2-7daed82b049f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:48:27.564974 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.564943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44be4eda-81b6-4163-9cb2-7daed82b049f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6\" (UID: \"44be4eda-81b6-4163-9cb2-7daed82b049f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:48:27.580656 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.580574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk6mt\" (UniqueName: \"kubernetes.io/projected/44be4eda-81b6-4163-9cb2-7daed82b049f-kube-api-access-rk6mt\") pod \"payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6\" (UID: \"44be4eda-81b6-4163-9cb2-7daed82b049f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:48:27.629982 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.629925    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:48:27.952918 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:27.952895    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"]
Sep 17 00:48:27.954272 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:48:27.954246    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44be4eda_81b6_4163_9cb2_7daed82b049f.slice/crio-12ae15552d529dc366f70872fd2c172048d315f49c8562422b8d87a9fa1da4f0 WatchSource:0}: Error finding container 12ae15552d529dc366f70872fd2c172048d315f49c8562422b8d87a9fa1da4f0: Status 404 returned error can't find the container with id 12ae15552d529dc366f70872fd2c172048d315f49c8562422b8d87a9fa1da4f0
Sep 17 00:48:28.886092 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:28.886055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6" event={"ID":"44be4eda-81b6-4163-9cb2-7daed82b049f","Type":"ContainerStarted","Data":"355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c"}
Sep 17 00:48:28.886660 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:28.886638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6" event={"ID":"44be4eda-81b6-4163-9cb2-7daed82b049f","Type":"ContainerStarted","Data":"12ae15552d529dc366f70872fd2c172048d315f49c8562422b8d87a9fa1da4f0"}
Sep 17 00:48:28.887531 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:28.887511    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:48:28.904236 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:28.904189    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6" podStartSLOduration=1.904177215 podStartE2EDuration="1.904177215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:48:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:48:28.901844116 +0000 UTC m=+1101.329302076" watchObservedRunningTime="2026-09-17 00:48:28.904177215 +0000 UTC m=+1101.331635195"
Sep 17 00:48:32.832809 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:32.832770    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"]
Sep 17 00:48:32.833384 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:32.833053    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92" podUID="c7ba392c-8575-4865-a524-25a05f31471d" containerName="payload-pre-processing" containerID="cri-o://f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e" gracePeriod=30
Sep 17 00:48:32.913424 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:32.913389    2576 generic.go:356] "Generic (PLEG): container finished" podID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerID="b485ae7c1c2cb5bc073222bacbf24632acfc40640a1c73746ce79dc82a7e89d0" exitCode=0
Sep 17 00:48:32.913424 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:32.913426    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" event={"ID":"b689e1ca-de94-45ab-bedc-ee664d76a62a","Type":"ContainerDied","Data":"b485ae7c1c2cb5bc073222bacbf24632acfc40640a1c73746ce79dc82a7e89d0"}
Sep 17 00:48:32.913805 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:32.913789    2576 scope.go:117] "RemoveContainer" containerID="b485ae7c1c2cb5bc073222bacbf24632acfc40640a1c73746ce79dc82a7e89d0"
Sep 17 00:48:32.914897 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:32.914867    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:48:32.915015 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:32.914975    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:48:32.915091 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:32.915031    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:48:33.134180 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.134152    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:33.322537 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.322506    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27svx\" (UniqueName: \"kubernetes.io/projected/c7ba392c-8575-4865-a524-25a05f31471d-kube-api-access-27svx\") pod \"c7ba392c-8575-4865-a524-25a05f31471d\" (UID: \"c7ba392c-8575-4865-a524-25a05f31471d\") "
Sep 17 00:48:33.322733 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.322572    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ba392c-8575-4865-a524-25a05f31471d-plugins-config-volume\") pod \"c7ba392c-8575-4865-a524-25a05f31471d\" (UID: \"c7ba392c-8575-4865-a524-25a05f31471d\") "
Sep 17 00:48:33.322981 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.322933    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ba392c-8575-4865-a524-25a05f31471d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c7ba392c-8575-4865-a524-25a05f31471d" (UID: "c7ba392c-8575-4865-a524-25a05f31471d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:48:33.324729 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.324707    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ba392c-8575-4865-a524-25a05f31471d-kube-api-access-27svx" (OuterVolumeSpecName: "kube-api-access-27svx") pod "c7ba392c-8575-4865-a524-25a05f31471d" (UID: "c7ba392c-8575-4865-a524-25a05f31471d"). InnerVolumeSpecName "kube-api-access-27svx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:48:33.423763 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.423729    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27svx\" (UniqueName: \"kubernetes.io/projected/c7ba392c-8575-4865-a524-25a05f31471d-kube-api-access-27svx\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:48:33.423763 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.423762    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ba392c-8575-4865-a524-25a05f31471d-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:48:33.921630 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.921588    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" event={"ID":"b689e1ca-de94-45ab-bedc-ee664d76a62a","Type":"ContainerStarted","Data":"c3831dd4eafbecce5f983035ad616224a750b276b6a05146a817c897eb146115"}
Sep 17 00:48:33.923100 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.923076    2576 generic.go:356] "Generic (PLEG): container finished" podID="c7ba392c-8575-4865-a524-25a05f31471d" containerID="f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e" exitCode=0
Sep 17 00:48:33.923241 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.923118    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"
Sep 17 00:48:33.923241 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.923158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92" event={"ID":"c7ba392c-8575-4865-a524-25a05f31471d","Type":"ContainerDied","Data":"f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e"}
Sep 17 00:48:33.923241 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.923205    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92" event={"ID":"c7ba392c-8575-4865-a524-25a05f31471d","Type":"ContainerDied","Data":"3249a038a4f54120a8bef95b3ce00b1d7bee586fc6f6c89b21eadcb7d5c96f7c"}
Sep 17 00:48:33.923241 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.923227    2576 scope.go:117] "RemoveContainer" containerID="f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e"
Sep 17 00:48:33.933065 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.933045    2576 scope.go:117] "RemoveContainer" containerID="f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e"
Sep 17 00:48:33.933317 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:48:33.933300    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e\": container with ID starting with f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e not found: ID does not exist" containerID="f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e"
Sep 17 00:48:33.933367 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.933325    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e"} err="failed to get container status \"f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e\": rpc error: code = NotFound desc = could not find container \"f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e\": container with ID starting with f0aef1534dc3dcbc3dd23749dca564afce49c06f6e0fac3fcba5c6cf194b354e not found: ID does not exist"
Sep 17 00:48:33.990416 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.990376    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"]
Sep 17 00:48:33.994656 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:33.994620    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8fd93c3d-586898d598-wrh92"]
Sep 17 00:48:34.142737 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:34.142708    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ba392c-8575-4865-a524-25a05f31471d" path="/var/lib/kubelet/pods/c7ba392c-8575-4865-a524-25a05f31471d/volumes"
Sep 17 00:48:34.315169 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:34.315088    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:34.316263 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:34.316237    2576 patch_prober.go:28] interesting pod/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 17 00:48:34.316399 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:34.316288    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 17 00:48:35.315104 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:35.315073    2576 patch_prober.go:28] interesting pod/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 17 00:48:35.315500 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:35.315128    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 17 00:48:36.314735 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:36.314700    2576 patch_prober.go:28] interesting pod/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 17 00:48:36.314912 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:36.314753    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 17 00:48:36.711855 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:36.711820    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:37.314820 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:37.314788    2576 patch_prober.go:28] interesting pod/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 17 00:48:37.314992 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:37.314843    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 17 00:48:38.315665 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:38.315627    2576 patch_prober.go:28] interesting pod/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 17 00:48:38.316096 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:38.315688    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 17 00:48:39.411781 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.411749    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:39.413265 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.413237    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:48:39.431743 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.431706    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"]
Sep 17 00:48:39.432332 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.432313    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ba392c-8575-4865-a524-25a05f31471d" containerName="payload-pre-processing"
Sep 17 00:48:39.432380 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.432337    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ba392c-8575-4865-a524-25a05f31471d" containerName="payload-pre-processing"
Sep 17 00:48:39.432450 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.432439    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ba392c-8575-4865-a524-25a05f31471d" containerName="payload-pre-processing"
Sep 17 00:48:39.437739 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.437714    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:48:39.442393 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.442366    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-ef36871b\""
Sep 17 00:48:39.442623 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.442606    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-ef36871b-dockercfg-9wnj5\""
Sep 17 00:48:39.448790 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.448759    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"]
Sep 17 00:48:39.474128 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.474091    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64qxt\" (UniqueName: \"kubernetes.io/projected/5db594ab-dab4-4838-baa5-e3577ce30bb5-kube-api-access-64qxt\") pod \"payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb\" (UID: \"5db594ab-dab4-4838-baa5-e3577ce30bb5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:48:39.474341 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.474250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5db594ab-dab4-4838-baa5-e3577ce30bb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb\" (UID: \"5db594ab-dab4-4838-baa5-e3577ce30bb5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:48:39.575661 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.575622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5db594ab-dab4-4838-baa5-e3577ce30bb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb\" (UID: \"5db594ab-dab4-4838-baa5-e3577ce30bb5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:48:39.577052 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.577024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64qxt\" (UniqueName: \"kubernetes.io/projected/5db594ab-dab4-4838-baa5-e3577ce30bb5-kube-api-access-64qxt\") pod \"payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb\" (UID: \"5db594ab-dab4-4838-baa5-e3577ce30bb5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:48:39.577765 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.576836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5db594ab-dab4-4838-baa5-e3577ce30bb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb\" (UID: \"5db594ab-dab4-4838-baa5-e3577ce30bb5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:48:39.586083 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.586054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64qxt\" (UniqueName: \"kubernetes.io/projected/5db594ab-dab4-4838-baa5-e3577ce30bb5-kube-api-access-64qxt\") pod \"payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb\" (UID: \"5db594ab-dab4-4838-baa5-e3577ce30bb5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:48:39.752268 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:39.752183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:48:40.040809 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:40.040281    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"]
Sep 17 00:48:40.049985 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:48:40.049922    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db594ab_dab4_4838_baa5_e3577ce30bb5.slice/crio-57177b5ab0126243ce91d25077cbf9210ffc2eb4aa93a64406e58348fb63879f WatchSource:0}: Error finding container 57177b5ab0126243ce91d25077cbf9210ffc2eb4aa93a64406e58348fb63879f: Status 404 returned error can't find the container with id 57177b5ab0126243ce91d25077cbf9210ffc2eb4aa93a64406e58348fb63879f
Sep 17 00:48:40.903033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:40.903000    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:48:40.967311 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:40.967280    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb" event={"ID":"5db594ab-dab4-4838-baa5-e3577ce30bb5","Type":"ContainerStarted","Data":"007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6"}
Sep 17 00:48:40.967496 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:40.967345    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb" event={"ID":"5db594ab-dab4-4838-baa5-e3577ce30bb5","Type":"ContainerStarted","Data":"57177b5ab0126243ce91d25077cbf9210ffc2eb4aa93a64406e58348fb63879f"}
Sep 17 00:48:40.967496 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:40.967375    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:48:40.986778 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:40.986729    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb" podStartSLOduration=1.986711517 podStartE2EDuration="1.986711517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:48:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:48:40.983476937 +0000 UTC m=+1113.410934872" watchObservedRunningTime="2026-09-17 00:48:40.986711517 +0000 UTC m=+1113.414169440"
Sep 17 00:48:51.975731 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:48:51.975704    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:49:08.733284 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:08.733202    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"]
Sep 17 00:49:08.733744 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:08.733433    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb" podUID="5db594ab-dab4-4838-baa5-e3577ce30bb5" containerName="payload-pre-processing" containerID="cri-o://007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6" gracePeriod=30
Sep 17 00:49:08.995419 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:08.995321    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:49:09.131644 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.131608    2576 generic.go:356] "Generic (PLEG): container finished" podID="5db594ab-dab4-4838-baa5-e3577ce30bb5" containerID="007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6" exitCode=0
Sep 17 00:49:09.131644 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.131652    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"
Sep 17 00:49:09.131917 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.131693    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb" event={"ID":"5db594ab-dab4-4838-baa5-e3577ce30bb5","Type":"ContainerDied","Data":"007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6"}
Sep 17 00:49:09.131917 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.131748    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb" event={"ID":"5db594ab-dab4-4838-baa5-e3577ce30bb5","Type":"ContainerDied","Data":"57177b5ab0126243ce91d25077cbf9210ffc2eb4aa93a64406e58348fb63879f"}
Sep 17 00:49:09.131917 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.131778    2576 scope.go:117] "RemoveContainer" containerID="007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6"
Sep 17 00:49:09.140980 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.140949    2576 scope.go:117] "RemoveContainer" containerID="007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6"
Sep 17 00:49:09.141267 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:49:09.141247    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6\": container with ID starting with 007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6 not found: ID does not exist" containerID="007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6"
Sep 17 00:49:09.141327 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.141280    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6"} err="failed to get container status \"007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6\": rpc error: code = NotFound desc = could not find container \"007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6\": container with ID starting with 007309af487271d1ed33443e0e92f5fa4d8ce820a37a77d0d0ac139f313b0df6 not found: ID does not exist"
Sep 17 00:49:09.162632 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.162609    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5db594ab-dab4-4838-baa5-e3577ce30bb5-plugins-config-volume\") pod \"5db594ab-dab4-4838-baa5-e3577ce30bb5\" (UID: \"5db594ab-dab4-4838-baa5-e3577ce30bb5\") "
Sep 17 00:49:09.162715 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.162647    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64qxt\" (UniqueName: \"kubernetes.io/projected/5db594ab-dab4-4838-baa5-e3577ce30bb5-kube-api-access-64qxt\") pod \"5db594ab-dab4-4838-baa5-e3577ce30bb5\" (UID: \"5db594ab-dab4-4838-baa5-e3577ce30bb5\") "
Sep 17 00:49:09.163026 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.163003    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5db594ab-dab4-4838-baa5-e3577ce30bb5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5db594ab-dab4-4838-baa5-e3577ce30bb5" (UID: "5db594ab-dab4-4838-baa5-e3577ce30bb5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:49:09.164796 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.164771    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db594ab-dab4-4838-baa5-e3577ce30bb5-kube-api-access-64qxt" (OuterVolumeSpecName: "kube-api-access-64qxt") pod "5db594ab-dab4-4838-baa5-e3577ce30bb5" (UID: "5db594ab-dab4-4838-baa5-e3577ce30bb5"). InnerVolumeSpecName "kube-api-access-64qxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:49:09.264407 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.264322    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64qxt\" (UniqueName: \"kubernetes.io/projected/5db594ab-dab4-4838-baa5-e3577ce30bb5-kube-api-access-64qxt\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:49:09.264407 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.264351    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5db594ab-dab4-4838-baa5-e3577ce30bb5-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:49:09.466833 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.466803    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"]
Sep 17 00:49:09.472681 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:09.472654    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ef36871b-576854bbc4-cj8qb"]
Sep 17 00:49:10.142041 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:10.142012    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5db594ab-dab4-4838-baa5-e3577ce30bb5" path="/var/lib/kubelet/pods/5db594ab-dab4-4838-baa5-e3577ce30bb5/volumes"
Sep 17 00:49:14.646542 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.646509    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"]
Sep 17 00:49:14.647007 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.646916    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db594ab-dab4-4838-baa5-e3577ce30bb5" containerName="payload-pre-processing"
Sep 17 00:49:14.647007 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.646928    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db594ab-dab4-4838-baa5-e3577ce30bb5" containerName="payload-pre-processing"
Sep 17 00:49:14.647089 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.647027    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5db594ab-dab4-4838-baa5-e3577ce30bb5" containerName="payload-pre-processing"
Sep 17 00:49:14.651286 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.651270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:14.653424 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.653403    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1035c6c0-dockercfg-k6vrz\""
Sep 17 00:49:14.653632 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.653617    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1035c6c0\""
Sep 17 00:49:14.660138 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.660115    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"]
Sep 17 00:49:14.818840 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.818809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95258625-6ba2-4ad0-8a19-483dc8a97bea-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5\" (UID: \"95258625-6ba2-4ad0-8a19-483dc8a97bea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:14.818840 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.818844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvr52\" (UniqueName: \"kubernetes.io/projected/95258625-6ba2-4ad0-8a19-483dc8a97bea-kube-api-access-zvr52\") pod \"payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5\" (UID: \"95258625-6ba2-4ad0-8a19-483dc8a97bea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:14.920270 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.920180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95258625-6ba2-4ad0-8a19-483dc8a97bea-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5\" (UID: \"95258625-6ba2-4ad0-8a19-483dc8a97bea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:14.920270 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.920214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvr52\" (UniqueName: \"kubernetes.io/projected/95258625-6ba2-4ad0-8a19-483dc8a97bea-kube-api-access-zvr52\") pod \"payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5\" (UID: \"95258625-6ba2-4ad0-8a19-483dc8a97bea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:14.920865 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.920844    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95258625-6ba2-4ad0-8a19-483dc8a97bea-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5\" (UID: \"95258625-6ba2-4ad0-8a19-483dc8a97bea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:14.927555 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.927533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvr52\" (UniqueName: \"kubernetes.io/projected/95258625-6ba2-4ad0-8a19-483dc8a97bea-kube-api-access-zvr52\") pod \"payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5\" (UID: \"95258625-6ba2-4ad0-8a19-483dc8a97bea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:14.963091 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:14.963056    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:15.233023 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:15.232992    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"]
Sep 17 00:49:15.234571 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:49:15.234549    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95258625_6ba2_4ad0_8a19_483dc8a97bea.slice/crio-f147f06ee6cde13e5bf6f649a7a08f5569897e090e450910aa2c3f8807a9da16 WatchSource:0}: Error finding container f147f06ee6cde13e5bf6f649a7a08f5569897e090e450910aa2c3f8807a9da16: Status 404 returned error can't find the container with id f147f06ee6cde13e5bf6f649a7a08f5569897e090e450910aa2c3f8807a9da16
Sep 17 00:49:16.173265 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:16.173235    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5" event={"ID":"95258625-6ba2-4ad0-8a19-483dc8a97bea","Type":"ContainerStarted","Data":"a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d"}
Sep 17 00:49:16.173744 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:16.173283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5" event={"ID":"95258625-6ba2-4ad0-8a19-483dc8a97bea","Type":"ContainerStarted","Data":"f147f06ee6cde13e5bf6f649a7a08f5569897e090e450910aa2c3f8807a9da16"}
Sep 17 00:49:16.173744 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:16.173334    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:16.190389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:16.190341    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5" podStartSLOduration=2.1903258660000002 podStartE2EDuration="2.190325866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:49:16.187795612 +0000 UTC m=+1148.615253535" watchObservedRunningTime="2026-09-17 00:49:16.190325866 +0000 UTC m=+1148.617783805"
Sep 17 00:49:27.181438 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:27.181399    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:44.056978 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.056876    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"]
Sep 17 00:49:44.057556 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.057157    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5" podUID="95258625-6ba2-4ad0-8a19-483dc8a97bea" containerName="payload-pre-processing" containerID="cri-o://a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d" gracePeriod=30
Sep 17 00:49:44.324493 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.321601    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:44.338369 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.338330    2576 generic.go:356] "Generic (PLEG): container finished" podID="95258625-6ba2-4ad0-8a19-483dc8a97bea" containerID="a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d" exitCode=0
Sep 17 00:49:44.338517 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.338386    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"
Sep 17 00:49:44.338517 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.338417    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5" event={"ID":"95258625-6ba2-4ad0-8a19-483dc8a97bea","Type":"ContainerDied","Data":"a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d"}
Sep 17 00:49:44.338590 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.338519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5" event={"ID":"95258625-6ba2-4ad0-8a19-483dc8a97bea","Type":"ContainerDied","Data":"f147f06ee6cde13e5bf6f649a7a08f5569897e090e450910aa2c3f8807a9da16"}
Sep 17 00:49:44.338590 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.338552    2576 scope.go:117] "RemoveContainer" containerID="a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d"
Sep 17 00:49:44.349446 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.349342    2576 scope.go:117] "RemoveContainer" containerID="a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d"
Sep 17 00:49:44.350029 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:49:44.349936    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d\": container with ID starting with a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d not found: ID does not exist" containerID="a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d"
Sep 17 00:49:44.350148 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.350073    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d"} err="failed to get container status \"a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d\": rpc error: code = NotFound desc = could not find container \"a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d\": container with ID starting with a605d88df799027be2c9c13e2afeec50f635c5a5562e5c3a7dddeaa4938f861d not found: ID does not exist"
Sep 17 00:49:44.394473 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.394437    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95258625-6ba2-4ad0-8a19-483dc8a97bea-plugins-config-volume\") pod \"95258625-6ba2-4ad0-8a19-483dc8a97bea\" (UID: \"95258625-6ba2-4ad0-8a19-483dc8a97bea\") "
Sep 17 00:49:44.394644 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.394599    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvr52\" (UniqueName: \"kubernetes.io/projected/95258625-6ba2-4ad0-8a19-483dc8a97bea-kube-api-access-zvr52\") pod \"95258625-6ba2-4ad0-8a19-483dc8a97bea\" (UID: \"95258625-6ba2-4ad0-8a19-483dc8a97bea\") "
Sep 17 00:49:44.394795 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.394770    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95258625-6ba2-4ad0-8a19-483dc8a97bea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "95258625-6ba2-4ad0-8a19-483dc8a97bea" (UID: "95258625-6ba2-4ad0-8a19-483dc8a97bea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:49:44.396791 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.396765    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95258625-6ba2-4ad0-8a19-483dc8a97bea-kube-api-access-zvr52" (OuterVolumeSpecName: "kube-api-access-zvr52") pod "95258625-6ba2-4ad0-8a19-483dc8a97bea" (UID: "95258625-6ba2-4ad0-8a19-483dc8a97bea"). InnerVolumeSpecName "kube-api-access-zvr52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:49:44.495552 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.495518    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvr52\" (UniqueName: \"kubernetes.io/projected/95258625-6ba2-4ad0-8a19-483dc8a97bea-kube-api-access-zvr52\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:49:44.495552 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.495550    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95258625-6ba2-4ad0-8a19-483dc8a97bea-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:49:44.660691 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.660667    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"]
Sep 17 00:49:44.663224 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:44.663202    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1035c6c0-5c58fd58b-6ftv5"]
Sep 17 00:49:46.141691 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:49:46.141657    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95258625-6ba2-4ad0-8a19-483dc8a97bea" path="/var/lib/kubelet/pods/95258625-6ba2-4ad0-8a19-483dc8a97bea/volumes"
Sep 17 00:50:26.984222 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:26.984180    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"]
Sep 17 00:50:26.984867 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:26.984802    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95258625-6ba2-4ad0-8a19-483dc8a97bea" containerName="payload-pre-processing"
Sep 17 00:50:26.984867 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:26.984822    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="95258625-6ba2-4ad0-8a19-483dc8a97bea" containerName="payload-pre-processing"
Sep 17 00:50:26.985065 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:26.984926    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="95258625-6ba2-4ad0-8a19-483dc8a97bea" containerName="payload-pre-processing"
Sep 17 00:50:26.989398 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:26.989383    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:26.992652 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:26.992623    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-6af38a\"/\"openshift-service-ca.crt\""
Sep 17 00:50:26.992774 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:26.992664    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-6af38a\"/\"default-dockercfg-k4qnc\""
Sep 17 00:50:26.992774 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:26.992623    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-6af38a\"/\"kube-root-ca.crt\""
Sep 17 00:50:26.992774 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:26.992634    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-6af38a\"/\"autores-model-6af38a-kserve-self-signed-certs\""
Sep 17 00:50:26.997515 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:26.997494    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"]
Sep 17 00:50:27.092486 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.092445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tls-certs\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.092486 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.092489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnptd\" (UniqueName: \"kubernetes.io/projected/fcfb783a-22e8-44a2-9901-7a916d50c3e3-kube-api-access-hnptd\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.092712 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.092524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-dshm\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.092712 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.092565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tmp-dir\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.092712 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.092643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-model-cache\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.092712 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.092669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-home\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.193504 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.193472    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tls-certs\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.193661 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.193514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnptd\" (UniqueName: \"kubernetes.io/projected/fcfb783a-22e8-44a2-9901-7a916d50c3e3-kube-api-access-hnptd\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.193661 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.193565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-dshm\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.193661 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.193610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tmp-dir\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.193811 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.193657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-model-cache\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.193811 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.193681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-home\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.194149 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.194121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tmp-dir\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.194149 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.194138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-model-cache\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.194271 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.194157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-home\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.196040 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.196021    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-dshm\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.196212 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.196197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tls-certs\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.200390 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.200371    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnptd\" (UniqueName: \"kubernetes.io/projected/fcfb783a-22e8-44a2-9901-7a916d50c3e3-kube-api-access-hnptd\") pod \"autores-model-6af38a-kserve-8649cf4d4c-vnbb6\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") " pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.300453 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.300359    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:27.585641 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:27.585549    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"]
Sep 17 00:50:27.590237 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:50:27.590204    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcfb783a_22e8_44a2_9901_7a916d50c3e3.slice/crio-de769e6b2aed3bcbf1de10f17b7450b6795faf12ac114f80d78dd1f41329c24b WatchSource:0}: Error finding container de769e6b2aed3bcbf1de10f17b7450b6795faf12ac114f80d78dd1f41329c24b: Status 404 returned error can't find the container with id de769e6b2aed3bcbf1de10f17b7450b6795faf12ac114f80d78dd1f41329c24b
Sep 17 00:50:28.586820 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:28.586781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6" event={"ID":"fcfb783a-22e8-44a2-9901-7a916d50c3e3","Type":"ContainerStarted","Data":"7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c"}
Sep 17 00:50:28.586820 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:28.586826    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6" event={"ID":"fcfb783a-22e8-44a2-9901-7a916d50c3e3","Type":"ContainerStarted","Data":"de769e6b2aed3bcbf1de10f17b7450b6795faf12ac114f80d78dd1f41329c24b"}
Sep 17 00:50:28.602946 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:28.602901    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6" podStartSLOduration=2.60288635 podStartE2EDuration="2.60288635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:50:28.601049581 +0000 UTC m=+1221.028507505" watchObservedRunningTime="2026-09-17 00:50:28.60288635 +0000 UTC m=+1221.030344315"
Sep 17 00:50:37.300512 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:37.300455    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:37.301080 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:37.300552    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:37.313334 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:37.313316    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:50:37.649393 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:50:37.649370    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:51:12.487938 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.487901    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"]
Sep 17 00:51:12.488560 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.488211    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf" podUID="fb0ccb70-75b1-4809-be1a-dabdc1373517" containerName="payload-processing" containerID="cri-o://0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d" gracePeriod=30
Sep 17 00:51:12.491328 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.491301    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"]
Sep 17 00:51:12.491583 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.491531    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk" podUID="463c5cc2-8e29-45ca-9f90-b3ca01dc0548" containerName="payload-pre-processing" containerID="cri-o://1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2" gracePeriod=30
Sep 17 00:51:12.775624 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.775595    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:51:12.790530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.790497    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:51:12.820003 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.819939    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb0ccb70-75b1-4809-be1a-dabdc1373517-plugins-config-volume\") pod \"fb0ccb70-75b1-4809-be1a-dabdc1373517\" (UID: \"fb0ccb70-75b1-4809-be1a-dabdc1373517\") "
Sep 17 00:51:12.820156 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.820014    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bslf2\" (UniqueName: \"kubernetes.io/projected/fb0ccb70-75b1-4809-be1a-dabdc1373517-kube-api-access-bslf2\") pod \"fb0ccb70-75b1-4809-be1a-dabdc1373517\" (UID: \"fb0ccb70-75b1-4809-be1a-dabdc1373517\") "
Sep 17 00:51:12.820414 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.820380    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb0ccb70-75b1-4809-be1a-dabdc1373517-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fb0ccb70-75b1-4809-be1a-dabdc1373517" (UID: "fb0ccb70-75b1-4809-be1a-dabdc1373517"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:51:12.822242 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.822221    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb0ccb70-75b1-4809-be1a-dabdc1373517-kube-api-access-bslf2" (OuterVolumeSpecName: "kube-api-access-bslf2") pod "fb0ccb70-75b1-4809-be1a-dabdc1373517" (UID: "fb0ccb70-75b1-4809-be1a-dabdc1373517"). InnerVolumeSpecName "kube-api-access-bslf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:51:12.836460 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.836429    2576 generic.go:356] "Generic (PLEG): container finished" podID="463c5cc2-8e29-45ca-9f90-b3ca01dc0548" containerID="1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2" exitCode=0
Sep 17 00:51:12.836574 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.836501    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"
Sep 17 00:51:12.836574 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.836511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk" event={"ID":"463c5cc2-8e29-45ca-9f90-b3ca01dc0548","Type":"ContainerDied","Data":"1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2"}
Sep 17 00:51:12.836710 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.836595    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk" event={"ID":"463c5cc2-8e29-45ca-9f90-b3ca01dc0548","Type":"ContainerDied","Data":"3674b2e756fccaad62d744e93a02e088136ecf42dcfd0d45ba057d2864274553"}
Sep 17 00:51:12.836710 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.836629    2576 scope.go:117] "RemoveContainer" containerID="1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2"
Sep 17 00:51:12.837924 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.837903    2576 generic.go:356] "Generic (PLEG): container finished" podID="fb0ccb70-75b1-4809-be1a-dabdc1373517" containerID="0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d" exitCode=0
Sep 17 00:51:12.838010 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.837979    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"
Sep 17 00:51:12.838071 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.837953    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf" event={"ID":"fb0ccb70-75b1-4809-be1a-dabdc1373517","Type":"ContainerDied","Data":"0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d"}
Sep 17 00:51:12.838119 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.838094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf" event={"ID":"fb0ccb70-75b1-4809-be1a-dabdc1373517","Type":"ContainerDied","Data":"e8dbe3a39209764e4edd967c9f0f3e488180be1d05d4747c619e3a3aabe7a010"}
Sep 17 00:51:12.846543 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.846515    2576 scope.go:117] "RemoveContainer" containerID="1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2"
Sep 17 00:51:12.846806 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:51:12.846786    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2\": container with ID starting with 1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2 not found: ID does not exist" containerID="1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2"
Sep 17 00:51:12.846849 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.846814    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2"} err="failed to get container status \"1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2\": rpc error: code = NotFound desc = could not find container \"1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2\": container with ID starting with 1f7f4e55a656bb3be0ffec937265be91b09e2c30554cac173f88a9cb1437e0a2 not found: ID does not exist"
Sep 17 00:51:12.846849 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.846832    2576 scope.go:117] "RemoveContainer" containerID="0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d"
Sep 17 00:51:12.855020 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.854999    2576 scope.go:117] "RemoveContainer" containerID="0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d"
Sep 17 00:51:12.855352 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:51:12.855325    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d\": container with ID starting with 0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d not found: ID does not exist" containerID="0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d"
Sep 17 00:51:12.855433 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.855354    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d"} err="failed to get container status \"0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d\": rpc error: code = NotFound desc = could not find container \"0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d\": container with ID starting with 0d52cfe2c7aba5b024d4744356a32078a394099c73919be4a249db533cca637d not found: ID does not exist"
Sep 17 00:51:12.858092 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.858070    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"]
Sep 17 00:51:12.861472 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.861450    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6af38a-5f9fd954dc-pf6gf"]
Sep 17 00:51:12.921135 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.921102    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-plugins-config-volume\") pod \"463c5cc2-8e29-45ca-9f90-b3ca01dc0548\" (UID: \"463c5cc2-8e29-45ca-9f90-b3ca01dc0548\") "
Sep 17 00:51:12.921303 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.921172    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dnml\" (UniqueName: \"kubernetes.io/projected/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-kube-api-access-2dnml\") pod \"463c5cc2-8e29-45ca-9f90-b3ca01dc0548\" (UID: \"463c5cc2-8e29-45ca-9f90-b3ca01dc0548\") "
Sep 17 00:51:12.921497 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.921474    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "463c5cc2-8e29-45ca-9f90-b3ca01dc0548" (UID: "463c5cc2-8e29-45ca-9f90-b3ca01dc0548"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:51:12.921568 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.921484    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb0ccb70-75b1-4809-be1a-dabdc1373517-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:12.921568 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.921526    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bslf2\" (UniqueName: \"kubernetes.io/projected/fb0ccb70-75b1-4809-be1a-dabdc1373517-kube-api-access-bslf2\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:12.923272 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:12.923254    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-kube-api-access-2dnml" (OuterVolumeSpecName: "kube-api-access-2dnml") pod "463c5cc2-8e29-45ca-9f90-b3ca01dc0548" (UID: "463c5cc2-8e29-45ca-9f90-b3ca01dc0548"). InnerVolumeSpecName "kube-api-access-2dnml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:51:13.022234 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:13.022168    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:13.022234 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:13.022192    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dnml\" (UniqueName: \"kubernetes.io/projected/463c5cc2-8e29-45ca-9f90-b3ca01dc0548-kube-api-access-2dnml\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:13.157244 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:13.157218    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"]
Sep 17 00:51:13.160709 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:13.160684    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6af38a-666b7b679d-rzcqk"]
Sep 17 00:51:14.142271 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:14.142237    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="463c5cc2-8e29-45ca-9f90-b3ca01dc0548" path="/var/lib/kubelet/pods/463c5cc2-8e29-45ca-9f90-b3ca01dc0548/volumes"
Sep 17 00:51:14.142658 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:14.142616    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb0ccb70-75b1-4809-be1a-dabdc1373517" path="/var/lib/kubelet/pods/fb0ccb70-75b1-4809-be1a-dabdc1373517/volumes"
Sep 17 00:51:17.967984 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:17.967942    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"]
Sep 17 00:51:32.987817 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:32.987752    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6" podUID="fcfb783a-22e8-44a2-9901-7a916d50c3e3" containerName="main" containerID="cri-o://7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c" gracePeriod=45
Sep 17 00:51:33.247782 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.247726    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:51:33.412845 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.412817    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tls-certs\") pod \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") "
Sep 17 00:51:33.413065 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.412895    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnptd\" (UniqueName: \"kubernetes.io/projected/fcfb783a-22e8-44a2-9901-7a916d50c3e3-kube-api-access-hnptd\") pod \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") "
Sep 17 00:51:33.413065 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.412923    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-dshm\") pod \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") "
Sep 17 00:51:33.413065 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.412943    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-home\") pod \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") "
Sep 17 00:51:33.413065 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.413031    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tmp-dir\") pod \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") "
Sep 17 00:51:33.413065 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.413058    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-model-cache\") pod \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\" (UID: \"fcfb783a-22e8-44a2-9901-7a916d50c3e3\") "
Sep 17 00:51:33.413349 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.413302    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-home" (OuterVolumeSpecName: "home") pod "fcfb783a-22e8-44a2-9901-7a916d50c3e3" (UID: "fcfb783a-22e8-44a2-9901-7a916d50c3e3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:51:33.413406 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.413311    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fcfb783a-22e8-44a2-9901-7a916d50c3e3" (UID: "fcfb783a-22e8-44a2-9901-7a916d50c3e3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:51:33.413456 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.413393    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-model-cache" (OuterVolumeSpecName: "model-cache") pod "fcfb783a-22e8-44a2-9901-7a916d50c3e3" (UID: "fcfb783a-22e8-44a2-9901-7a916d50c3e3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:51:33.415305 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.415284    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-dshm" (OuterVolumeSpecName: "dshm") pod "fcfb783a-22e8-44a2-9901-7a916d50c3e3" (UID: "fcfb783a-22e8-44a2-9901-7a916d50c3e3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:51:33.415378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.415347    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fcfb783a-22e8-44a2-9901-7a916d50c3e3" (UID: "fcfb783a-22e8-44a2-9901-7a916d50c3e3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:51:33.415425 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.415407    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcfb783a-22e8-44a2-9901-7a916d50c3e3-kube-api-access-hnptd" (OuterVolumeSpecName: "kube-api-access-hnptd") pod "fcfb783a-22e8-44a2-9901-7a916d50c3e3" (UID: "fcfb783a-22e8-44a2-9901-7a916d50c3e3"). InnerVolumeSpecName "kube-api-access-hnptd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:51:33.514497 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.514418    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-dshm\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:33.514497 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.514444    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-home\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:33.514497 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.514452    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tmp-dir\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:33.514497 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.514463    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcfb783a-22e8-44a2-9901-7a916d50c3e3-model-cache\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:33.514497 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.514471    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcfb783a-22e8-44a2-9901-7a916d50c3e3-tls-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:33.514497 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.514480    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnptd\" (UniqueName: \"kubernetes.io/projected/fcfb783a-22e8-44a2-9901-7a916d50c3e3-kube-api-access-hnptd\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:33.961137 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.961105    2576 generic.go:356] "Generic (PLEG): container finished" podID="fcfb783a-22e8-44a2-9901-7a916d50c3e3" containerID="7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c" exitCode=0
Sep 17 00:51:33.961311 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.961149    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"
Sep 17 00:51:33.961311 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.961195    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6" event={"ID":"fcfb783a-22e8-44a2-9901-7a916d50c3e3","Type":"ContainerDied","Data":"7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c"}
Sep 17 00:51:33.961311 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.961242    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6" event={"ID":"fcfb783a-22e8-44a2-9901-7a916d50c3e3","Type":"ContainerDied","Data":"de769e6b2aed3bcbf1de10f17b7450b6795faf12ac114f80d78dd1f41329c24b"}
Sep 17 00:51:33.961311 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.961259    2576 scope.go:117] "RemoveContainer" containerID="7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c"
Sep 17 00:51:33.970528 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.970513    2576 scope.go:117] "RemoveContainer" containerID="7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c"
Sep 17 00:51:33.970783 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:51:33.970764    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c\": container with ID starting with 7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c not found: ID does not exist" containerID="7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c"
Sep 17 00:51:33.970842 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.970790    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c"} err="failed to get container status \"7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c\": rpc error: code = NotFound desc = could not find container \"7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c\": container with ID starting with 7700775327d9be794a96a64ae9f0a0f96b0960904fc6233ff8f5672f1b86d70c not found: ID does not exist"
Sep 17 00:51:33.982029 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.981997    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"]
Sep 17 00:51:33.988114 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:33.988093    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-6af38a/autores-model-6af38a-kserve-8649cf4d4c-vnbb6"]
Sep 17 00:51:34.143279 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:34.143250    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcfb783a-22e8-44a2-9901-7a916d50c3e3" path="/var/lib/kubelet/pods/fcfb783a-22e8-44a2-9901-7a916d50c3e3/volumes"
Sep 17 00:51:35.910779 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:35.910736    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"]
Sep 17 00:51:35.911265 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:35.911060    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh" podUID="bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8" containerName="payload-pre-processing" containerID="cri-o://f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f" gracePeriod=30
Sep 17 00:51:36.170342 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.170280    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:51:36.338535 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.338505    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfgqr\" (UniqueName: \"kubernetes.io/projected/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-kube-api-access-xfgqr\") pod \"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8\" (UID: \"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8\") "
Sep 17 00:51:36.338730 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.338570    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-plugins-config-volume\") pod \"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8\" (UID: \"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8\") "
Sep 17 00:51:36.338878 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.338855    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8" (UID: "bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:51:36.340654 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.340630    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-kube-api-access-xfgqr" (OuterVolumeSpecName: "kube-api-access-xfgqr") pod "bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8" (UID: "bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8"). InnerVolumeSpecName "kube-api-access-xfgqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:51:36.440361 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.440280    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfgqr\" (UniqueName: \"kubernetes.io/projected/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-kube-api-access-xfgqr\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:36.440361 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.440307    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:51:36.981338 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.981301    2576 generic.go:356] "Generic (PLEG): container finished" podID="bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8" containerID="f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f" exitCode=0
Sep 17 00:51:36.981716 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.981362    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"
Sep 17 00:51:36.981716 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.981384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh" event={"ID":"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8","Type":"ContainerDied","Data":"f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f"}
Sep 17 00:51:36.981716 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.981475    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh" event={"ID":"bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8","Type":"ContainerDied","Data":"244ab5187750c6b859646ee4375fae9ddf1a6254abdac8243a9d251ab70daff1"}
Sep 17 00:51:36.981716 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.981503    2576 scope.go:117] "RemoveContainer" containerID="f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f"
Sep 17 00:51:36.994410 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.994389    2576 scope.go:117] "RemoveContainer" containerID="f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f"
Sep 17 00:51:36.995036 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:51:36.994933    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f\": container with ID starting with f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f not found: ID does not exist" containerID="f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f"
Sep 17 00:51:36.995036 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:36.994991    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f"} err="failed to get container status \"f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f\": rpc error: code = NotFound desc = could not find container \"f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f\": container with ID starting with f62cbda9253f6bdab8d125057d834a2b3995d4d8e576fbce5014680e7c4b5f5f not found: ID does not exist"
Sep 17 00:51:37.004423 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:37.004400    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"]
Sep 17 00:51:37.008110 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:37.008084    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f40754-574b8d9498-r88mh"]
Sep 17 00:51:38.140765 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:38.140736    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8" path="/var/lib/kubelet/pods/bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8/volumes"
Sep 17 00:51:54.876327 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:54.876292    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"]
Sep 17 00:51:54.876900 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:54.876589    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy" containerID="cri-o://c3831dd4eafbecce5f983035ad616224a750b276b6a05146a817c897eb146115" gracePeriod=30
Sep 17 00:51:55.598943 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.598912    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"]
Sep 17 00:51:55.599630 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599590    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb0ccb70-75b1-4809-be1a-dabdc1373517" containerName="payload-processing"
Sep 17 00:51:55.599630 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599617    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb0ccb70-75b1-4809-be1a-dabdc1373517" containerName="payload-processing"
Sep 17 00:51:55.599796 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599638    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcfb783a-22e8-44a2-9901-7a916d50c3e3" containerName="main"
Sep 17 00:51:55.599796 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599648    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcfb783a-22e8-44a2-9901-7a916d50c3e3" containerName="main"
Sep 17 00:51:55.599796 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599662    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8" containerName="payload-pre-processing"
Sep 17 00:51:55.599796 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599672    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8" containerName="payload-pre-processing"
Sep 17 00:51:55.599796 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599698    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="463c5cc2-8e29-45ca-9f90-b3ca01dc0548" containerName="payload-pre-processing"
Sep 17 00:51:55.599796 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599706    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="463c5cc2-8e29-45ca-9f90-b3ca01dc0548" containerName="payload-pre-processing"
Sep 17 00:51:55.599796 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599782    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb0ccb70-75b1-4809-be1a-dabdc1373517" containerName="payload-processing"
Sep 17 00:51:55.599796 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599796    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="463c5cc2-8e29-45ca-9f90-b3ca01dc0548" containerName="payload-pre-processing"
Sep 17 00:51:55.600179 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599806    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf0d4e01-7fa0-4f01-b9c6-c1032f3e6ea8" containerName="payload-pre-processing"
Sep 17 00:51:55.600179 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.599815    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcfb783a-22e8-44a2-9901-7a916d50c3e3" containerName="main"
Sep 17 00:51:55.604783 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.604765    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.606891 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.606873    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-c98a88-openshift-default-dockercfg-ddlj2\""
Sep 17 00:51:55.615029 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.615007    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"]
Sep 17 00:51:55.715221 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.715192    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-data\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.715401 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.715248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-token\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.715401 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.715309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-envoy\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.715476 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.715396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-certs\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.715476 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.715439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpkpj\" (UniqueName: \"kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-kube-api-access-qpkpj\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.715540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.715509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istiod-ca-cert\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.715577 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.715541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-credential-socket\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.715577 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.715558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-podinfo\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.715642 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.715587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-socket\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.816397 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.816364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-certs\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.816572 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.816408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpkpj\" (UniqueName: \"kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-kube-api-access-qpkpj\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.816572 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.816441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istiod-ca-cert\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.816572 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.816459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-credential-socket\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.816572 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.816479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-podinfo\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.816572 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.816505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-socket\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.816572 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.816534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-data\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.816910 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.816584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-token\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.816910 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.816611    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-envoy\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.816910 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.816819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-certs\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.816910 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.816848    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-credential-socket\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.817273 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.817252    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istiod-ca-cert\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.817344 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.817283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-data\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.817344 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.817300    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-socket\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.819249 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.819226    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-podinfo\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.819336 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.819285    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-envoy\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.824117 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.824097    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-token\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.824207 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.824145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpkpj\" (UniqueName: \"kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-kube-api-access-qpkpj\") pod \"e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") " pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:55.915883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:55.915838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:56.192207 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:56.192177    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"]
Sep 17 00:51:56.193353 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:51:56.193330    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5134ce1_e5bd_466a_a76e_80858c5c6b7e.slice/crio-d4525dfad7deb1787e9fc0e0fe7f96f745c36c14a92f0fb0d08f4c62decf5f03 WatchSource:0}: Error finding container d4525dfad7deb1787e9fc0e0fe7f96f745c36c14a92f0fb0d08f4c62decf5f03: Status 404 returned error can't find the container with id d4525dfad7deb1787e9fc0e0fe7f96f745c36c14a92f0fb0d08f4c62decf5f03
Sep 17 00:51:56.195615 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:56.195578    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:51:56.195711 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:56.195647    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:51:56.195711 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:56.195681    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:51:57.086838 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:57.086802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" event={"ID":"a5134ce1-e5bd-466a-a76e-80858c5c6b7e","Type":"ContainerStarted","Data":"c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5"}
Sep 17 00:51:57.087340 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:57.086851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" event={"ID":"a5134ce1-e5bd-466a-a76e-80858c5c6b7e","Type":"ContainerStarted","Data":"d4525dfad7deb1787e9fc0e0fe7f96f745c36c14a92f0fb0d08f4c62decf5f03"}
Sep 17 00:51:57.106779 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:57.106731    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" podStartSLOduration=2.106716155 podStartE2EDuration="2.106716155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:51:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:51:57.104426797 +0000 UTC m=+1309.531884720" watchObservedRunningTime="2026-09-17 00:51:57.106716155 +0000 UTC m=+1309.534174077"
Sep 17 00:51:57.916596 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:57.916564    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:57.922595 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:57.922566    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:58.092275 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:58.092230    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:51:58.093208 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:51:58.093186    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:52:00.106511 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.106477    2576 generic.go:356] "Generic (PLEG): container finished" podID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerID="c3831dd4eafbecce5f983035ad616224a750b276b6a05146a817c897eb146115" exitCode=0
Sep 17 00:52:00.106950 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.106550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" event={"ID":"b689e1ca-de94-45ab-bedc-ee664d76a62a","Type":"ContainerDied","Data":"c3831dd4eafbecce5f983035ad616224a750b276b6a05146a817c897eb146115"}
Sep 17 00:52:00.106950 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.106642    2576 scope.go:117] "RemoveContainer" containerID="b485ae7c1c2cb5bc073222bacbf24632acfc40640a1c73746ce79dc82a7e89d0"
Sep 17 00:52:00.129192 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.129171    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:52:00.259574 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.259545    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-envoy\") pod \"b689e1ca-de94-45ab-bedc-ee664d76a62a\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") "
Sep 17 00:52:00.259753 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.259584    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-podinfo\") pod \"b689e1ca-de94-45ab-bedc-ee664d76a62a\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") "
Sep 17 00:52:00.259753 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.259617    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b689e1ca-de94-45ab-bedc-ee664d76a62a-istiod-ca-cert\") pod \"b689e1ca-de94-45ab-bedc-ee664d76a62a\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") "
Sep 17 00:52:00.259753 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.259693    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-token\") pod \"b689e1ca-de94-45ab-bedc-ee664d76a62a\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") "
Sep 17 00:52:00.260032 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.259754    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-socket\") pod \"b689e1ca-de94-45ab-bedc-ee664d76a62a\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") "
Sep 17 00:52:00.260032 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.259833    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2f75\" (UniqueName: \"kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-kube-api-access-g2f75\") pod \"b689e1ca-de94-45ab-bedc-ee664d76a62a\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") "
Sep 17 00:52:00.260032 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.259870    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-data\") pod \"b689e1ca-de94-45ab-bedc-ee664d76a62a\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") "
Sep 17 00:52:00.260032 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.259903    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-credential-socket\") pod \"b689e1ca-de94-45ab-bedc-ee664d76a62a\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") "
Sep 17 00:52:00.260032 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.259932    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-certs\") pod \"b689e1ca-de94-45ab-bedc-ee664d76a62a\" (UID: \"b689e1ca-de94-45ab-bedc-ee664d76a62a\") "
Sep 17 00:52:00.260346 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.260171    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b689e1ca-de94-45ab-bedc-ee664d76a62a" (UID: "b689e1ca-de94-45ab-bedc-ee664d76a62a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:52:00.260346 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.260196    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-data" (OuterVolumeSpecName: "istio-data") pod "b689e1ca-de94-45ab-bedc-ee664d76a62a" (UID: "b689e1ca-de94-45ab-bedc-ee664d76a62a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:52:00.260346 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.260134    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b689e1ca-de94-45ab-bedc-ee664d76a62a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b689e1ca-de94-45ab-bedc-ee664d76a62a" (UID: "b689e1ca-de94-45ab-bedc-ee664d76a62a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:52:00.260675 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.260387    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b689e1ca-de94-45ab-bedc-ee664d76a62a" (UID: "b689e1ca-de94-45ab-bedc-ee664d76a62a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:52:00.260675 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.260596    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b689e1ca-de94-45ab-bedc-ee664d76a62a" (UID: "b689e1ca-de94-45ab-bedc-ee664d76a62a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:52:00.261168 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.261143    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-data\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:00.261337 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.261171    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-credential-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:00.261337 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.261201    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:00.261337 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.261221    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b689e1ca-de94-45ab-bedc-ee664d76a62a-istiod-ca-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:00.261337 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.261235    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-workload-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:00.262424 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.262268    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b689e1ca-de94-45ab-bedc-ee664d76a62a" (UID: "b689e1ca-de94-45ab-bedc-ee664d76a62a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:52:00.262424 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.262372    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b689e1ca-de94-45ab-bedc-ee664d76a62a" (UID: "b689e1ca-de94-45ab-bedc-ee664d76a62a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:52:00.262796 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.262770    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b689e1ca-de94-45ab-bedc-ee664d76a62a" (UID: "b689e1ca-de94-45ab-bedc-ee664d76a62a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:52:00.264116 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.264080    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-kube-api-access-g2f75" (OuterVolumeSpecName: "kube-api-access-g2f75") pod "b689e1ca-de94-45ab-bedc-ee664d76a62a" (UID: "b689e1ca-de94-45ab-bedc-ee664d76a62a"). InnerVolumeSpecName "kube-api-access-g2f75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:52:00.362460 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.362427    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-token\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:00.362460 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.362457    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2f75\" (UniqueName: \"kubernetes.io/projected/b689e1ca-de94-45ab-bedc-ee664d76a62a-kube-api-access-g2f75\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:00.362460 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.362468    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-envoy\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:00.362687 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:00.362476    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b689e1ca-de94-45ab-bedc-ee664d76a62a-istio-podinfo\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:01.113418 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:01.113381    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x" event={"ID":"b689e1ca-de94-45ab-bedc-ee664d76a62a","Type":"ContainerDied","Data":"586a5b0eaee98da9d6411885c04400c5d499fc78afae52e0430c2b48c73a087a"}
Sep 17 00:52:01.113418 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:01.113404    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"
Sep 17 00:52:01.113875 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:01.113439    2576 scope.go:117] "RemoveContainer" containerID="c3831dd4eafbecce5f983035ad616224a750b276b6a05146a817c897eb146115"
Sep 17 00:52:01.151471 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:01.151436    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"]
Sep 17 00:52:01.155446 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:01.155409    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-6af38a-openshift-default-5b956c884d-n8b9x"]
Sep 17 00:52:02.141626 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:02.141592    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" path="/var/lib/kubelet/pods/b689e1ca-de94-45ab-bedc-ee664d76a62a/volumes"
Sep 17 00:52:05.043758 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.043721    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"]
Sep 17 00:52:05.044306 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.044287    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy"
Sep 17 00:52:05.044306 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.044308    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy"
Sep 17 00:52:05.044422 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.044372    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy"
Sep 17 00:52:05.049519 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.049501    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.051673 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.051648    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-69d1f859-openshift-default-dockercfg-gk9cj\""
Sep 17 00:52:05.061282 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.059871    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"]
Sep 17 00:52:05.208116 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.208074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-socket\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.208116 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.208110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-envoy\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.208375 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.208141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-data\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.208375 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.208241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-istio-token\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.208375 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.208342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9fl8\" (UniqueName: \"kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-kube-api-access-t9fl8\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.208551 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.208409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-certs\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.208551 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.208432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d31e550-a17a-4658-83cd-519ca02eee13-istio-podinfo\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.208551 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.208454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d31e550-a17a-4658-83cd-519ca02eee13-istiod-ca-cert\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.208551 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.208512    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-credential-socket\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.309892 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.309808    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-istio-token\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.309892 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.309881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9fl8\" (UniqueName: \"kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-kube-api-access-t9fl8\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310149 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.309920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-certs\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310149 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.309937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d31e550-a17a-4658-83cd-519ca02eee13-istio-podinfo\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310149 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.309953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d31e550-a17a-4658-83cd-519ca02eee13-istiod-ca-cert\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310149 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.310022    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-credential-socket\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310149 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.310056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-socket\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310149 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.310079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-envoy\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310149 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.310111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-data\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310500 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.310419    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-certs\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310500 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.310486    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-socket\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310624 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.310601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-credential-socket\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310680 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.310645    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-data\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.310886 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.310831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d31e550-a17a-4658-83cd-519ca02eee13-istiod-ca-cert\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.312358 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.312336    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-envoy\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.312643 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.312626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d31e550-a17a-4658-83cd-519ca02eee13-istio-podinfo\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.318134 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.318111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9fl8\" (UniqueName: \"kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-kube-api-access-t9fl8\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.318211 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.318162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-istio-token\") pod \"e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") " pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.362928 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.362889    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:05.697662 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.697629    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"]
Sep 17 00:52:05.700945 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:52:05.700917    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d31e550_a17a_4658_83cd_519ca02eee13.slice/crio-0bfb0635c5e0fc267c1e93d3ec88b437b3b9cefad30ea3d7c6a1cab382db4712 WatchSource:0}: Error finding container 0bfb0635c5e0fc267c1e93d3ec88b437b3b9cefad30ea3d7c6a1cab382db4712: Status 404 returned error can't find the container with id 0bfb0635c5e0fc267c1e93d3ec88b437b3b9cefad30ea3d7c6a1cab382db4712
Sep 17 00:52:05.703225 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.703191    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:52:05.703312 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.703256    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:52:05.703312 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:05.703285    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:52:06.145139 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:06.145045    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" event={"ID":"5d31e550-a17a-4658-83cd-519ca02eee13","Type":"ContainerStarted","Data":"a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872"}
Sep 17 00:52:06.145139 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:06.145100    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" event={"ID":"5d31e550-a17a-4658-83cd-519ca02eee13","Type":"ContainerStarted","Data":"0bfb0635c5e0fc267c1e93d3ec88b437b3b9cefad30ea3d7c6a1cab382db4712"}
Sep 17 00:52:06.164594 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:06.164536    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" podStartSLOduration=1.164516093 podStartE2EDuration="1.164516093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:52:06.163180625 +0000 UTC m=+1318.590638563" watchObservedRunningTime="2026-09-17 00:52:06.164516093 +0000 UTC m=+1318.591974021"
Sep 17 00:52:06.363704 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:06.363676    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:06.368540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:06.368511    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:07.150381 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:07.150348    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:07.151343 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:07.151321    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:15.020337 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.020304    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"]
Sep 17 00:52:15.020785 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.020681    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy"
Sep 17 00:52:15.020785 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.020694    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy"
Sep 17 00:52:15.020862 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.020787    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b689e1ca-de94-45ab-bedc-ee664d76a62a" containerName="istio-proxy"
Sep 17 00:52:15.025232 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.025213    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:15.027678 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.027656    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-69d1f859\""
Sep 17 00:52:15.027821 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.027661    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-69d1f859-dockercfg-j5pcs\""
Sep 17 00:52:15.034858 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.034835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"]
Sep 17 00:52:15.059561 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.059527    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"]
Sep 17 00:52:15.063541 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.063523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:15.073864 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.073836    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"]
Sep 17 00:52:15.114817 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.114774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl\" (UID: \"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:15.115145 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.115120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhz7l\" (UniqueName: \"kubernetes.io/projected/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-kube-api-access-hhz7l\") pod \"payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl\" (UID: \"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:15.216416 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.216369    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2f2k\" (UniqueName: \"kubernetes.io/projected/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-kube-api-access-z2f2k\") pod \"payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f\" (UID: \"580f94c5-8d95-4d3b-ae7c-0514415d6a5d\") " pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:15.216614 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.216452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-plugins-config-volume\") pod \"payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f\" (UID: \"580f94c5-8d95-4d3b-ae7c-0514415d6a5d\") " pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:15.216614 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.216480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl\" (UID: \"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:15.216614 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.216567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhz7l\" (UniqueName: \"kubernetes.io/projected/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-kube-api-access-hhz7l\") pod \"payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl\" (UID: \"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:15.217379 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.217354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl\" (UID: \"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:15.224611 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.224581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhz7l\" (UniqueName: \"kubernetes.io/projected/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-kube-api-access-hhz7l\") pod \"payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl\" (UID: \"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:15.317886 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.317789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2f2k\" (UniqueName: \"kubernetes.io/projected/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-kube-api-access-z2f2k\") pod \"payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f\" (UID: \"580f94c5-8d95-4d3b-ae7c-0514415d6a5d\") " pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:15.317886 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.317860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-plugins-config-volume\") pod \"payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f\" (UID: \"580f94c5-8d95-4d3b-ae7c-0514415d6a5d\") " pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:15.318544 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.318526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-plugins-config-volume\") pod \"payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f\" (UID: \"580f94c5-8d95-4d3b-ae7c-0514415d6a5d\") " pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:15.326647 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.326620    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2f2k\" (UniqueName: \"kubernetes.io/projected/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-kube-api-access-z2f2k\") pod \"payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f\" (UID: \"580f94c5-8d95-4d3b-ae7c-0514415d6a5d\") " pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:15.338588 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.338564    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:15.376706 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.376669    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:15.628942 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.628915    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"]
Sep 17 00:52:15.631497 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:52:15.631466    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e7f687_6c6e_4dc0_9520_f3e3bce069a4.slice/crio-549acf4d3f93bc7a16f04013e000119deab16e8a6183515b51369ea42bc87275 WatchSource:0}: Error finding container 549acf4d3f93bc7a16f04013e000119deab16e8a6183515b51369ea42bc87275: Status 404 returned error can't find the container with id 549acf4d3f93bc7a16f04013e000119deab16e8a6183515b51369ea42bc87275
Sep 17 00:52:15.671996 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:15.671940    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"]
Sep 17 00:52:15.672540 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:52:15.672513    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580f94c5_8d95_4d3b_ae7c_0514415d6a5d.slice/crio-51f3781659bf9ab0e9b6d2ceb47a964f006e8494c94688a4e316ae088c304276 WatchSource:0}: Error finding container 51f3781659bf9ab0e9b6d2ceb47a964f006e8494c94688a4e316ae088c304276: Status 404 returned error can't find the container with id 51f3781659bf9ab0e9b6d2ceb47a964f006e8494c94688a4e316ae088c304276
Sep 17 00:52:16.214692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:16.214593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl" event={"ID":"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4","Type":"ContainerStarted","Data":"f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c"}
Sep 17 00:52:16.214692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:16.214656    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl" event={"ID":"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4","Type":"ContainerStarted","Data":"549acf4d3f93bc7a16f04013e000119deab16e8a6183515b51369ea42bc87275"}
Sep 17 00:52:16.215272 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:16.214788    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:16.216528 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:16.216505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f" event={"ID":"580f94c5-8d95-4d3b-ae7c-0514415d6a5d","Type":"ContainerStarted","Data":"7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693"}
Sep 17 00:52:16.216642 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:16.216556    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:16.216642 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:16.216572    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f" event={"ID":"580f94c5-8d95-4d3b-ae7c-0514415d6a5d","Type":"ContainerStarted","Data":"51f3781659bf9ab0e9b6d2ceb47a964f006e8494c94688a4e316ae088c304276"}
Sep 17 00:52:16.232669 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:16.232295    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl" podStartSLOduration=1.232275267 podStartE2EDuration="1.232275267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:52:16.228520506 +0000 UTC m=+1328.655978430" watchObservedRunningTime="2026-09-17 00:52:16.232275267 +0000 UTC m=+1328.659733191"
Sep 17 00:52:16.244766 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:16.244718    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f" podStartSLOduration=1.244693744 podStartE2EDuration="1.244693744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:52:16.243634935 +0000 UTC m=+1328.671092860" watchObservedRunningTime="2026-09-17 00:52:16.244693744 +0000 UTC m=+1328.672151666"
Sep 17 00:52:18.230637 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:18.230601    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerID="c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5" exitCode=0
Sep 17 00:52:18.231173 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:18.230683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" event={"ID":"a5134ce1-e5bd-466a-a76e-80858c5c6b7e","Type":"ContainerDied","Data":"c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5"}
Sep 17 00:52:18.231289 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:18.231272    2576 scope.go:117] "RemoveContainer" containerID="c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5"
Sep 17 00:52:18.232687 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:18.232649    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:52:18.232780 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:18.232762    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:52:18.232828 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:18.232813    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:52:19.239471 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:19.239432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" event={"ID":"a5134ce1-e5bd-466a-a76e-80858c5c6b7e","Type":"ContainerStarted","Data":"3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46"}
Sep 17 00:52:19.916161 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:19.916118    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:52:19.916831 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:19.916807    2576 patch_prober.go:28] interesting pod/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 17 00:52:19.916902 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:19.916862    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 17 00:52:20.916489 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:20.916455    2576 patch_prober.go:28] interesting pod/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 17 00:52:20.916871 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:20.916513    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 17 00:52:21.917155 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:21.917104    2576 patch_prober.go:28] interesting pod/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 17 00:52:21.917662 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:21.917180    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 17 00:52:22.916315 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:22.916267    2576 patch_prober.go:28] interesting pod/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 17 00:52:22.916534 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:22.916341    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 17 00:52:23.916490 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:23.916447    2576 patch_prober.go:28] interesting pod/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 17 00:52:23.917146 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:23.917109    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 17 00:52:24.916952 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:24.916916    2576 patch_prober.go:28] interesting pod/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 17 00:52:24.917354 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:24.917018    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 17 00:52:25.920810 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:25.920773    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:52:25.921303 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:25.921180    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:52:25.921790 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:25.921770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:52:27.225731 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:27.225703    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:27.226143 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:27.225774    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:30.312300 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:30.312210    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d31e550-a17a-4658-83cd-519ca02eee13" containerID="a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872" exitCode=0
Sep 17 00:52:30.312691 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:30.312294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" event={"ID":"5d31e550-a17a-4658-83cd-519ca02eee13","Type":"ContainerDied","Data":"a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872"}
Sep 17 00:52:30.312746 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:30.312689    2576 scope.go:117] "RemoveContainer" containerID="a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872"
Sep 17 00:52:30.313950 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:30.313914    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:52:30.314100 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:30.314031    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:52:30.314100 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:30.314086    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:52:31.320315 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:31.320276    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" event={"ID":"5d31e550-a17a-4658-83cd-519ca02eee13","Type":"ContainerStarted","Data":"1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5"}
Sep 17 00:52:31.363679 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:31.363641    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:31.363872 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:31.363841    2576 patch_prober.go:28] interesting pod/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 00:52:31.363937 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:31.363888    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 00:52:32.363640 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:32.363607    2576 patch_prober.go:28] interesting pod/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 00:52:32.364049 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:32.363663    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 00:52:33.363691 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:33.363657    2576 patch_prober.go:28] interesting pod/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 00:52:33.364102 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:33.363721    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 00:52:34.364246 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:34.364215    2576 patch_prober.go:28] interesting pod/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 00:52:34.364637 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:34.364264    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 00:52:35.363418 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:35.363382    2576 patch_prober.go:28] interesting pod/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 00:52:35.363602 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:35.363451    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 00:52:36.364033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:36.364001    2576 patch_prober.go:28] interesting pod/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 00:52:36.364479 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:36.364065    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 00:52:37.151407 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:37.151372    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:37.405515 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:37.405431    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:37.406614 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:37.406591    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:52:58.557703 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.557671    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"]
Sep 17 00:52:58.558258 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.557875    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f" podUID="580f94c5-8d95-4d3b-ae7c-0514415d6a5d" containerName="payload-processing" containerID="cri-o://7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693" gracePeriod=30
Sep 17 00:52:58.562789 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.562764    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"]
Sep 17 00:52:58.563167 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.563124    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl" podUID="b4e7f687-6c6e-4dc0-9520-f3e3bce069a4" containerName="payload-pre-processing" containerID="cri-o://f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c" gracePeriod=30
Sep 17 00:52:58.862007 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.861981    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:58.864722 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.864697    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:58.966467 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.966432    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhz7l\" (UniqueName: \"kubernetes.io/projected/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-kube-api-access-hhz7l\") pod \"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4\" (UID: \"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4\") "
Sep 17 00:52:58.966654 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.966474    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2f2k\" (UniqueName: \"kubernetes.io/projected/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-kube-api-access-z2f2k\") pod \"580f94c5-8d95-4d3b-ae7c-0514415d6a5d\" (UID: \"580f94c5-8d95-4d3b-ae7c-0514415d6a5d\") "
Sep 17 00:52:58.966654 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.966553    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-plugins-config-volume\") pod \"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4\" (UID: \"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4\") "
Sep 17 00:52:58.966654 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.966577    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-plugins-config-volume\") pod \"580f94c5-8d95-4d3b-ae7c-0514415d6a5d\" (UID: \"580f94c5-8d95-4d3b-ae7c-0514415d6a5d\") "
Sep 17 00:52:58.966892 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.966866    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b4e7f687-6c6e-4dc0-9520-f3e3bce069a4" (UID: "b4e7f687-6c6e-4dc0-9520-f3e3bce069a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:52:58.966991 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.966946    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "580f94c5-8d95-4d3b-ae7c-0514415d6a5d" (UID: "580f94c5-8d95-4d3b-ae7c-0514415d6a5d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:52:58.968732 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.968704    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-kube-api-access-z2f2k" (OuterVolumeSpecName: "kube-api-access-z2f2k") pod "580f94c5-8d95-4d3b-ae7c-0514415d6a5d" (UID: "580f94c5-8d95-4d3b-ae7c-0514415d6a5d"). InnerVolumeSpecName "kube-api-access-z2f2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:52:58.968795 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:58.968740    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-kube-api-access-hhz7l" (OuterVolumeSpecName: "kube-api-access-hhz7l") pod "b4e7f687-6c6e-4dc0-9520-f3e3bce069a4" (UID: "b4e7f687-6c6e-4dc0-9520-f3e3bce069a4"). InnerVolumeSpecName "kube-api-access-hhz7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:52:59.067420 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.067381    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2f2k\" (UniqueName: \"kubernetes.io/projected/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-kube-api-access-z2f2k\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:59.067420 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.067408    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:59.067420 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.067418    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/580f94c5-8d95-4d3b-ae7c-0514415d6a5d-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:59.067420 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.067427    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhz7l\" (UniqueName: \"kubernetes.io/projected/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4-kube-api-access-hhz7l\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:52:59.486707 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.486667    2576 generic.go:356] "Generic (PLEG): container finished" podID="580f94c5-8d95-4d3b-ae7c-0514415d6a5d" containerID="7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693" exitCode=0
Sep 17 00:52:59.486882 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.486743    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"
Sep 17 00:52:59.486882 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.486756    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f" event={"ID":"580f94c5-8d95-4d3b-ae7c-0514415d6a5d","Type":"ContainerDied","Data":"7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693"}
Sep 17 00:52:59.486882 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.486838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f" event={"ID":"580f94c5-8d95-4d3b-ae7c-0514415d6a5d","Type":"ContainerDied","Data":"51f3781659bf9ab0e9b6d2ceb47a964f006e8494c94688a4e316ae088c304276"}
Sep 17 00:52:59.486882 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.486860    2576 scope.go:117] "RemoveContainer" containerID="7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693"
Sep 17 00:52:59.488240 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.488219    2576 generic.go:356] "Generic (PLEG): container finished" podID="b4e7f687-6c6e-4dc0-9520-f3e3bce069a4" containerID="f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c" exitCode=0
Sep 17 00:52:59.488327 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.488251    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl" event={"ID":"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4","Type":"ContainerDied","Data":"f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c"}
Sep 17 00:52:59.488327 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.488288    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"
Sep 17 00:52:59.488327 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.488306    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl" event={"ID":"b4e7f687-6c6e-4dc0-9520-f3e3bce069a4","Type":"ContainerDied","Data":"549acf4d3f93bc7a16f04013e000119deab16e8a6183515b51369ea42bc87275"}
Sep 17 00:52:59.497802 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.497787    2576 scope.go:117] "RemoveContainer" containerID="7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693"
Sep 17 00:52:59.498084 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:52:59.498068    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693\": container with ID starting with 7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693 not found: ID does not exist" containerID="7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693"
Sep 17 00:52:59.498161 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.498091    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693"} err="failed to get container status \"7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693\": rpc error: code = NotFound desc = could not find container \"7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693\": container with ID starting with 7e4ed39053f1acc66041dc6ed513458b7320bfd34786f3c36e1fac7bd3148693 not found: ID does not exist"
Sep 17 00:52:59.498161 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.498107    2576 scope.go:117] "RemoveContainer" containerID="f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c"
Sep 17 00:52:59.507007 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.506977    2576 scope.go:117] "RemoveContainer" containerID="f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c"
Sep 17 00:52:59.507287 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:52:59.507265    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c\": container with ID starting with f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c not found: ID does not exist" containerID="f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c"
Sep 17 00:52:59.507369 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.507294    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c"} err="failed to get container status \"f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c\": rpc error: code = NotFound desc = could not find container \"f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c\": container with ID starting with f8bb20276d3b0a92bfa276def96e04e632be3908bfedb504846b32b02896241c not found: ID does not exist"
Sep 17 00:52:59.509673 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.509649    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"]
Sep 17 00:52:59.511949 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.511929    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-69d1f859-5dc6c4dc85-vkk8f"]
Sep 17 00:52:59.522805 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.522780    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"]
Sep 17 00:52:59.529017 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:52:59.528997    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-69d1f859-8c4849594-tfdhl"]
Sep 17 00:53:00.142587 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:00.142548    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="580f94c5-8d95-4d3b-ae7c-0514415d6a5d" path="/var/lib/kubelet/pods/580f94c5-8d95-4d3b-ae7c-0514415d6a5d/volumes"
Sep 17 00:53:00.143122 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:00.143103    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4e7f687-6c6e-4dc0-9520-f3e3bce069a4" path="/var/lib/kubelet/pods/b4e7f687-6c6e-4dc0-9520-f3e3bce069a4/volumes"
Sep 17 00:53:05.604500 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:05.604464    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"]
Sep 17 00:53:05.604999 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:05.604763    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy" containerID="cri-o://1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5" gracePeriod=30
Sep 17 00:53:07.408350 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:07.408313    2576 patch_prober.go:28] interesting pod/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 00:53:07.408778 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:07.408388    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:53:10.866522 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.866467    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:53:10.991104 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991069    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-socket\") pod \"5d31e550-a17a-4658-83cd-519ca02eee13\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") "
Sep 17 00:53:10.991104 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991112    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d31e550-a17a-4658-83cd-519ca02eee13-istiod-ca-cert\") pod \"5d31e550-a17a-4658-83cd-519ca02eee13\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") "
Sep 17 00:53:10.991347 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991168    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-istio-token\") pod \"5d31e550-a17a-4658-83cd-519ca02eee13\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") "
Sep 17 00:53:10.991347 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991185    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d31e550-a17a-4658-83cd-519ca02eee13-istio-podinfo\") pod \"5d31e550-a17a-4658-83cd-519ca02eee13\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") "
Sep 17 00:53:10.991347 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991217    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-certs\") pod \"5d31e550-a17a-4658-83cd-519ca02eee13\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") "
Sep 17 00:53:10.991347 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991234    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-data\") pod \"5d31e550-a17a-4658-83cd-519ca02eee13\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") "
Sep 17 00:53:10.991347 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991253    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9fl8\" (UniqueName: \"kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-kube-api-access-t9fl8\") pod \"5d31e550-a17a-4658-83cd-519ca02eee13\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") "
Sep 17 00:53:10.991723 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991398    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d31e550-a17a-4658-83cd-519ca02eee13" (UID: "5d31e550-a17a-4658-83cd-519ca02eee13"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:10.991723 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991477    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-envoy\") pod \"5d31e550-a17a-4658-83cd-519ca02eee13\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") "
Sep 17 00:53:10.991723 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991522    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-credential-socket\") pod \"5d31e550-a17a-4658-83cd-519ca02eee13\" (UID: \"5d31e550-a17a-4658-83cd-519ca02eee13\") "
Sep 17 00:53:10.991723 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991533    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d31e550-a17a-4658-83cd-519ca02eee13" (UID: "5d31e550-a17a-4658-83cd-519ca02eee13"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:10.991723 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991593    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d31e550-a17a-4658-83cd-519ca02eee13" (UID: "5d31e550-a17a-4658-83cd-519ca02eee13"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:10.991723 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991599    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d31e550-a17a-4658-83cd-519ca02eee13-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d31e550-a17a-4658-83cd-519ca02eee13" (UID: "5d31e550-a17a-4658-83cd-519ca02eee13"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:53:10.992228 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991815    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:10.992228 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991832    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-data\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:10.992228 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991843    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-workload-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:10.992228 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991849    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d31e550-a17a-4658-83cd-519ca02eee13" (UID: "5d31e550-a17a-4658-83cd-519ca02eee13"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:10.992228 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.991857    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d31e550-a17a-4658-83cd-519ca02eee13-istiod-ca-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:10.993689 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.993663    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d31e550-a17a-4658-83cd-519ca02eee13" (UID: "5d31e550-a17a-4658-83cd-519ca02eee13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:53:10.993802 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.993698    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d31e550-a17a-4658-83cd-519ca02eee13" (UID: "5d31e550-a17a-4658-83cd-519ca02eee13"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:10.994086 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.994063    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d31e550-a17a-4658-83cd-519ca02eee13-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d31e550-a17a-4658-83cd-519ca02eee13" (UID: "5d31e550-a17a-4658-83cd-519ca02eee13"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:53:10.994086 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:10.994071    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-kube-api-access-t9fl8" (OuterVolumeSpecName: "kube-api-access-t9fl8") pod "5d31e550-a17a-4658-83cd-519ca02eee13" (UID: "5d31e550-a17a-4658-83cd-519ca02eee13"). InnerVolumeSpecName "kube-api-access-t9fl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:53:11.093049 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.093013    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-istio-token\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:11.093049 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.093043    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d31e550-a17a-4658-83cd-519ca02eee13-istio-podinfo\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:11.093049 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.093055    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9fl8\" (UniqueName: \"kubernetes.io/projected/5d31e550-a17a-4658-83cd-519ca02eee13-kube-api-access-t9fl8\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:11.093275 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.093069    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-istio-envoy\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:11.093275 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.093081    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d31e550-a17a-4658-83cd-519ca02eee13-credential-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:11.562657 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.562624    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d31e550-a17a-4658-83cd-519ca02eee13" containerID="1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5" exitCode=0
Sep 17 00:53:11.562657 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.562659    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" event={"ID":"5d31e550-a17a-4658-83cd-519ca02eee13","Type":"ContainerDied","Data":"1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5"}
Sep 17 00:53:11.562914 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.562678    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"
Sep 17 00:53:11.562914 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.562703    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf" event={"ID":"5d31e550-a17a-4658-83cd-519ca02eee13","Type":"ContainerDied","Data":"0bfb0635c5e0fc267c1e93d3ec88b437b3b9cefad30ea3d7c6a1cab382db4712"}
Sep 17 00:53:11.562914 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.562724    2576 scope.go:117] "RemoveContainer" containerID="1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5"
Sep 17 00:53:11.573662 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.573643    2576 scope.go:117] "RemoveContainer" containerID="a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872"
Sep 17 00:53:11.581833 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.581813    2576 scope.go:117] "RemoveContainer" containerID="1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5"
Sep 17 00:53:11.582322 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:53:11.582279    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5\": container with ID starting with 1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5 not found: ID does not exist" containerID="1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5"
Sep 17 00:53:11.582418 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.582332    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5"} err="failed to get container status \"1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5\": rpc error: code = NotFound desc = could not find container \"1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5\": container with ID starting with 1edd61a0822710e305fe54a4cf20f3ff61d0e5272a278513c61ef2f3406d2ba5 not found: ID does not exist"
Sep 17 00:53:11.582418 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.582375    2576 scope.go:117] "RemoveContainer" containerID="a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872"
Sep 17 00:53:11.582702 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:53:11.582678    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872\": container with ID starting with a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872 not found: ID does not exist" containerID="a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872"
Sep 17 00:53:11.582801 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.582707    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872"} err="failed to get container status \"a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872\": rpc error: code = NotFound desc = could not find container \"a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872\": container with ID starting with a5e36823a590b6d65e70e79b4492c8dcae6c09de592815849415ff6209c99872 not found: ID does not exist"
Sep 17 00:53:11.585476 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.585452    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"]
Sep 17 00:53:11.587711 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:11.587693    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-69d1f859-openshift-default-74dcbb556d-lsdtf"]
Sep 17 00:53:12.141308 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:12.141273    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" path="/var/lib/kubelet/pods/5d31e550-a17a-4658-83cd-519ca02eee13/volumes"
Sep 17 00:53:18.975790 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.975749    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"]
Sep 17 00:53:18.976352 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.976331    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e7f687-6c6e-4dc0-9520-f3e3bce069a4" containerName="payload-pre-processing"
Sep 17 00:53:18.976445 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.976356    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e7f687-6c6e-4dc0-9520-f3e3bce069a4" containerName="payload-pre-processing"
Sep 17 00:53:18.976445 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.976383    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy"
Sep 17 00:53:18.976445 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.976392    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy"
Sep 17 00:53:18.976445 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.976401    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580f94c5-8d95-4d3b-ae7c-0514415d6a5d" containerName="payload-processing"
Sep 17 00:53:18.976445 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.976412    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="580f94c5-8d95-4d3b-ae7c-0514415d6a5d" containerName="payload-processing"
Sep 17 00:53:18.976445 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.976424    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy"
Sep 17 00:53:18.976445 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.976432    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy"
Sep 17 00:53:18.976786 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.976536    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy"
Sep 17 00:53:18.976786 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.976551    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="580f94c5-8d95-4d3b-ae7c-0514415d6a5d" containerName="payload-processing"
Sep 17 00:53:18.976786 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.976561    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4e7f687-6c6e-4dc0-9520-f3e3bce069a4" containerName="payload-pre-processing"
Sep 17 00:53:18.981074 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.981053    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:18.983410 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.983385    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-929f3a-openshift-default-dockercfg-nv5sr\""
Sep 17 00:53:18.989269 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:18.989232    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"]
Sep 17 00:53:19.067747 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.067716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-envoy\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.067913 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.067753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-data\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.067913 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.067778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-socket\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.067913 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.067824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-certs\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.067913 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.067877    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-credential-socket\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.067913 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.067892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-token\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.068125 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.067938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istiod-ca-cert\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.068125 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.068004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-podinfo\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.068125 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.068021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnkb4\" (UniqueName: \"kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-kube-api-access-mnkb4\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.169145 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.169103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-certs\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.169789 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.169763    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-certs\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.169995 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.169856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-credential-socket\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.170157 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.170132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-token\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.170279 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.170183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istiod-ca-cert\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.170279 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.170227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-podinfo\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.170279 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.170250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnkb4\" (UniqueName: \"kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-kube-api-access-mnkb4\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.170448 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.170321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-envoy\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.170448 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.170342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-data\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.170448 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.170368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-socket\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.170637 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.170139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-credential-socket\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.170755 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.170685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-socket\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.170917 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.170893    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-data\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.171058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.171023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istiod-ca-cert\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.172804 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.172777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-envoy\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.173173 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.173154    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-podinfo\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.177359 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.177335    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnkb4\" (UniqueName: \"kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-kube-api-access-mnkb4\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.177797 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.177779    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-token\") pod \"e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") " pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.293660 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.293576    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:19.575837 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.574287    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"]
Sep 17 00:53:19.582063 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.582016    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:53:19.582180 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.582105    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:53:19.582180 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.582149    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:53:19.590853 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.590832    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"]
Sep 17 00:53:19.592484 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.592343    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy" containerID="cri-o://3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46" gracePeriod=30
Sep 17 00:53:19.611546 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:19.611515    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" event={"ID":"a2dbc5b3-adde-4a53-b931-6c2e1b587337","Type":"ContainerStarted","Data":"2b3343e2a68f589616f141f9c450ed480ab3c9d7585730b06fae24bd4f6c639e"}
Sep 17 00:53:20.618800 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:20.618762    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" event={"ID":"a2dbc5b3-adde-4a53-b931-6c2e1b587337","Type":"ContainerStarted","Data":"c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421"}
Sep 17 00:53:20.641029 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:20.640979    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" podStartSLOduration=2.64093974 podStartE2EDuration="2.64093974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:53:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:53:20.639436502 +0000 UTC m=+1393.066894438" watchObservedRunningTime="2026-09-17 00:53:20.64093974 +0000 UTC m=+1393.068397662"
Sep 17 00:53:21.294605 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:21.294571    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:21.299806 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:21.299786    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:21.624283 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:21.624188    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:21.625082 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:21.625064    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:24.863541 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:24.863484    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:53:25.025227 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.025192    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-podinfo\") pod \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") "
Sep 17 00:53:25.025384 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.025238    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-envoy\") pod \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") "
Sep 17 00:53:25.025384 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.025267    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istiod-ca-cert\") pod \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") "
Sep 17 00:53:25.025384 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.025286    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-socket\") pod \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") "
Sep 17 00:53:25.025384 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.025333    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-credential-socket\") pod \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") "
Sep 17 00:53:25.025384 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.025366    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-token\") pod \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") "
Sep 17 00:53:25.025666 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.025401    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpkpj\" (UniqueName: \"kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-kube-api-access-qpkpj\") pod \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") "
Sep 17 00:53:25.025666 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.025437    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-certs\") pod \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") "
Sep 17 00:53:25.025666 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.025488    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-data\") pod \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\" (UID: \"a5134ce1-e5bd-466a-a76e-80858c5c6b7e\") "
Sep 17 00:53:25.025834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.025802    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5134ce1-e5bd-466a-a76e-80858c5c6b7e" (UID: "a5134ce1-e5bd-466a-a76e-80858c5c6b7e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:53:25.026032 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.025992    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5134ce1-e5bd-466a-a76e-80858c5c6b7e" (UID: "a5134ce1-e5bd-466a-a76e-80858c5c6b7e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:25.026181 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.026074    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5134ce1-e5bd-466a-a76e-80858c5c6b7e" (UID: "a5134ce1-e5bd-466a-a76e-80858c5c6b7e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:25.026181 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.026128    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5134ce1-e5bd-466a-a76e-80858c5c6b7e" (UID: "a5134ce1-e5bd-466a-a76e-80858c5c6b7e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:25.026319 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.026205    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5134ce1-e5bd-466a-a76e-80858c5c6b7e" (UID: "a5134ce1-e5bd-466a-a76e-80858c5c6b7e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:25.027806 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.027785    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-kube-api-access-qpkpj" (OuterVolumeSpecName: "kube-api-access-qpkpj") pod "a5134ce1-e5bd-466a-a76e-80858c5c6b7e" (UID: "a5134ce1-e5bd-466a-a76e-80858c5c6b7e"). InnerVolumeSpecName "kube-api-access-qpkpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:53:25.028153 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.028122    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5134ce1-e5bd-466a-a76e-80858c5c6b7e" (UID: "a5134ce1-e5bd-466a-a76e-80858c5c6b7e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:53:25.028250 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.028229    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5134ce1-e5bd-466a-a76e-80858c5c6b7e" (UID: "a5134ce1-e5bd-466a-a76e-80858c5c6b7e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:25.028250 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.028229    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5134ce1-e5bd-466a-a76e-80858c5c6b7e" (UID: "a5134ce1-e5bd-466a-a76e-80858c5c6b7e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:53:25.127118 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.127035    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-data\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:25.127118 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.127062    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-podinfo\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:25.127118 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.127071    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-envoy\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:25.127118 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.127081    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istiod-ca-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:25.127118 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.127089    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:25.127118 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.127096    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-credential-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:25.127118 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.127104    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-istio-token\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:25.127118 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.127112    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpkpj\" (UniqueName: \"kubernetes.io/projected/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-kube-api-access-qpkpj\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:25.127118 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.127120    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5134ce1-e5bd-466a-a76e-80858c5c6b7e-workload-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:53:25.413494 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.413465    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"]
Sep 17 00:53:25.414002 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.413978    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy"
Sep 17 00:53:25.414002 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.414002    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy"
Sep 17 00:53:25.414204 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.414120    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy"
Sep 17 00:53:25.414204 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.414137    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy"
Sep 17 00:53:25.414204 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.414147    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d31e550-a17a-4658-83cd-519ca02eee13" containerName="istio-proxy"
Sep 17 00:53:25.418331 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.418316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 00:53:25.420507 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.420490    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-929f3a-dockercfg-6gzrj\""
Sep 17 00:53:25.420591 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.420515    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-929f3a\""
Sep 17 00:53:25.434458 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.430536    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"]
Sep 17 00:53:25.475169 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.475137    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"]
Sep 17 00:53:25.475518 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.475506    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy"
Sep 17 00:53:25.475562 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.475520    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerName="istio-proxy"
Sep 17 00:53:25.478486 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.478471    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 00:53:25.488153 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.488126    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"]
Sep 17 00:53:25.532761 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.532704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5schc\" (UniqueName: \"kubernetes.io/projected/57049135-13f7-4ffe-b378-192551367779-kube-api-access-5schc\") pod \"payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn\" (UID: \"57049135-13f7-4ffe-b378-192551367779\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 00:53:25.532950 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.532807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57049135-13f7-4ffe-b378-192551367779-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn\" (UID: \"57049135-13f7-4ffe-b378-192551367779\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 00:53:25.634002 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.633951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5schc\" (UniqueName: \"kubernetes.io/projected/57049135-13f7-4ffe-b378-192551367779-kube-api-access-5schc\") pod \"payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn\" (UID: \"57049135-13f7-4ffe-b378-192551367779\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 00:53:25.634002 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.634009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x\" (UID: \"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 00:53:25.634261 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.634039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57049135-13f7-4ffe-b378-192551367779-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn\" (UID: \"57049135-13f7-4ffe-b378-192551367779\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 00:53:25.634261 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.634120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmfd4\" (UniqueName: \"kubernetes.io/projected/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-kube-api-access-jmfd4\") pod \"payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x\" (UID: \"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 00:53:25.634973 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.634938    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57049135-13f7-4ffe-b378-192551367779-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn\" (UID: \"57049135-13f7-4ffe-b378-192551367779\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 00:53:25.641324 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.641299    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5schc\" (UniqueName: \"kubernetes.io/projected/57049135-13f7-4ffe-b378-192551367779-kube-api-access-5schc\") pod \"payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn\" (UID: \"57049135-13f7-4ffe-b378-192551367779\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 00:53:25.649907 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.649875    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" containerID="3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46" exitCode=0
Sep 17 00:53:25.650058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.649944    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" event={"ID":"a5134ce1-e5bd-466a-a76e-80858c5c6b7e","Type":"ContainerDied","Data":"3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46"}
Sep 17 00:53:25.650058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.650026    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w" event={"ID":"a5134ce1-e5bd-466a-a76e-80858c5c6b7e","Type":"ContainerDied","Data":"d4525dfad7deb1787e9fc0e0fe7f96f745c36c14a92f0fb0d08f4c62decf5f03"}
Sep 17 00:53:25.650058 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.649951    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"
Sep 17 00:53:25.650230 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.650055    2576 scope.go:117] "RemoveContainer" containerID="3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46"
Sep 17 00:53:25.659409 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.659393    2576 scope.go:117] "RemoveContainer" containerID="c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5"
Sep 17 00:53:25.667900 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.667884    2576 scope.go:117] "RemoveContainer" containerID="3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46"
Sep 17 00:53:25.668196 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:53:25.668172    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46\": container with ID starting with 3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46 not found: ID does not exist" containerID="3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46"
Sep 17 00:53:25.668270 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.668205    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46"} err="failed to get container status \"3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46\": rpc error: code = NotFound desc = could not find container \"3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46\": container with ID starting with 3afbb662f283e7d91a2295d5ae28aab1d5ec5e491d18667109fc4a910d769c46 not found: ID does not exist"
Sep 17 00:53:25.668270 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.668222    2576 scope.go:117] "RemoveContainer" containerID="c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5"
Sep 17 00:53:25.668552 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:53:25.668524    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5\": container with ID starting with c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5 not found: ID does not exist" containerID="c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5"
Sep 17 00:53:25.668610 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.668564    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5"} err="failed to get container status \"c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5\": rpc error: code = NotFound desc = could not find container \"c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5\": container with ID starting with c57c346e38fba2fc6fd869d068f2c6578db54d66bccb6b8e7166b23c7be6eaf5 not found: ID does not exist"
Sep 17 00:53:25.672028 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.672007    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"]
Sep 17 00:53:25.675466 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.675445    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-c98a88-openshift-default-5f877c7568-77n2w"]
Sep 17 00:53:25.733740 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.733705    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 00:53:25.735116 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.735092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x\" (UID: \"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 00:53:25.735205 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.735192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmfd4\" (UniqueName: \"kubernetes.io/projected/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-kube-api-access-jmfd4\") pod \"payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x\" (UID: \"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 00:53:25.735764 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.735747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x\" (UID: \"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 00:53:25.743793 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.743768    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmfd4\" (UniqueName: \"kubernetes.io/projected/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-kube-api-access-jmfd4\") pod \"payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x\" (UID: \"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 00:53:25.789137 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:25.789090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 00:53:26.026149 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:26.026121    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"]
Sep 17 00:53:26.027450 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:53:26.027426    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57049135_13f7_4ffe_b378_192551367779.slice/crio-916a728ea75aae7d64b16e39d55905a43420656531d0b01fde5b0c5dc424d02a WatchSource:0}: Error finding container 916a728ea75aae7d64b16e39d55905a43420656531d0b01fde5b0c5dc424d02a: Status 404 returned error can't find the container with id 916a728ea75aae7d64b16e39d55905a43420656531d0b01fde5b0c5dc424d02a
Sep 17 00:53:26.097058 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:53:26.097029    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d9bbfc_261f_46b0_87ca_fb52b99d0e3d.slice/crio-2e4e1c9c5ff3ad23f0237edd79f49ee1a08fe77c2b0b6d3c6ebdcf57df2dcd4f WatchSource:0}: Error finding container 2e4e1c9c5ff3ad23f0237edd79f49ee1a08fe77c2b0b6d3c6ebdcf57df2dcd4f: Status 404 returned error can't find the container with id 2e4e1c9c5ff3ad23f0237edd79f49ee1a08fe77c2b0b6d3c6ebdcf57df2dcd4f
Sep 17 00:53:26.097268 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:26.097244    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"]
Sep 17 00:53:26.142536 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:26.142510    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5134ce1-e5bd-466a-a76e-80858c5c6b7e" path="/var/lib/kubelet/pods/a5134ce1-e5bd-466a-a76e-80858c5c6b7e/volumes"
Sep 17 00:53:26.658574 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:26.658539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x" event={"ID":"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d","Type":"ContainerStarted","Data":"ddcef9a046d28e1de2243c24b315d0ad228c2d01a512b9c6d387a6b4c4aabaeb"}
Sep 17 00:53:26.658786 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:26.658607    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 00:53:26.658786 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:26.658629    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x" event={"ID":"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d","Type":"ContainerStarted","Data":"2e4e1c9c5ff3ad23f0237edd79f49ee1a08fe77c2b0b6d3c6ebdcf57df2dcd4f"}
Sep 17 00:53:26.660390 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:26.660301    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn" event={"ID":"57049135-13f7-4ffe-b378-192551367779","Type":"ContainerStarted","Data":"b84bef870ea900b7bb453d3eb9f0a20748a0566ab204ebb3fbf7b6852f1d9ba6"}
Sep 17 00:53:26.660390 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:26.660353    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn" event={"ID":"57049135-13f7-4ffe-b378-192551367779","Type":"ContainerStarted","Data":"916a728ea75aae7d64b16e39d55905a43420656531d0b01fde5b0c5dc424d02a"}
Sep 17 00:53:26.660588 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:26.660486    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 00:53:26.677120 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:26.677045    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x" podStartSLOduration=1.677026475 podStartE2EDuration="1.677026475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:53:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:53:26.673829217 +0000 UTC m=+1399.101287169" watchObservedRunningTime="2026-09-17 00:53:26.677026475 +0000 UTC m=+1399.104484401"
Sep 17 00:53:37.671088 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:37.671056    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 00:53:37.671739 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:37.671135    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 00:53:37.686535 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:37.686483    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn" podStartSLOduration=12.686468364 podStartE2EDuration="12.686468364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:53:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:53:26.693738836 +0000 UTC m=+1399.121196760" watchObservedRunningTime="2026-09-17 00:53:37.686468364 +0000 UTC m=+1410.113926336"
Sep 17 00:53:47.785067 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:47.785034    2576 generic.go:356] "Generic (PLEG): container finished" podID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerID="c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421" exitCode=0
Sep 17 00:53:47.785688 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:47.785083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" event={"ID":"a2dbc5b3-adde-4a53-b931-6c2e1b587337","Type":"ContainerDied","Data":"c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421"}
Sep 17 00:53:47.785688 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:47.785460    2576 scope.go:117] "RemoveContainer" containerID="c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421"
Sep 17 00:53:47.793171 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:47.787615    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:53:47.793171 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:47.787787    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:53:47.793171 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:47.788043    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:53:48.085153 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.085067    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"]
Sep 17 00:53:48.089534 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.089503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.092027 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.091999    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-93017d-openshift-default-dockercfg-77b77\""
Sep 17 00:53:48.100218 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.100188    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"]
Sep 17 00:53:48.149414 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.149377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istiod-ca-cert\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.149561 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.149426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-podinfo\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.149561 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.149495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-credential-socket\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.149639 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.149575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-envoy\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.149674 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.149627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-data\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.149708 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.149676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-certs\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.149742 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.149710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-socket\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.149776 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.149743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-token\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.149814 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.149780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sxl7\" (UniqueName: \"kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-kube-api-access-8sxl7\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.250320 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.250288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-socket\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.250496 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.250338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-token\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.250496 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.250390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sxl7\" (UniqueName: \"kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-kube-api-access-8sxl7\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.250496 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.250439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istiod-ca-cert\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.250496 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.250467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-podinfo\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.250729 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.250529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-credential-socket\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.250729 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.250643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-envoy\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.250729 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.250703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-data\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.250729 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.250708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-socket\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.250951 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.250755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-certs\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.251033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.250984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-data\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.251135 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.251107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-certs\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.251276 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.251252    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-credential-socket\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.251398 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.251276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istiod-ca-cert\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.253307 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.253276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-envoy\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.253754 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.253732    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-podinfo\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.257839 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.257815    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sxl7\" (UniqueName: \"kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-kube-api-access-8sxl7\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.258156 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.258136    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-token\") pod \"e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") " pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.404113 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.404083    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:48.692849 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.692753    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"]
Sep 17 00:53:48.699757 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:53:48.699721    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c665bf_a87d_47df_97c1_e77dfc47fd8a.slice/crio-befacf791fa8cd28dc776b3a30b5c544dae62f247bc70db6df634363747a7826 WatchSource:0}: Error finding container befacf791fa8cd28dc776b3a30b5c544dae62f247bc70db6df634363747a7826: Status 404 returned error can't find the container with id befacf791fa8cd28dc776b3a30b5c544dae62f247bc70db6df634363747a7826
Sep 17 00:53:48.702212 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.702177    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:53:48.702295 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.702252    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:53:48.702295 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.702284    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:53:48.797441 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.797397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" event={"ID":"19c665bf-a87d-47df-97c1-e77dfc47fd8a","Type":"ContainerStarted","Data":"7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0"}
Sep 17 00:53:48.797866 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.797469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" event={"ID":"19c665bf-a87d-47df-97c1-e77dfc47fd8a","Type":"ContainerStarted","Data":"befacf791fa8cd28dc776b3a30b5c544dae62f247bc70db6df634363747a7826"}
Sep 17 00:53:48.801324 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.801292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" event={"ID":"a2dbc5b3-adde-4a53-b931-6c2e1b587337","Type":"ContainerStarted","Data":"84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590"}
Sep 17 00:53:48.817226 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:48.817171    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" podStartSLOduration=0.817150696 podStartE2EDuration="817.150696ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:53:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:53:48.814609734 +0000 UTC m=+1421.242067670" watchObservedRunningTime="2026-09-17 00:53:48.817150696 +0000 UTC m=+1421.244608624"
Sep 17 00:53:49.293911 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:49.293871    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:49.295690 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:49.295381    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 17 00:53:49.295690 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:49.295438    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 17 00:53:49.405260 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:49.405223    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:49.407364 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:49.407325    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 17 00:53:49.407535 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:49.407395    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 17 00:53:50.294407 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:50.294357    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 17 00:53:50.294883 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:50.294433    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 17 00:53:50.408693 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:50.408655    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:50.813109 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:50.813083    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:50.814168 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:50.814146    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:53:51.295086 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:51.295032    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 17 00:53:51.295490 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:51.295110    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 17 00:53:51.625131 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:51.625041    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:52.295012 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:52.294940    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 17 00:53:52.295224 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:52.295039    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 17 00:53:53.294048 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:53.294008    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 17 00:53:53.294367 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:53.294075    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 17 00:53:54.298700 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:54.298669    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:53:54.300150 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:53:54.300128    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 00:54:17.966106 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:17.966075    2576 generic.go:356] "Generic (PLEG): container finished" podID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerID="7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0" exitCode=0
Sep 17 00:54:17.966530 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:17.966155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" event={"ID":"19c665bf-a87d-47df-97c1-e77dfc47fd8a","Type":"ContainerDied","Data":"7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0"}
Sep 17 00:54:17.966572 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:17.966547    2576 scope.go:117] "RemoveContainer" containerID="7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0"
Sep 17 00:54:17.967746 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:17.967717    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:54:17.967808 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:17.967797    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:54:17.967848 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:17.967829    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:54:18.975974 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:18.975911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" event={"ID":"19c665bf-a87d-47df-97c1-e77dfc47fd8a","Type":"ContainerStarted","Data":"f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3"}
Sep 17 00:54:19.404811 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:19.404770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:54:19.405943 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:19.405917    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 17 00:54:19.406083 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:19.406016    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 17 00:54:20.405314 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:20.405281    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 17 00:54:20.405713 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:20.405335    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 17 00:54:20.813269 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:20.813187    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:54:21.405131 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:21.405096    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 17 00:54:21.405313 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:21.405161    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 17 00:54:22.404807 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:22.404764    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 17 00:54:22.405229 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:22.404843    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 17 00:54:23.102693 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.102660    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"]
Sep 17 00:54:23.105868 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.105841    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.106046 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.105875    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"]
Sep 17 00:54:23.108077 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.108053    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a79f56\"/\"openshift-service-ca.crt\""
Sep 17 00:54:23.108472 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.108444    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a79f56\"/\"kube-root-ca.crt\""
Sep 17 00:54:23.108978 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.108940    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a79f56\"/\"default-dockercfg-lqgbh\""
Sep 17 00:54:23.109088 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.109066    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a79f56\"/\"distinct-2-w0-a79f56-kserve-self-signed-certs\""
Sep 17 00:54:23.214661 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.214628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2038c2c3-1cb8-4854-9315-ce55d49078ef-tls-certs\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.214661 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.214664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-tmp-dir\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.214881 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.214704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmshl\" (UniqueName: \"kubernetes.io/projected/2038c2c3-1cb8-4854-9315-ce55d49078ef-kube-api-access-cmshl\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.214881 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.214800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-dshm\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.214881 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.214825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-home\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.215024 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.214890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-model-cache\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.316056 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.316017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2038c2c3-1cb8-4854-9315-ce55d49078ef-tls-certs\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.316242 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.316065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-tmp-dir\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.316242 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.316113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmshl\" (UniqueName: \"kubernetes.io/projected/2038c2c3-1cb8-4854-9315-ce55d49078ef-kube-api-access-cmshl\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.316242 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.316161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-dshm\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.316242 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.316175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-home\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.316242 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.316227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-model-cache\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.316643 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.316621    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-tmp-dir\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.316643 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.316635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-home\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.316750 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.316671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-model-cache\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.319148 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.319125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-dshm\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.319290 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.319275    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2038c2c3-1cb8-4854-9315-ce55d49078ef-tls-certs\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.323793 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.323769    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmshl\" (UniqueName: \"kubernetes.io/projected/2038c2c3-1cb8-4854-9315-ce55d49078ef-kube-api-access-cmshl\") pod \"distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") " pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.404744 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.404706    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 17 00:54:23.404907 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.404774    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 17 00:54:23.416540 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.416512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:23.720322 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:23.720294    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"]
Sep 17 00:54:23.721437 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:54:23.721398    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2038c2c3_1cb8_4854_9315_ce55d49078ef.slice/crio-e924eb06c15b766f38fb01055cf577d6574a0f96e91be810372891b2b0bb8ca4 WatchSource:0}: Error finding container e924eb06c15b766f38fb01055cf577d6574a0f96e91be810372891b2b0bb8ca4: Status 404 returned error can't find the container with id e924eb06c15b766f38fb01055cf577d6574a0f96e91be810372891b2b0bb8ca4
Sep 17 00:54:24.014284 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:24.014161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6" event={"ID":"2038c2c3-1cb8-4854-9315-ce55d49078ef","Type":"ContainerStarted","Data":"336f3fd12e6007040d7ccd2ba92f94d8d1d822396d79b663f82c5dc851ad7253"}
Sep 17 00:54:24.014284 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:24.014225    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6" event={"ID":"2038c2c3-1cb8-4854-9315-ce55d49078ef","Type":"ContainerStarted","Data":"e924eb06c15b766f38fb01055cf577d6574a0f96e91be810372891b2b0bb8ca4"}
Sep 17 00:54:24.029953 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:24.029900    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6" podStartSLOduration=1.029884815 podStartE2EDuration="1.029884815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:54:24.028655237 +0000 UTC m=+1456.456113172" watchObservedRunningTime="2026-09-17 00:54:24.029884815 +0000 UTC m=+1456.457342737"
Sep 17 00:54:24.408861 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:24.408830    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:54:24.409859 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:24.409835    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 00:54:33.417124 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:33.417088    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:33.417547 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:33.417150    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:33.429972 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:33.429933    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:34.083299 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:34.083258    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:54:39.110384 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.110344    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"]
Sep 17 00:54:39.110833 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.110624    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c" podUID="5fc890b2-6240-4493-aacf-0441e06a4a30" containerName="maas-api" containerID="cri-o://7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10" gracePeriod=30
Sep 17 00:54:39.181459 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.181426    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"]
Sep 17 00:54:39.181688 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.181661    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h" podUID="d8db8f98-a9cb-4aa3-883b-14731ada7445" containerName="payload-pre-processing" containerID="cri-o://554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267" gracePeriod=30
Sep 17 00:54:39.434437 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.434405    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:54:39.473617 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.473594    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:54:39.579984 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.578482    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-metrics-certs\") pod \"5fc890b2-6240-4493-aacf-0441e06a4a30\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") "
Sep 17 00:54:39.579984 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.578578    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8db8f98-a9cb-4aa3-883b-14731ada7445-plugins-config-volume\") pod \"d8db8f98-a9cb-4aa3-883b-14731ada7445\" (UID: \"d8db8f98-a9cb-4aa3-883b-14731ada7445\") "
Sep 17 00:54:39.579984 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.578609    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-maas-api-tls\") pod \"5fc890b2-6240-4493-aacf-0441e06a4a30\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") "
Sep 17 00:54:39.579984 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.578665    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9c6r\" (UniqueName: \"kubernetes.io/projected/5fc890b2-6240-4493-aacf-0441e06a4a30-kube-api-access-l9c6r\") pod \"5fc890b2-6240-4493-aacf-0441e06a4a30\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") "
Sep 17 00:54:39.579984 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.578700    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtfwk\" (UniqueName: \"kubernetes.io/projected/d8db8f98-a9cb-4aa3-883b-14731ada7445-kube-api-access-wtfwk\") pod \"d8db8f98-a9cb-4aa3-883b-14731ada7445\" (UID: \"d8db8f98-a9cb-4aa3-883b-14731ada7445\") "
Sep 17 00:54:39.579984 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.578731    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc890b2-6240-4493-aacf-0441e06a4a30-openshift-service-ca\") pod \"5fc890b2-6240-4493-aacf-0441e06a4a30\" (UID: \"5fc890b2-6240-4493-aacf-0441e06a4a30\") "
Sep 17 00:54:39.579984 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.579308    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fc890b2-6240-4493-aacf-0441e06a4a30-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5fc890b2-6240-4493-aacf-0441e06a4a30" (UID: "5fc890b2-6240-4493-aacf-0441e06a4a30"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:54:39.579984 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.579761    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc890b2-6240-4493-aacf-0441e06a4a30-openshift-service-ca\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:54:39.580544 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.580213    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8db8f98-a9cb-4aa3-883b-14731ada7445-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8db8f98-a9cb-4aa3-883b-14731ada7445" (UID: "d8db8f98-a9cb-4aa3-883b-14731ada7445"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:54:39.584008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.582944    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5fc890b2-6240-4493-aacf-0441e06a4a30" (UID: "5fc890b2-6240-4493-aacf-0441e06a4a30"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:54:39.584008 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.583458    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5fc890b2-6240-4493-aacf-0441e06a4a30" (UID: "5fc890b2-6240-4493-aacf-0441e06a4a30"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:54:39.588981 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.584637    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8db8f98-a9cb-4aa3-883b-14731ada7445-kube-api-access-wtfwk" (OuterVolumeSpecName: "kube-api-access-wtfwk") pod "d8db8f98-a9cb-4aa3-883b-14731ada7445" (UID: "d8db8f98-a9cb-4aa3-883b-14731ada7445"). InnerVolumeSpecName "kube-api-access-wtfwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:54:39.591078 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.590825    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc890b2-6240-4493-aacf-0441e06a4a30-kube-api-access-l9c6r" (OuterVolumeSpecName: "kube-api-access-l9c6r") pod "5fc890b2-6240-4493-aacf-0441e06a4a30" (UID: "5fc890b2-6240-4493-aacf-0441e06a4a30"). InnerVolumeSpecName "kube-api-access-l9c6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:54:39.681252 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.681220    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-metrics-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:54:39.681252 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.681246    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8db8f98-a9cb-4aa3-883b-14731ada7445-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:54:39.681252 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.681255    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fc890b2-6240-4493-aacf-0441e06a4a30-maas-api-tls\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:54:39.681480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.681265    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9c6r\" (UniqueName: \"kubernetes.io/projected/5fc890b2-6240-4493-aacf-0441e06a4a30-kube-api-access-l9c6r\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:54:39.681480 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:39.681273    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtfwk\" (UniqueName: \"kubernetes.io/projected/d8db8f98-a9cb-4aa3-883b-14731ada7445-kube-api-access-wtfwk\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:54:40.110583 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.110493    2576 generic.go:356] "Generic (PLEG): container finished" podID="5fc890b2-6240-4493-aacf-0441e06a4a30" containerID="7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10" exitCode=0
Sep 17 00:54:40.110583 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.110553    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"
Sep 17 00:54:40.111158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.110578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c" event={"ID":"5fc890b2-6240-4493-aacf-0441e06a4a30","Type":"ContainerDied","Data":"7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10"}
Sep 17 00:54:40.111158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.110675    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c" event={"ID":"5fc890b2-6240-4493-aacf-0441e06a4a30","Type":"ContainerDied","Data":"845878771ea4024aa498e0d6f7ead4281c449f02c14a8385e2403f89a4179eb4"}
Sep 17 00:54:40.111158 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.110713    2576 scope.go:117] "RemoveContainer" containerID="7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10"
Sep 17 00:54:40.112179 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.112094    2576 generic.go:356] "Generic (PLEG): container finished" podID="d8db8f98-a9cb-4aa3-883b-14731ada7445" containerID="554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267" exitCode=0
Sep 17 00:54:40.112179 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.112124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h" event={"ID":"d8db8f98-a9cb-4aa3-883b-14731ada7445","Type":"ContainerDied","Data":"554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267"}
Sep 17 00:54:40.112179 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.112146    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"
Sep 17 00:54:40.112179 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.112175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h" event={"ID":"d8db8f98-a9cb-4aa3-883b-14731ada7445","Type":"ContainerDied","Data":"4ddad254158795343a85a6648fb7c412f91472d00b84064b257a60c88c025176"}
Sep 17 00:54:40.121397 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.121382    2576 scope.go:117] "RemoveContainer" containerID="7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10"
Sep 17 00:54:40.121748 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:54:40.121724    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10\": container with ID starting with 7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10 not found: ID does not exist" containerID="7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10"
Sep 17 00:54:40.121825 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.121759    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10"} err="failed to get container status \"7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10\": rpc error: code = NotFound desc = could not find container \"7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10\": container with ID starting with 7ea25cf5d4d344d3bd3af49f9efbf4fed4fe828957d75e2c04363c06d8a06d10 not found: ID does not exist"
Sep 17 00:54:40.121825 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.121782    2576 scope.go:117] "RemoveContainer" containerID="554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267"
Sep 17 00:54:40.135045 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.135018    2576 scope.go:117] "RemoveContainer" containerID="554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267"
Sep 17 00:54:40.135354 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:54:40.135330    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267\": container with ID starting with 554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267 not found: ID does not exist" containerID="554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267"
Sep 17 00:54:40.135452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.135365    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267"} err="failed to get container status \"554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267\": rpc error: code = NotFound desc = could not find container \"554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267\": container with ID starting with 554a0b52c803407c31debbed59b1a448a9af9b80bbc2fcd9c3a2ca64ef7ee267 not found: ID does not exist"
Sep 17 00:54:40.149147 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.149111    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"]
Sep 17 00:54:40.149591 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.149560    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e491c5-6cd5794768-98t4c"]
Sep 17 00:54:40.158289 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.158265    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"]
Sep 17 00:54:40.161636 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:40.161615    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e491c5-6b496b7b4b-wjp4h"]
Sep 17 00:54:42.141734 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:42.141698    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fc890b2-6240-4493-aacf-0441e06a4a30" path="/var/lib/kubelet/pods/5fc890b2-6240-4493-aacf-0441e06a4a30/volumes"
Sep 17 00:54:42.142160 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:42.142105    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8db8f98-a9cb-4aa3-883b-14731ada7445" path="/var/lib/kubelet/pods/d8db8f98-a9cb-4aa3-883b-14731ada7445/volumes"
Sep 17 00:54:56.610113 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:56.610070    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"]
Sep 17 00:54:56.610599 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:56.610366    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6" podUID="44be4eda-81b6-4163-9cb2-7daed82b049f" containerName="payload-processing" containerID="cri-o://355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c" gracePeriod=30
Sep 17 00:54:56.880030 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:56.879394    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:54:56.959333 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:56.959305    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk6mt\" (UniqueName: \"kubernetes.io/projected/44be4eda-81b6-4163-9cb2-7daed82b049f-kube-api-access-rk6mt\") pod \"44be4eda-81b6-4163-9cb2-7daed82b049f\" (UID: \"44be4eda-81b6-4163-9cb2-7daed82b049f\") "
Sep 17 00:54:56.959493 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:56.959364    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44be4eda-81b6-4163-9cb2-7daed82b049f-plugins-config-volume\") pod \"44be4eda-81b6-4163-9cb2-7daed82b049f\" (UID: \"44be4eda-81b6-4163-9cb2-7daed82b049f\") "
Sep 17 00:54:56.959731 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:56.959703    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44be4eda-81b6-4163-9cb2-7daed82b049f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44be4eda-81b6-4163-9cb2-7daed82b049f" (UID: "44be4eda-81b6-4163-9cb2-7daed82b049f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:54:56.961528 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:56.961505    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44be4eda-81b6-4163-9cb2-7daed82b049f-kube-api-access-rk6mt" (OuterVolumeSpecName: "kube-api-access-rk6mt") pod "44be4eda-81b6-4163-9cb2-7daed82b049f" (UID: "44be4eda-81b6-4163-9cb2-7daed82b049f"). InnerVolumeSpecName "kube-api-access-rk6mt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:54:57.060763 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:57.060726    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk6mt\" (UniqueName: \"kubernetes.io/projected/44be4eda-81b6-4163-9cb2-7daed82b049f-kube-api-access-rk6mt\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:54:57.060763 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:57.060758    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44be4eda-81b6-4163-9cb2-7daed82b049f-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:54:57.208697 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:57.208655    2576 generic.go:356] "Generic (PLEG): container finished" podID="44be4eda-81b6-4163-9cb2-7daed82b049f" containerID="355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c" exitCode=0
Sep 17 00:54:57.208869 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:57.208706    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"
Sep 17 00:54:57.208869 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:57.208740    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6" event={"ID":"44be4eda-81b6-4163-9cb2-7daed82b049f","Type":"ContainerDied","Data":"355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c"}
Sep 17 00:54:57.208869 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:57.208795    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6" event={"ID":"44be4eda-81b6-4163-9cb2-7daed82b049f","Type":"ContainerDied","Data":"12ae15552d529dc366f70872fd2c172048d315f49c8562422b8d87a9fa1da4f0"}
Sep 17 00:54:57.208869 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:57.208817    2576 scope.go:117] "RemoveContainer" containerID="355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c"
Sep 17 00:54:57.218374 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:57.218354    2576 scope.go:117] "RemoveContainer" containerID="355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c"
Sep 17 00:54:57.218631 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:54:57.218612    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c\": container with ID starting with 355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c not found: ID does not exist" containerID="355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c"
Sep 17 00:54:57.218703 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:57.218640    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c"} err="failed to get container status \"355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c\": rpc error: code = NotFound desc = could not find container \"355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c\": container with ID starting with 355e7db1160f768f3f6260613cd0c51159184dc502d66b176b2a9b4d9b71ee5c not found: ID does not exist"
Sep 17 00:54:57.230609 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:57.230577    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"]
Sep 17 00:54:57.233929 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:57.233907    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e421ba-7c55b69bf-dd4x6"]
Sep 17 00:54:58.142434 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:54:58.142402    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44be4eda-81b6-4163-9cb2-7daed82b049f" path="/var/lib/kubelet/pods/44be4eda-81b6-4163-9cb2-7daed82b049f/volumes"
Sep 17 00:55:10.340618 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.340582    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"]
Sep 17 00:55:10.341034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.340970    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8db8f98-a9cb-4aa3-883b-14731ada7445" containerName="payload-pre-processing"
Sep 17 00:55:10.341034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.340982    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8db8f98-a9cb-4aa3-883b-14731ada7445" containerName="payload-pre-processing"
Sep 17 00:55:10.341034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.341010    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc890b2-6240-4493-aacf-0441e06a4a30" containerName="maas-api"
Sep 17 00:55:10.341034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.341016    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc890b2-6240-4493-aacf-0441e06a4a30" containerName="maas-api"
Sep 17 00:55:10.341034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.341021    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44be4eda-81b6-4163-9cb2-7daed82b049f" containerName="payload-processing"
Sep 17 00:55:10.341034 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.341027    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44be4eda-81b6-4163-9cb2-7daed82b049f" containerName="payload-processing"
Sep 17 00:55:10.341229 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.341087    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fc890b2-6240-4493-aacf-0441e06a4a30" containerName="maas-api"
Sep 17 00:55:10.341229 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.341095    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8db8f98-a9cb-4aa3-883b-14731ada7445" containerName="payload-pre-processing"
Sep 17 00:55:10.341229 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.341105    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44be4eda-81b6-4163-9cb2-7daed82b049f" containerName="payload-processing"
Sep 17 00:55:10.345669 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.345648    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 00:55:10.348147 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.348123    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-d2326d-dockercfg-7th5g\""
Sep 17 00:55:10.348275 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.348123    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-d2326d\""
Sep 17 00:55:10.354410 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.354388    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"]
Sep 17 00:55:10.387736 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.387692    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e91ad05c-8547-44d0-9005-16dd5c21fb04-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2\" (UID: \"e91ad05c-8547-44d0-9005-16dd5c21fb04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 00:55:10.387891 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.387780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbnss\" (UniqueName: \"kubernetes.io/projected/e91ad05c-8547-44d0-9005-16dd5c21fb04-kube-api-access-kbnss\") pod \"payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2\" (UID: \"e91ad05c-8547-44d0-9005-16dd5c21fb04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 00:55:10.489236 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.489199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e91ad05c-8547-44d0-9005-16dd5c21fb04-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2\" (UID: \"e91ad05c-8547-44d0-9005-16dd5c21fb04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 00:55:10.489419 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.489257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbnss\" (UniqueName: \"kubernetes.io/projected/e91ad05c-8547-44d0-9005-16dd5c21fb04-kube-api-access-kbnss\") pod \"payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2\" (UID: \"e91ad05c-8547-44d0-9005-16dd5c21fb04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 00:55:10.490004 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.489950    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e91ad05c-8547-44d0-9005-16dd5c21fb04-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2\" (UID: \"e91ad05c-8547-44d0-9005-16dd5c21fb04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 00:55:10.497422 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.497393    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbnss\" (UniqueName: \"kubernetes.io/projected/e91ad05c-8547-44d0-9005-16dd5c21fb04-kube-api-access-kbnss\") pod \"payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2\" (UID: \"e91ad05c-8547-44d0-9005-16dd5c21fb04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 00:55:10.658765 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.658736    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 00:55:10.933774 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:10.933749    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"]
Sep 17 00:55:10.935816 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:55:10.935790    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91ad05c_8547_44d0_9005_16dd5c21fb04.slice/crio-c39b250d54324c3421096caea3f641c64e07172678b4063ce3bd47bf099afcd0 WatchSource:0}: Error finding container c39b250d54324c3421096caea3f641c64e07172678b4063ce3bd47bf099afcd0: Status 404 returned error can't find the container with id c39b250d54324c3421096caea3f641c64e07172678b4063ce3bd47bf099afcd0
Sep 17 00:55:11.288775 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:11.288674    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2" event={"ID":"e91ad05c-8547-44d0-9005-16dd5c21fb04","Type":"ContainerStarted","Data":"b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a"}
Sep 17 00:55:11.288775 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:11.288738    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2" event={"ID":"e91ad05c-8547-44d0-9005-16dd5c21fb04","Type":"ContainerStarted","Data":"c39b250d54324c3421096caea3f641c64e07172678b4063ce3bd47bf099afcd0"}
Sep 17 00:55:11.289027 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:11.288813    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 00:55:11.304651 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:11.304607    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2" podStartSLOduration=1.304592525 podStartE2EDuration="1.304592525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:55:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:55:11.301915053 +0000 UTC m=+1503.729372978" watchObservedRunningTime="2026-09-17 00:55:11.304592525 +0000 UTC m=+1503.732050494"
Sep 17 00:55:20.590553 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.590511    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"]
Sep 17 00:55:20.594358 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.594341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.596499 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.596479    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c7c845e1\"/\"kube-root-ca.crt\""
Sep 17 00:55:20.597245 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.597220    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c7c845e1\"/\"default-dockercfg-lfblt\""
Sep 17 00:55:20.597245 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.597232    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c7c845e1\"/\"openshift-service-ca.crt\""
Sep 17 00:55:20.597397 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.597270    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c7c845e1\"/\"e2e-lifecycle-model-c7c845e1-kserve-self-signed-certs\""
Sep 17 00:55:20.601500 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.601477    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"]
Sep 17 00:55:20.688423 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.688392    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-home\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.688575 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.688429    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvx9x\" (UniqueName: \"kubernetes.io/projected/0a4027dc-c19e-4d71-9862-10dd2d390715-kube-api-access-jvx9x\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.688575 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.688523    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-dshm\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.688662 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.688581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-model-cache\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.688662 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.688651    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-tmp-dir\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.688742 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.688722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a4027dc-c19e-4d71-9862-10dd2d390715-tls-certs\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.789679 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.789647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-model-cache\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.789813 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.789716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-tmp-dir\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.789813 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.789759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a4027dc-c19e-4d71-9862-10dd2d390715-tls-certs\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.789813 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.789781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-home\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.789813 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.789804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvx9x\" (UniqueName: \"kubernetes.io/projected/0a4027dc-c19e-4d71-9862-10dd2d390715-kube-api-access-jvx9x\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.790060 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.789840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-dshm\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.790155 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.790132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-model-cache\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.790220 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.790143    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-tmp-dir\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.790266 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.790214    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-home\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.792202 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.792183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-dshm\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.792357 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.792343    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a4027dc-c19e-4d71-9862-10dd2d390715-tls-certs\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.797263 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.797244    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvx9x\" (UniqueName: \"kubernetes.io/projected/0a4027dc-c19e-4d71-9862-10dd2d390715-kube-api-access-jvx9x\") pod \"e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") " pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:20.904452 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:20.904425    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:21.177412 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:21.177387    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"]
Sep 17 00:55:21.178735 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:55:21.178709    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a4027dc_c19e_4d71_9862_10dd2d390715.slice/crio-1094d97818f74227d087f8272c20b966d74b5417ff3b34e617dce1bf2c907f9e WatchSource:0}: Error finding container 1094d97818f74227d087f8272c20b966d74b5417ff3b34e617dce1bf2c907f9e: Status 404 returned error can't find the container with id 1094d97818f74227d087f8272c20b966d74b5417ff3b34e617dce1bf2c907f9e
Sep 17 00:55:21.346130 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:21.346096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s" event={"ID":"0a4027dc-c19e-4d71-9862-10dd2d390715","Type":"ContainerStarted","Data":"ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b"}
Sep 17 00:55:21.346295 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:21.346140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s" event={"ID":"0a4027dc-c19e-4d71-9862-10dd2d390715","Type":"ContainerStarted","Data":"1094d97818f74227d087f8272c20b966d74b5417ff3b34e617dce1bf2c907f9e"}
Sep 17 00:55:21.361211 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:21.361166    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s" podStartSLOduration=1.3611511250000001 podStartE2EDuration="1.361151125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:55:21.360107001 +0000 UTC m=+1513.787564926" watchObservedRunningTime="2026-09-17 00:55:21.361151125 +0000 UTC m=+1513.788609048"
Sep 17 00:55:22.295692 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:22.295664    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 00:55:30.905428 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:30.905338    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:30.905428 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:30.905412    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:30.922654 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:30.922620    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:31.411267 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:31.411232    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:55:32.356599 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.356569    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"]
Sep 17 00:55:32.366318 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.366295    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.369086 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.369066    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-bcd112-openshift-default-dockercfg-4rb5x\""
Sep 17 00:55:32.376736 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.376713    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"]
Sep 17 00:55:32.409310 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.409283    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-envoy\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.409446 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.409318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-data\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.409446 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.409343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/750bcf6e-f469-4059-b339-230e5545ebe8-istiod-ca-cert\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.409446 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.409433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/750bcf6e-f469-4059-b339-230e5545ebe8-istio-podinfo\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.409558 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.409477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-socket\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.409558 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.409503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-certs\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.409623 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.409594    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-istio-token\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.409658 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.409624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-credential-socket\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.409695 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.409664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq27k\" (UniqueName: \"kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-kube-api-access-bq27k\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.510718 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.510683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/750bcf6e-f469-4059-b339-230e5545ebe8-istio-podinfo\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.510888 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.510727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-socket\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.510888 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.510751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-certs\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.510888 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.510820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-istio-token\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.510888 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.510851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-credential-socket\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.511138 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.510919    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq27k\" (UniqueName: \"kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-kube-api-access-bq27k\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.511138 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.511010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-envoy\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.511138 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.511046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-data\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.511138 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.511094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/750bcf6e-f469-4059-b339-230e5545ebe8-istiod-ca-cert\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.511358 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.511175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-socket\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.511358 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.511197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-certs\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.511358 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.511305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-credential-socket\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.511523 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.511432    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-data\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.511715 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.511696    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/750bcf6e-f469-4059-b339-230e5545ebe8-istiod-ca-cert\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.513616 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.513595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/750bcf6e-f469-4059-b339-230e5545ebe8-istio-podinfo\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.513764 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.513745    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-envoy\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.518664 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.518618    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-istio-token\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.519136 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.519106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq27k\" (UniqueName: \"kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-kube-api-access-bq27k\") pod \"e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") " pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.684563 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.684528    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:32.966939 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.966912    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"]
Sep 17 00:55:32.968659 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:55:32.968627    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750bcf6e_f469_4059_b339_230e5545ebe8.slice/crio-c3771745047bd525e7be9b5238f73b4ccd5024f7942cc0648b8fb3e6e6e50122 WatchSource:0}: Error finding container c3771745047bd525e7be9b5238f73b4ccd5024f7942cc0648b8fb3e6e6e50122: Status 404 returned error can't find the container with id c3771745047bd525e7be9b5238f73b4ccd5024f7942cc0648b8fb3e6e6e50122
Sep 17 00:55:32.971065 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.971029    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:55:32.971156 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.971096    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:55:32.971156 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:32.971126    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:55:33.414336 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:33.414295    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" event={"ID":"750bcf6e-f469-4059-b339-230e5545ebe8","Type":"ContainerStarted","Data":"9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd"}
Sep 17 00:55:33.414708 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:33.414364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" event={"ID":"750bcf6e-f469-4059-b339-230e5545ebe8","Type":"ContainerStarted","Data":"c3771745047bd525e7be9b5238f73b4ccd5024f7942cc0648b8fb3e6e6e50122"}
Sep 17 00:55:33.436166 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:33.436118    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" podStartSLOduration=1.436104137 podStartE2EDuration="1.436104137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:55:33.433180577 +0000 UTC m=+1525.860638501" watchObservedRunningTime="2026-09-17 00:55:33.436104137 +0000 UTC m=+1525.863562059"
Sep 17 00:55:33.685104 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:33.685022    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:34.692992 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:34.692946    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:35.426194 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:35.426159    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:35.427074 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:35.427054    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:55:40.323202 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.323170    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"]
Sep 17 00:55:40.326707 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.326689    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 00:55:40.329263 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.329237    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-bcd112-dockercfg-2dwbd\""
Sep 17 00:55:40.329465 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.329380    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-bcd112\""
Sep 17 00:55:40.335722 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.335700    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"]
Sep 17 00:55:40.393163 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.393131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c2a25ad-01a4-4d02-9a01-81e62316bec0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk\" (UID: \"1c2a25ad-01a4-4d02-9a01-81e62316bec0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 00:55:40.393369 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.393206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xb45\" (UniqueName: \"kubernetes.io/projected/1c2a25ad-01a4-4d02-9a01-81e62316bec0-kube-api-access-9xb45\") pod \"payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk\" (UID: \"1c2a25ad-01a4-4d02-9a01-81e62316bec0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 00:55:40.494986 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.494915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xb45\" (UniqueName: \"kubernetes.io/projected/1c2a25ad-01a4-4d02-9a01-81e62316bec0-kube-api-access-9xb45\") pod \"payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk\" (UID: \"1c2a25ad-01a4-4d02-9a01-81e62316bec0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 00:55:40.495248 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.495140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c2a25ad-01a4-4d02-9a01-81e62316bec0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk\" (UID: \"1c2a25ad-01a4-4d02-9a01-81e62316bec0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 00:55:40.495945 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.495918    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c2a25ad-01a4-4d02-9a01-81e62316bec0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk\" (UID: \"1c2a25ad-01a4-4d02-9a01-81e62316bec0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 00:55:40.503990 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.503802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xb45\" (UniqueName: \"kubernetes.io/projected/1c2a25ad-01a4-4d02-9a01-81e62316bec0-kube-api-access-9xb45\") pod \"payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk\" (UID: \"1c2a25ad-01a4-4d02-9a01-81e62316bec0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 00:55:40.639519 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.639434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 00:55:40.911848 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:40.911817    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"]
Sep 17 00:55:40.912795 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:55:40.912771    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2a25ad_01a4_4d02_9a01_81e62316bec0.slice/crio-41785d1c5ba64324d1f4339d74c66717a9d0bdd6948d446112a4952ececc365c WatchSource:0}: Error finding container 41785d1c5ba64324d1f4339d74c66717a9d0bdd6948d446112a4952ececc365c: Status 404 returned error can't find the container with id 41785d1c5ba64324d1f4339d74c66717a9d0bdd6948d446112a4952ececc365c
Sep 17 00:55:41.460585 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:41.460540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk" event={"ID":"1c2a25ad-01a4-4d02-9a01-81e62316bec0","Type":"ContainerStarted","Data":"d92082239b2e177ece19717d78e398c6c2a7b4b9ad1fc3d31842a2df2d53e207"}
Sep 17 00:55:41.461041 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:41.460610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk" event={"ID":"1c2a25ad-01a4-4d02-9a01-81e62316bec0","Type":"ContainerStarted","Data":"41785d1c5ba64324d1f4339d74c66717a9d0bdd6948d446112a4952ececc365c"}
Sep 17 00:55:41.461041 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:41.460754    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 00:55:41.478256 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:41.478203    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk" podStartSLOduration=1.478182327 podStartE2EDuration="1.478182327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:55:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:55:41.474685261 +0000 UTC m=+1533.902143183" watchObservedRunningTime="2026-09-17 00:55:41.478182327 +0000 UTC m=+1533.905640251"
Sep 17 00:55:52.468000 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:55:52.467944    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 00:56:09.637073 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:09.637039    2576 generic.go:356] "Generic (PLEG): container finished" podID="750bcf6e-f469-4059-b339-230e5545ebe8" containerID="9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd" exitCode=0
Sep 17 00:56:09.637479 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:09.637114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" event={"ID":"750bcf6e-f469-4059-b339-230e5545ebe8","Type":"ContainerDied","Data":"9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd"}
Sep 17 00:56:09.637555 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:09.637540    2576 scope.go:117] "RemoveContainer" containerID="9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd"
Sep 17 00:56:09.638840 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:09.638808    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:56:09.638899 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:09.638886    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:56:09.638935 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:09.638918    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 00:56:10.645056 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:10.645022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" event={"ID":"750bcf6e-f469-4059-b339-230e5545ebe8","Type":"ContainerStarted","Data":"77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483"}
Sep 17 00:56:10.685280 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:10.685239    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:56:10.686069 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:10.685935    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 17 00:56:10.686283 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:10.686259    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 17 00:56:11.684990 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:11.684919    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 17 00:56:11.685498 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:11.685020    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 17 00:56:12.685308 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:12.685263    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 17 00:56:12.685908 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:12.685875    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 17 00:56:13.697177 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:13.697138    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 17 00:56:13.697773 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:13.697738    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 17 00:56:14.685903 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:14.685859    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 17 00:56:14.686254 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:14.686223    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 17 00:56:15.685044 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:15.684998    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 17 00:56:15.685580 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:15.685085    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 17 00:56:16.689205 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:16.689167    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:56:16.689647 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:16.689562    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:56:16.690303 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:16.690285    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 00:56:37.401643 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:37.401603    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"]
Sep 17 00:56:52.421841 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.421788    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s" podUID="0a4027dc-c19e-4d71-9862-10dd2d390715" containerName="main" containerID="cri-o://ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b" gracePeriod=45
Sep 17 00:56:52.665826 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.665800    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:56:52.713378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.713299    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-tmp-dir\") pod \"0a4027dc-c19e-4d71-9862-10dd2d390715\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") "
Sep 17 00:56:52.713378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.713340    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a4027dc-c19e-4d71-9862-10dd2d390715-tls-certs\") pod \"0a4027dc-c19e-4d71-9862-10dd2d390715\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") "
Sep 17 00:56:52.713378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.713360    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-model-cache\") pod \"0a4027dc-c19e-4d71-9862-10dd2d390715\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") "
Sep 17 00:56:52.713378 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.713378    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-home\") pod \"0a4027dc-c19e-4d71-9862-10dd2d390715\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") "
Sep 17 00:56:52.714033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.713428    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvx9x\" (UniqueName: \"kubernetes.io/projected/0a4027dc-c19e-4d71-9862-10dd2d390715-kube-api-access-jvx9x\") pod \"0a4027dc-c19e-4d71-9862-10dd2d390715\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") "
Sep 17 00:56:52.714033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.713489    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-dshm\") pod \"0a4027dc-c19e-4d71-9862-10dd2d390715\" (UID: \"0a4027dc-c19e-4d71-9862-10dd2d390715\") "
Sep 17 00:56:52.714033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.713623    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0a4027dc-c19e-4d71-9862-10dd2d390715" (UID: "0a4027dc-c19e-4d71-9862-10dd2d390715"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:56:52.714033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.713643    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-model-cache" (OuterVolumeSpecName: "model-cache") pod "0a4027dc-c19e-4d71-9862-10dd2d390715" (UID: "0a4027dc-c19e-4d71-9862-10dd2d390715"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:56:52.714033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.713711    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-home" (OuterVolumeSpecName: "home") pod "0a4027dc-c19e-4d71-9862-10dd2d390715" (UID: "0a4027dc-c19e-4d71-9862-10dd2d390715"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:56:52.714033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.713951    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-tmp-dir\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:56:52.714033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.713994    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-model-cache\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:56:52.714033 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.714011    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-home\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:56:52.715936 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.715914    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-dshm" (OuterVolumeSpecName: "dshm") pod "0a4027dc-c19e-4d71-9862-10dd2d390715" (UID: "0a4027dc-c19e-4d71-9862-10dd2d390715"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:56:52.716091 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.716072    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a4027dc-c19e-4d71-9862-10dd2d390715-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0a4027dc-c19e-4d71-9862-10dd2d390715" (UID: "0a4027dc-c19e-4d71-9862-10dd2d390715"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:56:52.716325 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.716308    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a4027dc-c19e-4d71-9862-10dd2d390715-kube-api-access-jvx9x" (OuterVolumeSpecName: "kube-api-access-jvx9x") pod "0a4027dc-c19e-4d71-9862-10dd2d390715" (UID: "0a4027dc-c19e-4d71-9862-10dd2d390715"). InnerVolumeSpecName "kube-api-access-jvx9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:56:52.814747 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.814714    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvx9x\" (UniqueName: \"kubernetes.io/projected/0a4027dc-c19e-4d71-9862-10dd2d390715-kube-api-access-jvx9x\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:56:52.814747 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.814742    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a4027dc-c19e-4d71-9862-10dd2d390715-dshm\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:56:52.814747 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.814751    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a4027dc-c19e-4d71-9862-10dd2d390715-tls-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:56:52.896266 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.896231    2576 generic.go:356] "Generic (PLEG): container finished" podID="0a4027dc-c19e-4d71-9862-10dd2d390715" containerID="ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b" exitCode=0
Sep 17 00:56:52.896423 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.896275    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"
Sep 17 00:56:52.896423 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.896308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s" event={"ID":"0a4027dc-c19e-4d71-9862-10dd2d390715","Type":"ContainerDied","Data":"ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b"}
Sep 17 00:56:52.896423 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.896353    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s" event={"ID":"0a4027dc-c19e-4d71-9862-10dd2d390715","Type":"ContainerDied","Data":"1094d97818f74227d087f8272c20b966d74b5417ff3b34e617dce1bf2c907f9e"}
Sep 17 00:56:52.896423 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.896372    2576 scope.go:117] "RemoveContainer" containerID="ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b"
Sep 17 00:56:52.905983 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.905953    2576 scope.go:117] "RemoveContainer" containerID="ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b"
Sep 17 00:56:52.906260 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:56:52.906240    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b\": container with ID starting with ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b not found: ID does not exist" containerID="ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b"
Sep 17 00:56:52.906362 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.906263    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b"} err="failed to get container status \"ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b\": rpc error: code = NotFound desc = could not find container \"ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b\": container with ID starting with ee8d2650442cd266bc099464de1a2549df05796aea6c19067b2218904e2c726b not found: ID does not exist"
Sep 17 00:56:52.916622 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.916597    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"]
Sep 17 00:56:52.923116 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:52.923084    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-c7c845e1/e2e-lifecycle-model-c7c845e1-kserve-bc5fb4fff-lxd8s"]
Sep 17 00:56:54.142079 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:56:54.142039    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a4027dc-c19e-4d71-9862-10dd2d390715" path="/var/lib/kubelet/pods/0a4027dc-c19e-4d71-9862-10dd2d390715/volumes"
Sep 17 00:58:06.144618 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:06.144584    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"]
Sep 17 00:58:16.727044 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:16.727011    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"]
Sep 17 00:58:16.727559 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:16.727362    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7" podUID="2e118ff2-c805-45c3-b170-0f55f7b3f6b2" containerName="maas-api" containerID="cri-o://02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468" gracePeriod=30
Sep 17 00:58:17.194934 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.194908    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:58:17.221663 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.221636    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-metrics-certs\") pod \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") "
Sep 17 00:58:17.221810 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.221698    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-maas-api-tls\") pod \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") "
Sep 17 00:58:17.221810 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.221731    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrh6t\" (UniqueName: \"kubernetes.io/projected/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-kube-api-access-nrh6t\") pod \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") "
Sep 17 00:58:17.221918 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.221842    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-openshift-service-ca\") pod \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\" (UID: \"2e118ff2-c805-45c3-b170-0f55f7b3f6b2\") "
Sep 17 00:58:17.222907 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.222222    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e118ff2-c805-45c3-b170-0f55f7b3f6b2" (UID: "2e118ff2-c805-45c3-b170-0f55f7b3f6b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:58:17.222907 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.222888    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-openshift-service-ca\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:17.224225 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.224201    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e118ff2-c805-45c3-b170-0f55f7b3f6b2" (UID: "2e118ff2-c805-45c3-b170-0f55f7b3f6b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:58:17.224451 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.224431    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2e118ff2-c805-45c3-b170-0f55f7b3f6b2" (UID: "2e118ff2-c805-45c3-b170-0f55f7b3f6b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:58:17.224507 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.224457    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-kube-api-access-nrh6t" (OuterVolumeSpecName: "kube-api-access-nrh6t") pod "2e118ff2-c805-45c3-b170-0f55f7b3f6b2" (UID: "2e118ff2-c805-45c3-b170-0f55f7b3f6b2"). InnerVolumeSpecName "kube-api-access-nrh6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:58:17.323944 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.323863    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-metrics-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:17.323944 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.323893    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-maas-api-tls\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:17.323944 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.323903    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrh6t\" (UniqueName: \"kubernetes.io/projected/2e118ff2-c805-45c3-b170-0f55f7b3f6b2-kube-api-access-nrh6t\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:17.368323 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.368292    2576 generic.go:356] "Generic (PLEG): container finished" podID="2e118ff2-c805-45c3-b170-0f55f7b3f6b2" containerID="02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468" exitCode=0
Sep 17 00:58:17.368474 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.368339    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"
Sep 17 00:58:17.368474 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.368378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7" event={"ID":"2e118ff2-c805-45c3-b170-0f55f7b3f6b2","Type":"ContainerDied","Data":"02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468"}
Sep 17 00:58:17.368474 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.368434    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7" event={"ID":"2e118ff2-c805-45c3-b170-0f55f7b3f6b2","Type":"ContainerDied","Data":"cb8724c97d9fbd038f4f3a1523ea3176a201f064bd70c67596f02435e659de56"}
Sep 17 00:58:17.368474 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.368458    2576 scope.go:117] "RemoveContainer" containerID="02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468"
Sep 17 00:58:17.379223 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.379205    2576 scope.go:117] "RemoveContainer" containerID="02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468"
Sep 17 00:58:17.379858 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:58:17.379520    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468\": container with ID starting with 02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468 not found: ID does not exist" containerID="02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468"
Sep 17 00:58:17.379858 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.379572    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468"} err="failed to get container status \"02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468\": rpc error: code = NotFound desc = could not find container \"02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468\": container with ID starting with 02af500bb58cad8be59b30b771ca78f496cd9334647e306a7985213d399af468 not found: ID does not exist"
Sep 17 00:58:17.390107 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.390084    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"]
Sep 17 00:58:17.392366 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:17.392345    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a79f56-58b6fd977d-rb8w7"]
Sep 17 00:58:18.141558 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:18.141516    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e118ff2-c805-45c3-b170-0f55f7b3f6b2" path="/var/lib/kubelet/pods/2e118ff2-c805-45c3-b170-0f55f7b3f6b2/volumes"
Sep 17 00:58:21.165100 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.165061    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6" podUID="2038c2c3-1cb8-4854-9315-ce55d49078ef" containerName="main" containerID="cri-o://336f3fd12e6007040d7ccd2ba92f94d8d1d822396d79b663f82c5dc851ad7253" gracePeriod=45
Sep 17 00:58:21.395453 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.395425    2576 generic.go:356] "Generic (PLEG): container finished" podID="2038c2c3-1cb8-4854-9315-ce55d49078ef" containerID="336f3fd12e6007040d7ccd2ba92f94d8d1d822396d79b663f82c5dc851ad7253" exitCode=0
Sep 17 00:58:21.395627 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.395494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6" event={"ID":"2038c2c3-1cb8-4854-9315-ce55d49078ef","Type":"ContainerDied","Data":"336f3fd12e6007040d7ccd2ba92f94d8d1d822396d79b663f82c5dc851ad7253"}
Sep 17 00:58:21.422298 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.422247    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:58:21.470708 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.470677    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-model-cache\") pod \"2038c2c3-1cb8-4854-9315-ce55d49078ef\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") "
Sep 17 00:58:21.470879 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.470762    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-dshm\") pod \"2038c2c3-1cb8-4854-9315-ce55d49078ef\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") "
Sep 17 00:58:21.470879 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.470812    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-tmp-dir\") pod \"2038c2c3-1cb8-4854-9315-ce55d49078ef\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") "
Sep 17 00:58:21.470879 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.470864    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmshl\" (UniqueName: \"kubernetes.io/projected/2038c2c3-1cb8-4854-9315-ce55d49078ef-kube-api-access-cmshl\") pod \"2038c2c3-1cb8-4854-9315-ce55d49078ef\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") "
Sep 17 00:58:21.471074 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.470906    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2038c2c3-1cb8-4854-9315-ce55d49078ef-tls-certs\") pod \"2038c2c3-1cb8-4854-9315-ce55d49078ef\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") "
Sep 17 00:58:21.471074 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.470916    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "2038c2c3-1cb8-4854-9315-ce55d49078ef" (UID: "2038c2c3-1cb8-4854-9315-ce55d49078ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:58:21.471193 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.471076    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2038c2c3-1cb8-4854-9315-ce55d49078ef" (UID: "2038c2c3-1cb8-4854-9315-ce55d49078ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:58:21.471193 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.471159    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-home\") pod \"2038c2c3-1cb8-4854-9315-ce55d49078ef\" (UID: \"2038c2c3-1cb8-4854-9315-ce55d49078ef\") "
Sep 17 00:58:21.471193 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.471171    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-home" (OuterVolumeSpecName: "home") pod "2038c2c3-1cb8-4854-9315-ce55d49078ef" (UID: "2038c2c3-1cb8-4854-9315-ce55d49078ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:58:21.471586 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.471554    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-home\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:21.471586 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.471581    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-model-cache\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:21.471764 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.471597    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-tmp-dir\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:21.473389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.473362    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2038c2c3-1cb8-4854-9315-ce55d49078ef-kube-api-access-cmshl" (OuterVolumeSpecName: "kube-api-access-cmshl") pod "2038c2c3-1cb8-4854-9315-ce55d49078ef" (UID: "2038c2c3-1cb8-4854-9315-ce55d49078ef"). InnerVolumeSpecName "kube-api-access-cmshl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:58:21.473389 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.473375    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2038c2c3-1cb8-4854-9315-ce55d49078ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2038c2c3-1cb8-4854-9315-ce55d49078ef" (UID: "2038c2c3-1cb8-4854-9315-ce55d49078ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:58:21.473541 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.473508    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-dshm" (OuterVolumeSpecName: "dshm") pod "2038c2c3-1cb8-4854-9315-ce55d49078ef" (UID: "2038c2c3-1cb8-4854-9315-ce55d49078ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:58:21.572766 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.572733    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2038c2c3-1cb8-4854-9315-ce55d49078ef-dshm\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:21.572766 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.572762    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmshl\" (UniqueName: \"kubernetes.io/projected/2038c2c3-1cb8-4854-9315-ce55d49078ef-kube-api-access-cmshl\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:21.572766 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:21.572773    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2038c2c3-1cb8-4854-9315-ce55d49078ef-tls-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:22.402207 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:22.402119    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"
Sep 17 00:58:22.402207 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:22.402158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6" event={"ID":"2038c2c3-1cb8-4854-9315-ce55d49078ef","Type":"ContainerDied","Data":"e924eb06c15b766f38fb01055cf577d6574a0f96e91be810372891b2b0bb8ca4"}
Sep 17 00:58:22.402742 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:22.402209    2576 scope.go:117] "RemoveContainer" containerID="336f3fd12e6007040d7ccd2ba92f94d8d1d822396d79b663f82c5dc851ad7253"
Sep 17 00:58:22.434433 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:22.434411    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"]
Sep 17 00:58:22.452979 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:22.452936    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a79f56/distinct-2-w0-a79f56-kserve-745f4bd7d8-7w8n6"]
Sep 17 00:58:23.902144 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:23.902109    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"]
Sep 17 00:58:23.902893 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:23.902836    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy" containerID="cri-o://4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3" gracePeriod=30
Sep 17 00:58:24.141988 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:24.141944    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2038c2c3-1cb8-4854-9315-ce55d49078ef" path="/var/lib/kubelet/pods/2038c2c3-1cb8-4854-9315-ce55d49078ef/volumes"
Sep 17 00:58:26.133645 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:26.133609    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 00:58:26.134055 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:26.133669    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:58:29.151509 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.151482    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:58:29.246512 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246409    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cbbr\" (UniqueName: \"kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-kube-api-access-6cbbr\") pod \"a5860f81-b169-4806-a905-371e98117a98\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") "
Sep 17 00:58:29.246512 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246471    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-socket\") pod \"a5860f81-b169-4806-a905-371e98117a98\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") "
Sep 17 00:58:29.246512 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246506    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-certs\") pod \"a5860f81-b169-4806-a905-371e98117a98\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") "
Sep 17 00:58:29.246785 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246549    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-data\") pod \"a5860f81-b169-4806-a905-371e98117a98\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") "
Sep 17 00:58:29.246785 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246590    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5860f81-b169-4806-a905-371e98117a98-istio-podinfo\") pod \"a5860f81-b169-4806-a905-371e98117a98\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") "
Sep 17 00:58:29.246785 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246658    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-credential-socket\") pod \"a5860f81-b169-4806-a905-371e98117a98\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") "
Sep 17 00:58:29.246785 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246696    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-envoy\") pod \"a5860f81-b169-4806-a905-371e98117a98\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") "
Sep 17 00:58:29.246785 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246727    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-istio-token\") pod \"a5860f81-b169-4806-a905-371e98117a98\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") "
Sep 17 00:58:29.246785 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246758    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5860f81-b169-4806-a905-371e98117a98-istiod-ca-cert\") pod \"a5860f81-b169-4806-a905-371e98117a98\" (UID: \"a5860f81-b169-4806-a905-371e98117a98\") "
Sep 17 00:58:29.247132 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246870    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5860f81-b169-4806-a905-371e98117a98" (UID: "a5860f81-b169-4806-a905-371e98117a98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:58:29.247132 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246886    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5860f81-b169-4806-a905-371e98117a98" (UID: "a5860f81-b169-4806-a905-371e98117a98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:58:29.247132 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.246865    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5860f81-b169-4806-a905-371e98117a98" (UID: "a5860f81-b169-4806-a905-371e98117a98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:58:29.247300 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.247199    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5860f81-b169-4806-a905-371e98117a98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5860f81-b169-4806-a905-371e98117a98" (UID: "a5860f81-b169-4806-a905-371e98117a98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:58:29.247300 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.247207    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:29.247300 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.247242    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-data\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:29.247300 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.247256    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-workload-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:29.247300 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.247275    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5860f81-b169-4806-a905-371e98117a98" (UID: "a5860f81-b169-4806-a905-371e98117a98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:58:29.249125 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.249097    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5860f81-b169-4806-a905-371e98117a98" (UID: "a5860f81-b169-4806-a905-371e98117a98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:58:29.249247 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.249227    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5860f81-b169-4806-a905-371e98117a98" (UID: "a5860f81-b169-4806-a905-371e98117a98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:58:29.249388 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.249372    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5860f81-b169-4806-a905-371e98117a98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5860f81-b169-4806-a905-371e98117a98" (UID: "a5860f81-b169-4806-a905-371e98117a98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:58:29.249388 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.249378    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-kube-api-access-6cbbr" (OuterVolumeSpecName: "kube-api-access-6cbbr") pod "a5860f81-b169-4806-a905-371e98117a98" (UID: "a5860f81-b169-4806-a905-371e98117a98"). InnerVolumeSpecName "kube-api-access-6cbbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:58:29.348017 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.347976    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5860f81-b169-4806-a905-371e98117a98-istio-podinfo\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:29.348017 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.348015    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-credential-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:29.348017 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.348026    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5860f81-b169-4806-a905-371e98117a98-istio-envoy\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:29.348227 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.348034    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-istio-token\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:29.348227 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.348042    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5860f81-b169-4806-a905-371e98117a98-istiod-ca-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:29.348227 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.348049    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cbbr\" (UniqueName: \"kubernetes.io/projected/a5860f81-b169-4806-a905-371e98117a98-kube-api-access-6cbbr\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 00:58:29.446861 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.446829    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5860f81-b169-4806-a905-371e98117a98" containerID="4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3" exitCode=0
Sep 17 00:58:29.447046 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.446877    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"
Sep 17 00:58:29.447046 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.446920    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" event={"ID":"a5860f81-b169-4806-a905-371e98117a98","Type":"ContainerDied","Data":"4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3"}
Sep 17 00:58:29.447046 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.447010    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf" event={"ID":"a5860f81-b169-4806-a905-371e98117a98","Type":"ContainerDied","Data":"c95aa2633d0d412ff489098c2fc13909273d14c2c4b6b1ac5744c9cd1c34c5f1"}
Sep 17 00:58:29.447046 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.447040    2576 scope.go:117] "RemoveContainer" containerID="4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3"
Sep 17 00:58:29.456917 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.456900    2576 scope.go:117] "RemoveContainer" containerID="e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce"
Sep 17 00:58:29.465221 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.465201    2576 scope.go:117] "RemoveContainer" containerID="4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3"
Sep 17 00:58:29.465515 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:58:29.465488    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3\": container with ID starting with 4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3 not found: ID does not exist" containerID="4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3"
Sep 17 00:58:29.465633 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.465524    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3"} err="failed to get container status \"4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3\": rpc error: code = NotFound desc = could not find container \"4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3\": container with ID starting with 4b79fb3b78dd169aeb5ea9062de1238a9b517e5e6c39300893f0797b543809b3 not found: ID does not exist"
Sep 17 00:58:29.465633 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.465545    2576 scope.go:117] "RemoveContainer" containerID="e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce"
Sep 17 00:58:29.465927 ip-10-0-128-98 kubenswrapper[2576]: E0917 00:58:29.465912    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce\": container with ID starting with e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce not found: ID does not exist" containerID="e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce"
Sep 17 00:58:29.465995 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.465931    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce"} err="failed to get container status \"e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce\": rpc error: code = NotFound desc = could not find container \"e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce\": container with ID starting with e38db4f77bc1810063aa6aa30fe9aa963577151f9902eda58ffd8307f0c084ce not found: ID does not exist"
Sep 17 00:58:29.475991 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.475273    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"]
Sep 17 00:58:29.475991 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:29.475323    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a79f56-openshift-default-c8cb9f796-z8whf"]
Sep 17 00:58:30.141881 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:58:30.141842    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5860f81-b169-4806-a905-371e98117a98" path="/var/lib/kubelet/pods/a5860f81-b169-4806-a905-371e98117a98/volumes"
Sep 17 00:59:01.376352 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376318    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"]
Sep 17 00:59:01.376834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376729    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a4027dc-c19e-4d71-9862-10dd2d390715" containerName="main"
Sep 17 00:59:01.376834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376746    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a4027dc-c19e-4d71-9862-10dd2d390715" containerName="main"
Sep 17 00:59:01.376834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376763    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e118ff2-c805-45c3-b170-0f55f7b3f6b2" containerName="maas-api"
Sep 17 00:59:01.376834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376769    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e118ff2-c805-45c3-b170-0f55f7b3f6b2" containerName="maas-api"
Sep 17 00:59:01.376834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376777    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy"
Sep 17 00:59:01.376834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376782    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy"
Sep 17 00:59:01.376834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376789    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2038c2c3-1cb8-4854-9315-ce55d49078ef" containerName="main"
Sep 17 00:59:01.376834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376794    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2038c2c3-1cb8-4854-9315-ce55d49078ef" containerName="main"
Sep 17 00:59:01.376834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376800    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy"
Sep 17 00:59:01.376834 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376805    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy"
Sep 17 00:59:01.377195 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376863    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy"
Sep 17 00:59:01.377195 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376872    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a4027dc-c19e-4d71-9862-10dd2d390715" containerName="main"
Sep 17 00:59:01.377195 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376878    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2038c2c3-1cb8-4854-9315-ce55d49078ef" containerName="main"
Sep 17 00:59:01.377195 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.376886    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e118ff2-c805-45c3-b170-0f55f7b3f6b2" containerName="maas-api"
Sep 17 00:59:01.380262 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.380239    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 00:59:01.382697 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.382661    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-1c4c89\""
Sep 17 00:59:01.382871 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.382673    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-1c4c89-dockercfg-c6mbn\""
Sep 17 00:59:01.390429 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.390401    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"]
Sep 17 00:59:01.397780 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.397751    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"]
Sep 17 00:59:01.398473 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.398452    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5860f81-b169-4806-a905-371e98117a98" containerName="istio-proxy"
Sep 17 00:59:01.401814 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.401795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 00:59:01.419085 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.419045    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"]
Sep 17 00:59:01.456036 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.455997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8bkf\" (UniqueName: \"kubernetes.io/projected/4fad7687-e016-40dc-b0d4-e420bd07bd0a-kube-api-access-w8bkf\") pod \"payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s\" (UID: \"4fad7687-e016-40dc-b0d4-e420bd07bd0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 00:59:01.456197 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.456058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cpfb\" (UniqueName: \"kubernetes.io/projected/fba6dbad-f57f-40a8-a38f-082797f4892f-kube-api-access-2cpfb\") pod \"payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q\" (UID: \"fba6dbad-f57f-40a8-a38f-082797f4892f\") " pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 00:59:01.456197 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.456131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fba6dbad-f57f-40a8-a38f-082797f4892f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q\" (UID: \"fba6dbad-f57f-40a8-a38f-082797f4892f\") " pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 00:59:01.456303 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.456277    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fad7687-e016-40dc-b0d4-e420bd07bd0a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s\" (UID: \"4fad7687-e016-40dc-b0d4-e420bd07bd0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 00:59:01.557266 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.557226    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fba6dbad-f57f-40a8-a38f-082797f4892f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q\" (UID: \"fba6dbad-f57f-40a8-a38f-082797f4892f\") " pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 00:59:01.557441 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.557313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fad7687-e016-40dc-b0d4-e420bd07bd0a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s\" (UID: \"4fad7687-e016-40dc-b0d4-e420bd07bd0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 00:59:01.557441 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.557359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8bkf\" (UniqueName: \"kubernetes.io/projected/4fad7687-e016-40dc-b0d4-e420bd07bd0a-kube-api-access-w8bkf\") pod \"payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s\" (UID: \"4fad7687-e016-40dc-b0d4-e420bd07bd0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 00:59:01.557441 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.557396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cpfb\" (UniqueName: \"kubernetes.io/projected/fba6dbad-f57f-40a8-a38f-082797f4892f-kube-api-access-2cpfb\") pod \"payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q\" (UID: \"fba6dbad-f57f-40a8-a38f-082797f4892f\") " pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 00:59:01.558053 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.558033    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fba6dbad-f57f-40a8-a38f-082797f4892f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q\" (UID: \"fba6dbad-f57f-40a8-a38f-082797f4892f\") " pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 00:59:01.558122 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.558104    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fad7687-e016-40dc-b0d4-e420bd07bd0a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s\" (UID: \"4fad7687-e016-40dc-b0d4-e420bd07bd0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 00:59:01.564739 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.564715    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cpfb\" (UniqueName: \"kubernetes.io/projected/fba6dbad-f57f-40a8-a38f-082797f4892f-kube-api-access-2cpfb\") pod \"payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q\" (UID: \"fba6dbad-f57f-40a8-a38f-082797f4892f\") " pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 00:59:01.564866 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.564808    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8bkf\" (UniqueName: \"kubernetes.io/projected/4fad7687-e016-40dc-b0d4-e420bd07bd0a-kube-api-access-w8bkf\") pod \"payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s\" (UID: \"4fad7687-e016-40dc-b0d4-e420bd07bd0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 00:59:01.694374 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.694345    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 00:59:01.719877 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.719840    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 00:59:01.972701 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:01.972640    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"]
Sep 17 00:59:01.973650 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:59:01.973610    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fad7687_e016_40dc_b0d4_e420bd07bd0a.slice/crio-6e728bf458e60c01ab13f7b320f6a67c8c3420870e5a1d2706b5770ec9b12bd1 WatchSource:0}: Error finding container 6e728bf458e60c01ab13f7b320f6a67c8c3420870e5a1d2706b5770ec9b12bd1: Status 404 returned error can't find the container with id 6e728bf458e60c01ab13f7b320f6a67c8c3420870e5a1d2706b5770ec9b12bd1
Sep 17 00:59:02.003418 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:02.003393    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"]
Sep 17 00:59:02.005171 ip-10-0-128-98 kubenswrapper[2576]: W0917 00:59:02.005141    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba6dbad_f57f_40a8_a38f_082797f4892f.slice/crio-cd1451cb03315faddb4cd053bd9c612aab8e789b612a60e37cbabc4a072ee0db WatchSource:0}: Error finding container cd1451cb03315faddb4cd053bd9c612aab8e789b612a60e37cbabc4a072ee0db: Status 404 returned error can't find the container with id cd1451cb03315faddb4cd053bd9c612aab8e789b612a60e37cbabc4a072ee0db
Sep 17 00:59:02.629179 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:02.629145    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q" event={"ID":"fba6dbad-f57f-40a8-a38f-082797f4892f","Type":"ContainerStarted","Data":"5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987"}
Sep 17 00:59:02.629631 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:02.629206    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q" event={"ID":"fba6dbad-f57f-40a8-a38f-082797f4892f","Type":"ContainerStarted","Data":"cd1451cb03315faddb4cd053bd9c612aab8e789b612a60e37cbabc4a072ee0db"}
Sep 17 00:59:02.629631 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:02.629327    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 00:59:02.630744 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:02.630720    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s" event={"ID":"4fad7687-e016-40dc-b0d4-e420bd07bd0a","Type":"ContainerStarted","Data":"878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e"}
Sep 17 00:59:02.630825 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:02.630763    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s" event={"ID":"4fad7687-e016-40dc-b0d4-e420bd07bd0a","Type":"ContainerStarted","Data":"6e728bf458e60c01ab13f7b320f6a67c8c3420870e5a1d2706b5770ec9b12bd1"}
Sep 17 00:59:02.630825 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:02.630805    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 00:59:02.643894 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:02.643853    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q" podStartSLOduration=1.643836765 podStartE2EDuration="1.643836765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:59:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:59:02.642839869 +0000 UTC m=+1735.070297793" watchObservedRunningTime="2026-09-17 00:59:02.643836765 +0000 UTC m=+1735.071294688"
Sep 17 00:59:02.658725 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:02.658681    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s" podStartSLOduration=1.658667678 podStartE2EDuration="1.658667678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:59:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:59:02.657304893 +0000 UTC m=+1735.084762817" watchObservedRunningTime="2026-09-17 00:59:02.658667678 +0000 UTC m=+1735.086125625"
Sep 17 00:59:13.638740 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:13.638711    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 00:59:13.639180 ip-10-0-128-98 kubenswrapper[2576]: I0917 00:59:13.638782    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 01:00:00.141560 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.141485    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94"]
Sep 17 01:00:00.145184 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.145160    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2"]
Sep 17 01:00:00.145454 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.145432    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94"
Sep 17 01:00:00.148429 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.148410    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f2hd4\""
Sep 17 01:00:00.149164 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.149146    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2"]
Sep 17 01:00:00.149377 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.149361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2"
Sep 17 01:00:00.152163 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.152138    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94"]
Sep 17 01:00:00.159938 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.159917    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94"
Sep 17 01:00:00.169014 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.168996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2"
Sep 17 01:00:00.450732 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.450707    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94"]
Sep 17 01:00:00.451704 ip-10-0-128-98 kubenswrapper[2576]: W0917 01:00:00.451678    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c10d4ec_4c83_431f_a906_d5e207e7703f.slice/crio-c71897e557f4b64b353ccfc2aec26051fb54a7ff6d31e9187dffd69e5cb0928e WatchSource:0}: Error finding container c71897e557f4b64b353ccfc2aec26051fb54a7ff6d31e9187dffd69e5cb0928e: Status 404 returned error can't find the container with id c71897e557f4b64b353ccfc2aec26051fb54a7ff6d31e9187dffd69e5cb0928e
Sep 17 01:00:00.453702 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.453645    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2"]
Sep 17 01:00:00.453702 ip-10-0-128-98 kubenswrapper[2576]: W0917 01:00:00.453679    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3916862_8816_496a_b30f_a9edc17dc57c.slice/crio-29fa2dddc0e1badee4f7259906beddcad5d528704241bd4375a9da7e63eabacb WatchSource:0}: Error finding container 29fa2dddc0e1badee4f7259906beddcad5d528704241bd4375a9da7e63eabacb: Status 404 returned error can't find the container with id 29fa2dddc0e1badee4f7259906beddcad5d528704241bd4375a9da7e63eabacb
Sep 17 01:00:00.454036 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.454016    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 01:00:00.965179 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.965145    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2" event={"ID":"b3916862-8816-496a-b30f-a9edc17dc57c","Type":"ContainerStarted","Data":"29fa2dddc0e1badee4f7259906beddcad5d528704241bd4375a9da7e63eabacb"}
Sep 17 01:00:00.966411 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:00.966388    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94" event={"ID":"6c10d4ec-4c83-431f-a906-d5e207e7703f","Type":"ContainerStarted","Data":"c71897e557f4b64b353ccfc2aec26051fb54a7ff6d31e9187dffd69e5cb0928e"}
Sep 17 01:00:03.989462 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:03.989424    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94" event={"ID":"6c10d4ec-4c83-431f-a906-d5e207e7703f","Type":"ContainerStarted","Data":"c6b455bf5f635c597b0489d92973934f2d61889f79e4b3215a57ec7c78edf197"}
Sep 17 01:00:03.991133 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:03.991102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2" event={"ID":"b3916862-8816-496a-b30f-a9edc17dc57c","Type":"ContainerStarted","Data":"d524e6cb0df06e819869cb3520f4df9be77f98ae3026f3000620780a8607f9f4"}
Sep 17 01:00:04.006362 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:04.006314    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94" podStartSLOduration=0.958662136 podStartE2EDuration="4.006299928s" totalImagesPullingTime="3.047637792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:00:04.004358346 +0000 UTC m=+1796.431816281" watchObservedRunningTime="2026-09-17 01:00:04.006299928 +0000 UTC m=+1796.433757850"
Sep 17 01:00:04.020164 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:04.020119    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2" podStartSLOduration=0.97862366 podStartE2EDuration="4.0201034s" totalImagesPullingTime="3.04147974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:00:04.017580475 +0000 UTC m=+1796.445038398" watchObservedRunningTime="2026-09-17 01:00:04.0201034 +0000 UTC m=+1796.447561323"
Sep 17 01:00:04.998594 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:04.998551    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3916862-8816-496a-b30f-a9edc17dc57c" containerID="d524e6cb0df06e819869cb3520f4df9be77f98ae3026f3000620780a8607f9f4" exitCode=0
Sep 17 01:00:04.999039 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:04.998614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2" event={"ID":"b3916862-8816-496a-b30f-a9edc17dc57c","Type":"ContainerDied","Data":"d524e6cb0df06e819869cb3520f4df9be77f98ae3026f3000620780a8607f9f4"}
Sep 17 01:00:05.000256 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:05.000236    2576 generic.go:356] "Generic (PLEG): container finished" podID="6c10d4ec-4c83-431f-a906-d5e207e7703f" containerID="c6b455bf5f635c597b0489d92973934f2d61889f79e4b3215a57ec7c78edf197" exitCode=0
Sep 17 01:00:05.000360 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:05.000301    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94" event={"ID":"6c10d4ec-4c83-431f-a906-d5e207e7703f","Type":"ContainerDied","Data":"c6b455bf5f635c597b0489d92973934f2d61889f79e4b3215a57ec7c78edf197"}
Sep 17 01:00:06.148148 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:06.148124    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2"
Sep 17 01:00:06.182463 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:06.182438    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94"
Sep 17 01:00:07.013494 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:07.013462    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2"
Sep 17 01:00:07.013702 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:07.013489    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2" event={"ID":"b3916862-8816-496a-b30f-a9edc17dc57c","Type":"ContainerDied","Data":"29fa2dddc0e1badee4f7259906beddcad5d528704241bd4375a9da7e63eabacb"}
Sep 17 01:00:07.013702 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:07.013574    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29fa2dddc0e1badee4f7259906beddcad5d528704241bd4375a9da7e63eabacb"
Sep 17 01:00:07.014940 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:07.014919    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94" event={"ID":"6c10d4ec-4c83-431f-a906-d5e207e7703f","Type":"ContainerDied","Data":"c71897e557f4b64b353ccfc2aec26051fb54a7ff6d31e9187dffd69e5cb0928e"}
Sep 17 01:00:07.014940 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:07.014938    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94"
Sep 17 01:00:07.015083 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:07.014981    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c71897e557f4b64b353ccfc2aec26051fb54a7ff6d31e9187dffd69e5cb0928e"
Sep 17 01:00:08.405160 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.405126    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2"]
Sep 17 01:00:08.408862 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.408823    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1c4c89-29826780-zgrb2"]
Sep 17 01:00:08.440644 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.440607    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"]
Sep 17 01:00:08.440921 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.440874    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q" podUID="fba6dbad-f57f-40a8-a38f-082797f4892f" containerName="payload-processing" containerID="cri-o://5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987" gracePeriod=30
Sep 17 01:00:08.454079 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.454056    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"]
Sep 17 01:00:08.454339 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.454293    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s" podUID="4fad7687-e016-40dc-b0d4-e420bd07bd0a" containerName="payload-pre-processing" containerID="cri-o://878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e" gracePeriod=30
Sep 17 01:00:08.730774 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.730733    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 01:00:08.744141 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.744116    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 01:00:08.906625 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.906591    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cpfb\" (UniqueName: \"kubernetes.io/projected/fba6dbad-f57f-40a8-a38f-082797f4892f-kube-api-access-2cpfb\") pod \"fba6dbad-f57f-40a8-a38f-082797f4892f\" (UID: \"fba6dbad-f57f-40a8-a38f-082797f4892f\") "
Sep 17 01:00:08.906805 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.906655    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8bkf\" (UniqueName: \"kubernetes.io/projected/4fad7687-e016-40dc-b0d4-e420bd07bd0a-kube-api-access-w8bkf\") pod \"4fad7687-e016-40dc-b0d4-e420bd07bd0a\" (UID: \"4fad7687-e016-40dc-b0d4-e420bd07bd0a\") "
Sep 17 01:00:08.906805 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.906672    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fad7687-e016-40dc-b0d4-e420bd07bd0a-plugins-config-volume\") pod \"4fad7687-e016-40dc-b0d4-e420bd07bd0a\" (UID: \"4fad7687-e016-40dc-b0d4-e420bd07bd0a\") "
Sep 17 01:00:08.906805 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.906742    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fba6dbad-f57f-40a8-a38f-082797f4892f-plugins-config-volume\") pod \"fba6dbad-f57f-40a8-a38f-082797f4892f\" (UID: \"fba6dbad-f57f-40a8-a38f-082797f4892f\") "
Sep 17 01:00:08.907136 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.907108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fad7687-e016-40dc-b0d4-e420bd07bd0a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4fad7687-e016-40dc-b0d4-e420bd07bd0a" (UID: "4fad7687-e016-40dc-b0d4-e420bd07bd0a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:00:08.907269 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.907180    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fba6dbad-f57f-40a8-a38f-082797f4892f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fba6dbad-f57f-40a8-a38f-082797f4892f" (UID: "fba6dbad-f57f-40a8-a38f-082797f4892f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:00:08.908933 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.908907    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fad7687-e016-40dc-b0d4-e420bd07bd0a-kube-api-access-w8bkf" (OuterVolumeSpecName: "kube-api-access-w8bkf") pod "4fad7687-e016-40dc-b0d4-e420bd07bd0a" (UID: "4fad7687-e016-40dc-b0d4-e420bd07bd0a"). InnerVolumeSpecName "kube-api-access-w8bkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:00:08.909053 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:08.908949    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fba6dbad-f57f-40a8-a38f-082797f4892f-kube-api-access-2cpfb" (OuterVolumeSpecName: "kube-api-access-2cpfb") pod "fba6dbad-f57f-40a8-a38f-082797f4892f" (UID: "fba6dbad-f57f-40a8-a38f-082797f4892f"). InnerVolumeSpecName "kube-api-access-2cpfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:00:09.007868 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.007785    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cpfb\" (UniqueName: \"kubernetes.io/projected/fba6dbad-f57f-40a8-a38f-082797f4892f-kube-api-access-2cpfb\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:09.007868 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.007815    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8bkf\" (UniqueName: \"kubernetes.io/projected/4fad7687-e016-40dc-b0d4-e420bd07bd0a-kube-api-access-w8bkf\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:09.007868 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.007825    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fad7687-e016-40dc-b0d4-e420bd07bd0a-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:09.007868 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.007833    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fba6dbad-f57f-40a8-a38f-082797f4892f-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:09.027103 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.027071    2576 generic.go:356] "Generic (PLEG): container finished" podID="4fad7687-e016-40dc-b0d4-e420bd07bd0a" containerID="878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e" exitCode=0
Sep 17 01:00:09.027245 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.027116    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"
Sep 17 01:00:09.027245 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.027154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s" event={"ID":"4fad7687-e016-40dc-b0d4-e420bd07bd0a","Type":"ContainerDied","Data":"878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e"}
Sep 17 01:00:09.027245 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.027228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s" event={"ID":"4fad7687-e016-40dc-b0d4-e420bd07bd0a","Type":"ContainerDied","Data":"6e728bf458e60c01ab13f7b320f6a67c8c3420870e5a1d2706b5770ec9b12bd1"}
Sep 17 01:00:09.027391 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.027252    2576 scope.go:117] "RemoveContainer" containerID="878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e"
Sep 17 01:00:09.028717 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.028696    2576 generic.go:356] "Generic (PLEG): container finished" podID="fba6dbad-f57f-40a8-a38f-082797f4892f" containerID="5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987" exitCode=0
Sep 17 01:00:09.028818 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.028730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q" event={"ID":"fba6dbad-f57f-40a8-a38f-082797f4892f","Type":"ContainerDied","Data":"5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987"}
Sep 17 01:00:09.028818 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.028734    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"
Sep 17 01:00:09.028818 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.028766    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q" event={"ID":"fba6dbad-f57f-40a8-a38f-082797f4892f","Type":"ContainerDied","Data":"cd1451cb03315faddb4cd053bd9c612aab8e789b612a60e37cbabc4a072ee0db"}
Sep 17 01:00:09.037278 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.037259    2576 scope.go:117] "RemoveContainer" containerID="878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e"
Sep 17 01:00:09.037527 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:00:09.037506    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e\": container with ID starting with 878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e not found: ID does not exist" containerID="878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e"
Sep 17 01:00:09.037606 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.037536    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e"} err="failed to get container status \"878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e\": rpc error: code = NotFound desc = could not find container \"878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e\": container with ID starting with 878fb54331677c4ba0e58247c28c0208bedde4206e240e6f519247ede2e8652e not found: ID does not exist"
Sep 17 01:00:09.037606 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.037552    2576 scope.go:117] "RemoveContainer" containerID="5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987"
Sep 17 01:00:09.046280 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.046264    2576 scope.go:117] "RemoveContainer" containerID="5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987"
Sep 17 01:00:09.046525 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:00:09.046505    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987\": container with ID starting with 5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987 not found: ID does not exist" containerID="5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987"
Sep 17 01:00:09.046590 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.046535    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987"} err="failed to get container status \"5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987\": rpc error: code = NotFound desc = could not find container \"5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987\": container with ID starting with 5ac5c6748f93c7aecfd0c10575017f9bdba4f1913c284130f952e9982f96d987 not found: ID does not exist"
Sep 17 01:00:09.051260 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.051239    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"]
Sep 17 01:00:09.053741 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.053721    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1c4c89-869d4f5f9d-8kv5s"]
Sep 17 01:00:09.060789 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.060771    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"]
Sep 17 01:00:09.066456 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:09.066433    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1c4c89-7b8c547bfc-92j6q"]
Sep 17 01:00:10.140873 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:10.140837    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fad7687-e016-40dc-b0d4-e420bd07bd0a" path="/var/lib/kubelet/pods/4fad7687-e016-40dc-b0d4-e420bd07bd0a/volumes"
Sep 17 01:00:10.141276 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:10.141189    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3916862-8816-496a-b30f-a9edc17dc57c" path="/var/lib/kubelet/pods/b3916862-8816-496a-b30f-a9edc17dc57c/volumes"
Sep 17 01:00:10.141504 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:10.141488    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fba6dbad-f57f-40a8-a38f-082797f4892f" path="/var/lib/kubelet/pods/fba6dbad-f57f-40a8-a38f-082797f4892f/volumes"
Sep 17 01:00:25.907865 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:25.907829    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"]
Sep 17 01:00:25.908344 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:25.908142    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn" podUID="57049135-13f7-4ffe-b378-192551367779" containerName="payload-processing" containerID="cri-o://b84bef870ea900b7bb453d3eb9f0a20748a0566ab204ebb3fbf7b6852f1d9ba6" gracePeriod=30
Sep 17 01:00:25.917381 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:25.917355    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"]
Sep 17 01:00:25.917845 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:25.917577    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x" podUID="41d9bbfc-261f-46b0-87ca-fb52b99d0e3d" containerName="payload-pre-processing" containerID="cri-o://ddcef9a046d28e1de2243c24b315d0ad228c2d01a512b9c6d387a6b4c4aabaeb" gracePeriod=30
Sep 17 01:00:26.129317 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.129286    2576 generic.go:356] "Generic (PLEG): container finished" podID="41d9bbfc-261f-46b0-87ca-fb52b99d0e3d" containerID="ddcef9a046d28e1de2243c24b315d0ad228c2d01a512b9c6d387a6b4c4aabaeb" exitCode=0
Sep 17 01:00:26.129500 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.129334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x" event={"ID":"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d","Type":"ContainerDied","Data":"ddcef9a046d28e1de2243c24b315d0ad228c2d01a512b9c6d387a6b4c4aabaeb"}
Sep 17 01:00:26.131422 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.131349    2576 generic.go:356] "Generic (PLEG): container finished" podID="57049135-13f7-4ffe-b378-192551367779" containerID="b84bef870ea900b7bb453d3eb9f0a20748a0566ab204ebb3fbf7b6852f1d9ba6" exitCode=0
Sep 17 01:00:26.131422 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.131399    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn" event={"ID":"57049135-13f7-4ffe-b378-192551367779","Type":"ContainerDied","Data":"b84bef870ea900b7bb453d3eb9f0a20748a0566ab204ebb3fbf7b6852f1d9ba6"}
Sep 17 01:00:26.179417 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.179356    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 01:00:26.207396 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.207364    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 01:00:26.266459 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.266423    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-plugins-config-volume\") pod \"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d\" (UID: \"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d\") "
Sep 17 01:00:26.266732 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.266714    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5schc\" (UniqueName: \"kubernetes.io/projected/57049135-13f7-4ffe-b378-192551367779-kube-api-access-5schc\") pod \"57049135-13f7-4ffe-b378-192551367779\" (UID: \"57049135-13f7-4ffe-b378-192551367779\") "
Sep 17 01:00:26.267308 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.266909    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41d9bbfc-261f-46b0-87ca-fb52b99d0e3d" (UID: "41d9bbfc-261f-46b0-87ca-fb52b99d0e3d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:00:26.267560 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.267544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57049135-13f7-4ffe-b378-192551367779-plugins-config-volume\") pod \"57049135-13f7-4ffe-b378-192551367779\" (UID: \"57049135-13f7-4ffe-b378-192551367779\") "
Sep 17 01:00:26.268201 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.268184    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmfd4\" (UniqueName: \"kubernetes.io/projected/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-kube-api-access-jmfd4\") pod \"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d\" (UID: \"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d\") "
Sep 17 01:00:26.268996 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.268977    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:26.269130 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.268083    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57049135-13f7-4ffe-b378-192551367779-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "57049135-13f7-4ffe-b378-192551367779" (UID: "57049135-13f7-4ffe-b378-192551367779"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:00:26.270447 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.270412    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57049135-13f7-4ffe-b378-192551367779-kube-api-access-5schc" (OuterVolumeSpecName: "kube-api-access-5schc") pod "57049135-13f7-4ffe-b378-192551367779" (UID: "57049135-13f7-4ffe-b378-192551367779"). InnerVolumeSpecName "kube-api-access-5schc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:00:26.272657 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.272623    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-kube-api-access-jmfd4" (OuterVolumeSpecName: "kube-api-access-jmfd4") pod "41d9bbfc-261f-46b0-87ca-fb52b99d0e3d" (UID: "41d9bbfc-261f-46b0-87ca-fb52b99d0e3d"). InnerVolumeSpecName "kube-api-access-jmfd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:00:26.370616 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.370569    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57049135-13f7-4ffe-b378-192551367779-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:26.370616 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.370617    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmfd4\" (UniqueName: \"kubernetes.io/projected/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d-kube-api-access-jmfd4\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:26.370825 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:26.370636    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5schc\" (UniqueName: \"kubernetes.io/projected/57049135-13f7-4ffe-b378-192551367779-kube-api-access-5schc\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:27.138848 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:27.138819    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"
Sep 17 01:00:27.139294 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:27.138854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn" event={"ID":"57049135-13f7-4ffe-b378-192551367779","Type":"ContainerDied","Data":"916a728ea75aae7d64b16e39d55905a43420656531d0b01fde5b0c5dc424d02a"}
Sep 17 01:00:27.139294 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:27.138912    2576 scope.go:117] "RemoveContainer" containerID="b84bef870ea900b7bb453d3eb9f0a20748a0566ab204ebb3fbf7b6852f1d9ba6"
Sep 17 01:00:27.140553 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:27.140538    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"
Sep 17 01:00:27.140652 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:27.140591    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x" event={"ID":"41d9bbfc-261f-46b0-87ca-fb52b99d0e3d","Type":"ContainerDied","Data":"2e4e1c9c5ff3ad23f0237edd79f49ee1a08fe77c2b0b6d3c6ebdcf57df2dcd4f"}
Sep 17 01:00:27.148765 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:27.148745    2576 scope.go:117] "RemoveContainer" containerID="ddcef9a046d28e1de2243c24b315d0ad228c2d01a512b9c6d387a6b4c4aabaeb"
Sep 17 01:00:27.199284 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:27.199222    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"]
Sep 17 01:00:27.205324 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:27.205297    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-929f3a-58d6cfb646-2sq7x"]
Sep 17 01:00:27.232100 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:27.232074    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"]
Sep 17 01:00:27.239118 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:27.239096    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-929f3a-79c759b5cc-b9bxn"]
Sep 17 01:00:28.141722 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:28.141686    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41d9bbfc-261f-46b0-87ca-fb52b99d0e3d" path="/var/lib/kubelet/pods/41d9bbfc-261f-46b0-87ca-fb52b99d0e3d/volumes"
Sep 17 01:00:28.142193 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:28.142173    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57049135-13f7-4ffe-b378-192551367779" path="/var/lib/kubelet/pods/57049135-13f7-4ffe-b378-192551367779/volumes"
Sep 17 01:00:32.219212 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:32.219174    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"]
Sep 17 01:00:32.219806 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:32.219387    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy" containerID="cri-o://84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590" gracePeriod=30
Sep 17 01:00:37.465095 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.465066    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 01:00:37.578823 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.578719    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istiod-ca-cert\") pod \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") "
Sep 17 01:00:37.578823 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.578809    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-socket\") pod \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") "
Sep 17 01:00:37.578823 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.578832    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-podinfo\") pod \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") "
Sep 17 01:00:37.579161 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.578883    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-credential-socket\") pod \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") "
Sep 17 01:00:37.579161 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.578906    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnkb4\" (UniqueName: \"kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-kube-api-access-mnkb4\") pod \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") "
Sep 17 01:00:37.579161 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.578933    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-token\") pod \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") "
Sep 17 01:00:37.579161 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.578980    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-certs\") pod \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") "
Sep 17 01:00:37.579161 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.579023    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-envoy\") pod \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") "
Sep 17 01:00:37.579161 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.579049    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-data\") pod \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\" (UID: \"a2dbc5b3-adde-4a53-b931-6c2e1b587337\") "
Sep 17 01:00:37.579476 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.579184    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a2dbc5b3-adde-4a53-b931-6c2e1b587337" (UID: "a2dbc5b3-adde-4a53-b931-6c2e1b587337"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:00:37.579476 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.579288    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a2dbc5b3-adde-4a53-b931-6c2e1b587337" (UID: "a2dbc5b3-adde-4a53-b931-6c2e1b587337"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:00:37.579476 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.579379    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a2dbc5b3-adde-4a53-b931-6c2e1b587337" (UID: "a2dbc5b3-adde-4a53-b931-6c2e1b587337"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:00:37.579476 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.579392    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-data" (OuterVolumeSpecName: "istio-data") pod "a2dbc5b3-adde-4a53-b931-6c2e1b587337" (UID: "a2dbc5b3-adde-4a53-b931-6c2e1b587337"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:00:37.579476 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.579425    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a2dbc5b3-adde-4a53-b931-6c2e1b587337" (UID: "a2dbc5b3-adde-4a53-b931-6c2e1b587337"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:00:37.579476 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.579453    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:37.579476 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.579475    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-workload-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:37.581385 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.581353    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-kube-api-access-mnkb4" (OuterVolumeSpecName: "kube-api-access-mnkb4") pod "a2dbc5b3-adde-4a53-b931-6c2e1b587337" (UID: "a2dbc5b3-adde-4a53-b931-6c2e1b587337"). InnerVolumeSpecName "kube-api-access-mnkb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:00:37.581499 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.581394    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a2dbc5b3-adde-4a53-b931-6c2e1b587337" (UID: "a2dbc5b3-adde-4a53-b931-6c2e1b587337"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:00:37.581499 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.581404    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-token" (OuterVolumeSpecName: "istio-token") pod "a2dbc5b3-adde-4a53-b931-6c2e1b587337" (UID: "a2dbc5b3-adde-4a53-b931-6c2e1b587337"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:00:37.581499 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.581422    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a2dbc5b3-adde-4a53-b931-6c2e1b587337" (UID: "a2dbc5b3-adde-4a53-b931-6c2e1b587337"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:00:37.680686 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.680640    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-envoy\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:37.680686 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.680677    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-data\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:37.680686 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.680686    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istiod-ca-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:37.680686 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.680693    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-podinfo\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:37.680951 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.680701    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2dbc5b3-adde-4a53-b931-6c2e1b587337-credential-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:37.680951 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.680712    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnkb4\" (UniqueName: \"kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-kube-api-access-mnkb4\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:37.680951 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:37.680733    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2dbc5b3-adde-4a53-b931-6c2e1b587337-istio-token\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:38.205214 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.205183    2576 generic.go:356] "Generic (PLEG): container finished" podID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerID="84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590" exitCode=0
Sep 17 01:00:38.205362 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.205233    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"
Sep 17 01:00:38.205362 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.205270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" event={"ID":"a2dbc5b3-adde-4a53-b931-6c2e1b587337","Type":"ContainerDied","Data":"84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590"}
Sep 17 01:00:38.205362 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.205323    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8" event={"ID":"a2dbc5b3-adde-4a53-b931-6c2e1b587337","Type":"ContainerDied","Data":"2b3343e2a68f589616f141f9c450ed480ab3c9d7585730b06fae24bd4f6c639e"}
Sep 17 01:00:38.205362 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.205348    2576 scope.go:117] "RemoveContainer" containerID="84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590"
Sep 17 01:00:38.217824 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.217805    2576 scope.go:117] "RemoveContainer" containerID="c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421"
Sep 17 01:00:38.223890 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.223867    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"]
Sep 17 01:00:38.226313 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.226294    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-929f3a-openshift-default-9fc7857db-7xzd8"]
Sep 17 01:00:38.227316 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.227300    2576 scope.go:117] "RemoveContainer" containerID="84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590"
Sep 17 01:00:38.227566 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:00:38.227544    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590\": container with ID starting with 84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590 not found: ID does not exist" containerID="84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590"
Sep 17 01:00:38.227659 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.227571    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590"} err="failed to get container status \"84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590\": rpc error: code = NotFound desc = could not find container \"84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590\": container with ID starting with 84ef99fc7b6bc1b260398125d9155c3c9c17d7e620982d224e1bd00fac355590 not found: ID does not exist"
Sep 17 01:00:38.227659 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.227590    2576 scope.go:117] "RemoveContainer" containerID="c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421"
Sep 17 01:00:38.227821 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:00:38.227806    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421\": container with ID starting with c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421 not found: ID does not exist" containerID="c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421"
Sep 17 01:00:38.227872 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:38.227825    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421"} err="failed to get container status \"c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421\": rpc error: code = NotFound desc = could not find container \"c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421\": container with ID starting with c1f0c61c8a054b002cafd40a76f3c2d5793d1afc443f507906ec8ce0fb7ab421 not found: ID does not exist"
Sep 17 01:00:40.141520 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:40.141485    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" path="/var/lib/kubelet/pods/a2dbc5b3-adde-4a53-b931-6c2e1b587337/volumes"
Sep 17 01:00:49.961865 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:49.961827    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"]
Sep 17 01:00:49.962256 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:49.962157    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy" containerID="cri-o://f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3" gracePeriod=30
Sep 17 01:00:54.411607 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:54.411567    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:00:54.412013 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:54.411633    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:00:55.218545 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.218522    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 01:00:55.249844 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.249767    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istiod-ca-cert\") pod \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") "
Sep 17 01:00:55.249844 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.249803    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sxl7\" (UniqueName: \"kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-kube-api-access-8sxl7\") pod \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") "
Sep 17 01:00:55.249844 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.249834    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-token\") pod \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") "
Sep 17 01:00:55.250170 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.249938    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-data\") pod \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") "
Sep 17 01:00:55.250170 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250050    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-credential-socket\") pod \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") "
Sep 17 01:00:55.250170 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250086    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-socket\") pod \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") "
Sep 17 01:00:55.250170 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250130    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-certs\") pod \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") "
Sep 17 01:00:55.250396 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250175    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-data" (OuterVolumeSpecName: "istio-data") pod "19c665bf-a87d-47df-97c1-e77dfc47fd8a" (UID: "19c665bf-a87d-47df-97c1-e77dfc47fd8a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:00:55.250396 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250195    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-podinfo\") pod \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") "
Sep 17 01:00:55.250396 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250198    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19c665bf-a87d-47df-97c1-e77dfc47fd8a" (UID: "19c665bf-a87d-47df-97c1-e77dfc47fd8a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:00:55.250396 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250225    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-envoy\") pod \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\" (UID: \"19c665bf-a87d-47df-97c1-e77dfc47fd8a\") "
Sep 17 01:00:55.250614 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250486    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19c665bf-a87d-47df-97c1-e77dfc47fd8a" (UID: "19c665bf-a87d-47df-97c1-e77dfc47fd8a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:00:55.250614 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250537    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19c665bf-a87d-47df-97c1-e77dfc47fd8a" (UID: "19c665bf-a87d-47df-97c1-e77dfc47fd8a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:00:55.250614 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250567    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:55.250614 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250586    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istiod-ca-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:55.250614 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250601    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-data\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:55.250874 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.250379    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19c665bf-a87d-47df-97c1-e77dfc47fd8a" (UID: "19c665bf-a87d-47df-97c1-e77dfc47fd8a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:00:55.252545 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.252511    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19c665bf-a87d-47df-97c1-e77dfc47fd8a" (UID: "19c665bf-a87d-47df-97c1-e77dfc47fd8a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:00:55.252692 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.252658    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19c665bf-a87d-47df-97c1-e77dfc47fd8a" (UID: "19c665bf-a87d-47df-97c1-e77dfc47fd8a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:00:55.252760 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.252741    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-kube-api-access-8sxl7" (OuterVolumeSpecName: "kube-api-access-8sxl7") pod "19c665bf-a87d-47df-97c1-e77dfc47fd8a" (UID: "19c665bf-a87d-47df-97c1-e77dfc47fd8a"). InnerVolumeSpecName "kube-api-access-8sxl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:00:55.252823 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.252748    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-token" (OuterVolumeSpecName: "istio-token") pod "19c665bf-a87d-47df-97c1-e77dfc47fd8a" (UID: "19c665bf-a87d-47df-97c1-e77dfc47fd8a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:00:55.299704 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.299670    2576 generic.go:356] "Generic (PLEG): container finished" podID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerID="f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3" exitCode=0
Sep 17 01:00:55.299849 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.299717    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"
Sep 17 01:00:55.299849 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.299763    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" event={"ID":"19c665bf-a87d-47df-97c1-e77dfc47fd8a","Type":"ContainerDied","Data":"f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3"}
Sep 17 01:00:55.299849 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.299817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s" event={"ID":"19c665bf-a87d-47df-97c1-e77dfc47fd8a","Type":"ContainerDied","Data":"befacf791fa8cd28dc776b3a30b5c544dae62f247bc70db6df634363747a7826"}
Sep 17 01:00:55.299973 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.299851    2576 scope.go:117] "RemoveContainer" containerID="f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3"
Sep 17 01:00:55.310625 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.310609    2576 scope.go:117] "RemoveContainer" containerID="7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0"
Sep 17 01:00:55.318883 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.318862    2576 scope.go:117] "RemoveContainer" containerID="f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3"
Sep 17 01:00:55.319191 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:00:55.319173    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3\": container with ID starting with f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3 not found: ID does not exist" containerID="f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3"
Sep 17 01:00:55.319246 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.319201    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3"} err="failed to get container status \"f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3\": rpc error: code = NotFound desc = could not find container \"f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3\": container with ID starting with f577c908d18bdb63a36c4ae5cf88b61d3472eda47a04bfcd9c292708bf88aef3 not found: ID does not exist"
Sep 17 01:00:55.319246 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.319218    2576 scope.go:117] "RemoveContainer" containerID="7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0"
Sep 17 01:00:55.319443 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:00:55.319430    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0\": container with ID starting with 7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0 not found: ID does not exist" containerID="7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0"
Sep 17 01:00:55.319480 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.319447    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0"} err="failed to get container status \"7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0\": rpc error: code = NotFound desc = could not find container \"7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0\": container with ID starting with 7a1c27eb5c10439aab8ddee8eda77e830f8e8a4da0ddb483733cd911995d0cb0 not found: ID does not exist"
Sep 17 01:00:55.322884 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.322861    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"]
Sep 17 01:00:55.326802 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.326782    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-93017d-openshift-default-7957b577f6-cr78s"]
Sep 17 01:00:55.351384 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.351361    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-credential-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:55.351489 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.351390    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-workload-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:55.351489 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.351405    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-podinfo\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:55.351489 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.351417    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-envoy\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:55.351489 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.351428    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sxl7\" (UniqueName: \"kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-kube-api-access-8sxl7\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:55.351489 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:55.351442    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c665bf-a87d-47df-97c1-e77dfc47fd8a-istio-token\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:00:56.140881 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:00:56.140854    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" path="/var/lib/kubelet/pods/19c665bf-a87d-47df-97c1-e77dfc47fd8a/volumes"
Sep 17 01:02:45.087853 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.087817    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"]
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088371    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088393    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088413    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3916862-8816-496a-b30f-a9edc17dc57c" containerName="cleanup"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088422    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3916862-8816-496a-b30f-a9edc17dc57c" containerName="cleanup"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088432    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088440    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088459    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57049135-13f7-4ffe-b378-192551367779" containerName="payload-processing"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088468    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="57049135-13f7-4ffe-b378-192551367779" containerName="payload-processing"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088481    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d9bbfc-261f-46b0-87ca-fb52b99d0e3d" containerName="payload-pre-processing"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088490    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d9bbfc-261f-46b0-87ca-fb52b99d0e3d" containerName="payload-pre-processing"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088498    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fad7687-e016-40dc-b0d4-e420bd07bd0a" containerName="payload-pre-processing"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088507    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fad7687-e016-40dc-b0d4-e420bd07bd0a" containerName="payload-pre-processing"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088517    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fba6dbad-f57f-40a8-a38f-082797f4892f" containerName="payload-processing"
Sep 17 01:02:45.088518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088525    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fba6dbad-f57f-40a8-a38f-082797f4892f" containerName="payload-processing"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088534    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c10d4ec-4c83-431f-a906-d5e207e7703f" containerName="cleanup"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088539    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c10d4ec-4c83-431f-a906-d5e207e7703f" containerName="cleanup"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088555    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088560    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088632    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fad7687-e016-40dc-b0d4-e420bd07bd0a" containerName="payload-pre-processing"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088641    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="57049135-13f7-4ffe-b378-192551367779" containerName="payload-processing"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088649    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fba6dbad-f57f-40a8-a38f-082797f4892f" containerName="payload-processing"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088662    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088668    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d9bbfc-261f-46b0-87ca-fb52b99d0e3d" containerName="payload-pre-processing"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088676    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c10d4ec-4c83-431f-a906-d5e207e7703f" containerName="cleanup"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088685    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088694    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2dbc5b3-adde-4a53-b931-6c2e1b587337" containerName="istio-proxy"
Sep 17 01:02:45.089270 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.088700    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3916862-8816-496a-b30f-a9edc17dc57c" containerName="cleanup"
Sep 17 01:02:45.090752 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.090732    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.093134 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.093110    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-7e9533-openshift-default-dockercfg-m88jp\""
Sep 17 01:02:45.101931 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.101907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"]
Sep 17 01:02:45.217866 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.217828    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-certs\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.218080 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.217883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0456e8e-f03b-48e9-8dad-300322cb61a6-istiod-ca-cert\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.218080 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.218046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-credential-socket\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.218238 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.218095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-socket\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.218238 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.218140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-podinfo\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.218238 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.218210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-token\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.218371 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.218243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-envoy\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.218371 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.218289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-data\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.218371 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.218324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs6dj\" (UniqueName: \"kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-kube-api-access-fs6dj\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319266 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-token\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319266 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-envoy\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319508 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-data\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319508 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs6dj\" (UniqueName: \"kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-kube-api-access-fs6dj\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319508 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-certs\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319508 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0456e8e-f03b-48e9-8dad-300322cb61a6-istiod-ca-cert\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319508 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-credential-socket\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319508 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-socket\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319508 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-podinfo\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319863 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319686    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-data\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319863 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-certs\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.319863 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.319818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-credential-socket\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.320106 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.320066    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-socket\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.320285 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.320183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0456e8e-f03b-48e9-8dad-300322cb61a6-istiod-ca-cert\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.321771 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.321747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-envoy\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.321997 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.321978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-podinfo\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.331603 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.331581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-token\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.331839 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.331822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs6dj\" (UniqueName: \"kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-kube-api-access-fs6dj\") pod \"e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") " pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.404013 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.403980    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:45.676536 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.676510    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"]
Sep 17 01:02:45.678161 ip-10-0-128-98 kubenswrapper[2576]: W0917 01:02:45.678137    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0456e8e_f03b_48e9_8dad_300322cb61a6.slice/crio-2273c841bc9be34f967fb3b84a0e1380db7a3193fee7329853f5bdc8a7d77c30 WatchSource:0}: Error finding container 2273c841bc9be34f967fb3b84a0e1380db7a3193fee7329853f5bdc8a7d77c30: Status 404 returned error can't find the container with id 2273c841bc9be34f967fb3b84a0e1380db7a3193fee7329853f5bdc8a7d77c30
Sep 17 01:02:45.680323 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.680293    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:02:45.680394 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.680359    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:02:45.680394 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.680385    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:02:45.888733 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.888696    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" event={"ID":"c0456e8e-f03b-48e9-8dad-300322cb61a6","Type":"ContainerStarted","Data":"9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb"}
Sep 17 01:02:45.888939 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.888764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" event={"ID":"c0456e8e-f03b-48e9-8dad-300322cb61a6","Type":"ContainerStarted","Data":"2273c841bc9be34f967fb3b84a0e1380db7a3193fee7329853f5bdc8a7d77c30"}
Sep 17 01:02:45.909483 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:45.909426    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" podStartSLOduration=0.909408663 podStartE2EDuration="909.408663ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:02:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:02:45.906302659 +0000 UTC m=+1958.333760583" watchObservedRunningTime="2026-09-17 01:02:45.909408663 +0000 UTC m=+1958.336866585"
Sep 17 01:02:46.404421 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:46.404387    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:46.409518 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:46.409495    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:46.894835 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:46.894742    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:46.896002 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:46.895942    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:02:50.081436 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.081405    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"]
Sep 17 01:02:50.081948 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.081929    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy"
Sep 17 01:02:50.082065 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.081953    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy"
Sep 17 01:02:50.082065 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.082052    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c665bf-a87d-47df-97c1-e77dfc47fd8a" containerName="istio-proxy"
Sep 17 01:02:50.084166 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.084146    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:02:50.086413 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.086394    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-7e9533\""
Sep 17 01:02:50.086517 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.086394    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-7e9533-dockercfg-5rr7k\""
Sep 17 01:02:50.099907 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.099868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"]
Sep 17 01:02:50.169192 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.169149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj\" (UID: \"dadd204f-edd2-4399-9e50-ecf1cf4ae99b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:02:50.169367 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.169313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr7l9\" (UniqueName: \"kubernetes.io/projected/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-kube-api-access-hr7l9\") pod \"payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj\" (UID: \"dadd204f-edd2-4399-9e50-ecf1cf4ae99b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:02:50.270777 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.270739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj\" (UID: \"dadd204f-edd2-4399-9e50-ecf1cf4ae99b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:02:50.271003 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.270849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr7l9\" (UniqueName: \"kubernetes.io/projected/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-kube-api-access-hr7l9\") pod \"payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj\" (UID: \"dadd204f-edd2-4399-9e50-ecf1cf4ae99b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:02:50.271541 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.271519    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj\" (UID: \"dadd204f-edd2-4399-9e50-ecf1cf4ae99b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:02:50.278216 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.278193    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr7l9\" (UniqueName: \"kubernetes.io/projected/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-kube-api-access-hr7l9\") pod \"payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj\" (UID: \"dadd204f-edd2-4399-9e50-ecf1cf4ae99b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:02:50.397114 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.397086    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:02:50.666743 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.666718    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"]
Sep 17 01:02:50.667870 ip-10-0-128-98 kubenswrapper[2576]: W0917 01:02:50.667846    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddadd204f_edd2_4399_9e50_ecf1cf4ae99b.slice/crio-f3f6b929aa1dfcabf7fc7609e74e8e9bc381ac28cdf0ecac7203c8e69d1a82a2 WatchSource:0}: Error finding container f3f6b929aa1dfcabf7fc7609e74e8e9bc381ac28cdf0ecac7203c8e69d1a82a2: Status 404 returned error can't find the container with id f3f6b929aa1dfcabf7fc7609e74e8e9bc381ac28cdf0ecac7203c8e69d1a82a2
Sep 17 01:02:50.920710 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.920608    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj" event={"ID":"dadd204f-edd2-4399-9e50-ecf1cf4ae99b","Type":"ContainerStarted","Data":"59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25"}
Sep 17 01:02:50.920710 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.920681    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj" event={"ID":"dadd204f-edd2-4399-9e50-ecf1cf4ae99b","Type":"ContainerStarted","Data":"f3f6b929aa1dfcabf7fc7609e74e8e9bc381ac28cdf0ecac7203c8e69d1a82a2"}
Sep 17 01:02:50.920710 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.920709    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:02:50.936803 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:02:50.936755    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj" podStartSLOduration=0.936741872 podStartE2EDuration="936.741872ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:02:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:02:50.934088489 +0000 UTC m=+1963.361546435" watchObservedRunningTime="2026-09-17 01:02:50.936741872 +0000 UTC m=+1963.364199795"
Sep 17 01:03:01.928545 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:01.928511    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:03:02.936223 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:02.936143    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 01:03:02.936723 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:02.936262    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 01:03:05.002251 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:05.002222    2576 generic.go:356] "Generic (PLEG): container finished" podID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerID="9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb" exitCode=0
Sep 17 01:03:05.002706 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:05.002305    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" event={"ID":"c0456e8e-f03b-48e9-8dad-300322cb61a6","Type":"ContainerDied","Data":"9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb"}
Sep 17 01:03:05.002861 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:05.002844    2576 scope.go:117] "RemoveContainer" containerID="9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb"
Sep 17 01:03:05.003928 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:05.003901    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:03:05.004017 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:05.003985    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:03:05.004066 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:05.004022    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:03:06.009420 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:06.009386    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" event={"ID":"c0456e8e-f03b-48e9-8dad-300322cb61a6","Type":"ContainerStarted","Data":"b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c"}
Sep 17 01:03:06.404686 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:06.404646    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:03:06.404992 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:06.404940    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 17 01:03:06.405092 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:06.405029    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 17 01:03:07.405156 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:07.405115    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 17 01:03:07.405535 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:07.405174    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 17 01:03:08.405244 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:08.405205    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 17 01:03:08.405645 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:08.405277    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 17 01:03:09.405209 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:09.405174    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 17 01:03:09.405413 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:09.405244    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 17 01:03:10.404977 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:10.404928    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 17 01:03:10.405167 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:10.405017    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 17 01:03:11.407676 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:11.407647    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:03:11.408142 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:11.408071    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:03:11.408773 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:11.408754    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:03:46.642838 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:03:46.642807    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7mk8t_7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f/payload-processing/0.log"
Sep 17 01:04:19.644866 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:19.644828    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7mk8t_7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f/payload-processing/0.log"
Sep 17 01:04:20.311461 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.311415    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"]
Sep 17 01:04:20.314068 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.314037    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.316441 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.316419    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-9187f3-openshift-default-dockercfg-9xslt\""
Sep 17 01:04:20.327086 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.327020    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"]
Sep 17 01:04:20.385538 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.385504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-envoy\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.385738 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.385551    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-podinfo\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.385738 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.385625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp6fl\" (UniqueName: \"kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-kube-api-access-fp6fl\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.385738 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.385658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-data\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.385738 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.385678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-socket\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.385912 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.385743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-certs\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.385912 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.385769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-credential-socket\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.385912 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.385785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.385912 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.385845    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-token\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.487346 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp6fl\" (UniqueName: \"kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-kube-api-access-fp6fl\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.487544 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-data\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.487544 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-socket\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.487544 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-certs\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.487544 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-credential-socket\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.487784 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.487784 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-token\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.487784 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487667    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-envoy\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.487784 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-podinfo\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.487784 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487771    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-certs\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.488030 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-socket\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.488030 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487993    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-credential-socket\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.488030 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.487998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-data\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.488396 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.488364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.490091 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.490058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-envoy\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.490260 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.490244    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-podinfo\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.494583 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.494558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-token\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.494684 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.494661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp6fl\" (UniqueName: \"kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-kube-api-access-fp6fl\") pod \"e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") " pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.625585 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.625498    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:20.904877 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.904847    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"]
Sep 17 01:04:20.905872 ip-10-0-128-98 kubenswrapper[2576]: W0917 01:04:20.905849    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode813b27a_dce3_4ce6_be6e_811f13b2e4a8.slice/crio-49c9015f66df0e12970aa38a180e664dc91d2a932eba259f9613210ca3aca441 WatchSource:0}: Error finding container 49c9015f66df0e12970aa38a180e664dc91d2a932eba259f9613210ca3aca441: Status 404 returned error can't find the container with id 49c9015f66df0e12970aa38a180e664dc91d2a932eba259f9613210ca3aca441
Sep 17 01:04:20.908299 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.908265    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:04:20.908414 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.908349    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:04:20.908414 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:20.908399    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:04:21.431027 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:21.430982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" event={"ID":"e813b27a-dce3-4ce6-be6e-811f13b2e4a8","Type":"ContainerStarted","Data":"ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8"}
Sep 17 01:04:21.431191 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:21.431048    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" event={"ID":"e813b27a-dce3-4ce6-be6e-811f13b2e4a8","Type":"ContainerStarted","Data":"49c9015f66df0e12970aa38a180e664dc91d2a932eba259f9613210ca3aca441"}
Sep 17 01:04:21.449945 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:21.449898    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" podStartSLOduration=1.449882878 podStartE2EDuration="1.449882878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:04:21.447477478 +0000 UTC m=+2053.874935400" watchObservedRunningTime="2026-09-17 01:04:21.449882878 +0000 UTC m=+2053.877340801"
Sep 17 01:04:21.626115 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:21.626076    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:21.631622 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:21.631597    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:22.437386 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:22.437357    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:22.438369 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:22.438351    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:27.075452 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.075421    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"]
Sep 17 01:04:27.077988 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.077947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:27.080338 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.080316    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-9187f3-dockercfg-zdfps\""
Sep 17 01:04:27.080430 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.080344    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-9187f3\""
Sep 17 01:04:27.088848 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.088827    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"]
Sep 17 01:04:27.151442 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.151411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjlxw\" (UniqueName: \"kubernetes.io/projected/48cdfc62-e141-428e-b4f6-67a900207667-kube-api-access-rjlxw\") pod \"payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l\" (UID: \"48cdfc62-e141-428e-b4f6-67a900207667\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:27.151597 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.151450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48cdfc62-e141-428e-b4f6-67a900207667-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l\" (UID: \"48cdfc62-e141-428e-b4f6-67a900207667\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:27.252895 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.252859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjlxw\" (UniqueName: \"kubernetes.io/projected/48cdfc62-e141-428e-b4f6-67a900207667-kube-api-access-rjlxw\") pod \"payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l\" (UID: \"48cdfc62-e141-428e-b4f6-67a900207667\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:27.253088 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.252914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48cdfc62-e141-428e-b4f6-67a900207667-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l\" (UID: \"48cdfc62-e141-428e-b4f6-67a900207667\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:27.253633 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.253611    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48cdfc62-e141-428e-b4f6-67a900207667-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l\" (UID: \"48cdfc62-e141-428e-b4f6-67a900207667\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:27.260632 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.260606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjlxw\" (UniqueName: \"kubernetes.io/projected/48cdfc62-e141-428e-b4f6-67a900207667-kube-api-access-rjlxw\") pod \"payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l\" (UID: \"48cdfc62-e141-428e-b4f6-67a900207667\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:27.390600 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.390509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:27.661120 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:27.661094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"]
Sep 17 01:04:27.662678 ip-10-0-128-98 kubenswrapper[2576]: W0917 01:04:27.662649    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48cdfc62_e141_428e_b4f6_67a900207667.slice/crio-bc6854cdb5b0a7ad3b87426786cb9acff6de7d7629e464208b70a8ada1bb5ad9 WatchSource:0}: Error finding container bc6854cdb5b0a7ad3b87426786cb9acff6de7d7629e464208b70a8ada1bb5ad9: Status 404 returned error can't find the container with id bc6854cdb5b0a7ad3b87426786cb9acff6de7d7629e464208b70a8ada1bb5ad9
Sep 17 01:04:28.477552 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:28.477519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l" event={"ID":"48cdfc62-e141-428e-b4f6-67a900207667","Type":"ContainerStarted","Data":"ba1e38863f0f3016fce10873c9d99ef7f327627624a878ca5d5169dd99d494fd"}
Sep 17 01:04:28.478008 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:28.477575    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l" event={"ID":"48cdfc62-e141-428e-b4f6-67a900207667","Type":"ContainerStarted","Data":"bc6854cdb5b0a7ad3b87426786cb9acff6de7d7629e464208b70a8ada1bb5ad9"}
Sep 17 01:04:28.478008 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:28.477689    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:28.494622 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:28.494574    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l" podStartSLOduration=1.494553848 podStartE2EDuration="1.494553848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:04:28.4911188 +0000 UTC m=+2060.918576730" watchObservedRunningTime="2026-09-17 01:04:28.494553848 +0000 UTC m=+2060.922011775"
Sep 17 01:04:39.485620 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:39.485587    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:55.449053 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:55.449013    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"]
Sep 17 01:04:55.449483 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:55.449259    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l" podUID="48cdfc62-e141-428e-b4f6-67a900207667" containerName="payload-pre-processing" containerID="cri-o://ba1e38863f0f3016fce10873c9d99ef7f327627624a878ca5d5169dd99d494fd" gracePeriod=30
Sep 17 01:04:55.642514 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:55.642468    2576 generic.go:356] "Generic (PLEG): container finished" podID="48cdfc62-e141-428e-b4f6-67a900207667" containerID="ba1e38863f0f3016fce10873c9d99ef7f327627624a878ca5d5169dd99d494fd" exitCode=0
Sep 17 01:04:55.642676 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:55.642569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l" event={"ID":"48cdfc62-e141-428e-b4f6-67a900207667","Type":"ContainerDied","Data":"ba1e38863f0f3016fce10873c9d99ef7f327627624a878ca5d5169dd99d494fd"}
Sep 17 01:04:55.712303 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:55.712215    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:55.732122 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:55.732097    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48cdfc62-e141-428e-b4f6-67a900207667-plugins-config-volume\") pod \"48cdfc62-e141-428e-b4f6-67a900207667\" (UID: \"48cdfc62-e141-428e-b4f6-67a900207667\") "
Sep 17 01:04:55.732294 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:55.732223    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjlxw\" (UniqueName: \"kubernetes.io/projected/48cdfc62-e141-428e-b4f6-67a900207667-kube-api-access-rjlxw\") pod \"48cdfc62-e141-428e-b4f6-67a900207667\" (UID: \"48cdfc62-e141-428e-b4f6-67a900207667\") "
Sep 17 01:04:55.732508 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:55.732483    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48cdfc62-e141-428e-b4f6-67a900207667-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48cdfc62-e141-428e-b4f6-67a900207667" (UID: "48cdfc62-e141-428e-b4f6-67a900207667"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:04:55.734511 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:55.734474    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48cdfc62-e141-428e-b4f6-67a900207667-kube-api-access-rjlxw" (OuterVolumeSpecName: "kube-api-access-rjlxw") pod "48cdfc62-e141-428e-b4f6-67a900207667" (UID: "48cdfc62-e141-428e-b4f6-67a900207667"). InnerVolumeSpecName "kube-api-access-rjlxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:04:55.833544 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:55.833508    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjlxw\" (UniqueName: \"kubernetes.io/projected/48cdfc62-e141-428e-b4f6-67a900207667-kube-api-access-rjlxw\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:04:55.833544 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:55.833538    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48cdfc62-e141-428e-b4f6-67a900207667-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:04:56.649617 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:56.649590    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"
Sep 17 01:04:56.650060 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:56.649631    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l" event={"ID":"48cdfc62-e141-428e-b4f6-67a900207667","Type":"ContainerDied","Data":"bc6854cdb5b0a7ad3b87426786cb9acff6de7d7629e464208b70a8ada1bb5ad9"}
Sep 17 01:04:56.650060 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:56.649691    2576 scope.go:117] "RemoveContainer" containerID="ba1e38863f0f3016fce10873c9d99ef7f327627624a878ca5d5169dd99d494fd"
Sep 17 01:04:56.651596 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:56.651576    2576 generic.go:356] "Generic (PLEG): container finished" podID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerID="ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8" exitCode=0
Sep 17 01:04:56.651687 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:56.651660    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" event={"ID":"e813b27a-dce3-4ce6-be6e-811f13b2e4a8","Type":"ContainerDied","Data":"ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8"}
Sep 17 01:04:56.652047 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:56.652031    2576 scope.go:117] "RemoveContainer" containerID="ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8"
Sep 17 01:04:56.653411 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:56.653370    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:04:56.653519 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:56.653469    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:04:56.653586 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:56.653522    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 01:04:56.690074 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:56.690040    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"]
Sep 17 01:04:56.692521 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:56.692488    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9187f3-645bf7bd6b-b8c5l"]
Sep 17 01:04:57.661073 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:57.661041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" event={"ID":"e813b27a-dce3-4ce6-be6e-811f13b2e4a8","Type":"ContainerStarted","Data":"91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397"}
Sep 17 01:04:58.141944 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:58.141859    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48cdfc62-e141-428e-b4f6-67a900207667" path="/var/lib/kubelet/pods/48cdfc62-e141-428e-b4f6-67a900207667/volumes"
Sep 17 01:04:58.626508 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:58.626475    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:04:58.626719 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:58.626678    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 17 01:04:58.626786 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:58.626748    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 17 01:04:59.626375 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:59.626334    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 17 01:04:59.626773 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:04:59.626398    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 17 01:05:00.626294 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:00.626251    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 17 01:05:00.626472 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:00.626313    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 17 01:05:01.629145 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:01.629108    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 17 01:05:01.629543 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:01.629164    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 17 01:05:01.916135 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:01.916090    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"]
Sep 17 01:05:01.916687 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:01.916652    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerName="istio-proxy" containerID="cri-o://91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397" gracePeriod=30
Sep 17 01:05:07.438176 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:07.438140    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:05:09.375082 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.375054    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:05:09.464779 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.464701    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-podinfo\") pod \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") "
Sep 17 01:05:09.464779 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.464751    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-token\") pod \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") "
Sep 17 01:05:09.465032 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.464802    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-certs\") pod \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") "
Sep 17 01:05:09.465032 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.464834    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-envoy\") pod \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") "
Sep 17 01:05:09.465032 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.464849    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-data\") pod \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") "
Sep 17 01:05:09.465032 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.464868    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp6fl\" (UniqueName: \"kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-kube-api-access-fp6fl\") pod \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") "
Sep 17 01:05:09.465032 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.464888    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-socket\") pod \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") "
Sep 17 01:05:09.465032 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.464976    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istiod-ca-cert\") pod \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") "
Sep 17 01:05:09.465346 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.465042    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-credential-socket\") pod \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\" (UID: \"e813b27a-dce3-4ce6-be6e-811f13b2e4a8\") "
Sep 17 01:05:09.465346 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.465184    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "e813b27a-dce3-4ce6-be6e-811f13b2e4a8" (UID: "e813b27a-dce3-4ce6-be6e-811f13b2e4a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:05:09.465346 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.465196    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e813b27a-dce3-4ce6-be6e-811f13b2e4a8" (UID: "e813b27a-dce3-4ce6-be6e-811f13b2e4a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:05:09.465668 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.465366    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e813b27a-dce3-4ce6-be6e-811f13b2e4a8" (UID: "e813b27a-dce3-4ce6-be6e-811f13b2e4a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:05:09.465668 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.465385    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e813b27a-dce3-4ce6-be6e-811f13b2e4a8" (UID: "e813b27a-dce3-4ce6-be6e-811f13b2e4a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:05:09.465668 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.465439    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-data\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:05:09.465668 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.465460    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:05:09.465668 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.465474    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-workload-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:05:09.465668 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.465616    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e813b27a-dce3-4ce6-be6e-811f13b2e4a8" (UID: "e813b27a-dce3-4ce6-be6e-811f13b2e4a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:05:09.467158 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.467134    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e813b27a-dce3-4ce6-be6e-811f13b2e4a8" (UID: "e813b27a-dce3-4ce6-be6e-811f13b2e4a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:05:09.467302 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.467273    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-kube-api-access-fp6fl" (OuterVolumeSpecName: "kube-api-access-fp6fl") pod "e813b27a-dce3-4ce6-be6e-811f13b2e4a8" (UID: "e813b27a-dce3-4ce6-be6e-811f13b2e4a8"). InnerVolumeSpecName "kube-api-access-fp6fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:05:09.467571 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.467546    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e813b27a-dce3-4ce6-be6e-811f13b2e4a8" (UID: "e813b27a-dce3-4ce6-be6e-811f13b2e4a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:05:09.467571 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.467549    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "e813b27a-dce3-4ce6-be6e-811f13b2e4a8" (UID: "e813b27a-dce3-4ce6-be6e-811f13b2e4a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:05:09.566158 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.566129    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp6fl\" (UniqueName: \"kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-kube-api-access-fp6fl\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:05:09.566158 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.566154    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istiod-ca-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:05:09.566158 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.566163    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-credential-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:05:09.566365 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.566171    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-podinfo\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:05:09.566365 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.566180    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-token\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:05:09.566365 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.566187    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e813b27a-dce3-4ce6-be6e-811f13b2e4a8-istio-envoy\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:05:09.741687 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.741606    2576 generic.go:356] "Generic (PLEG): container finished" podID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerID="91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397" exitCode=0
Sep 17 01:05:09.741687 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.741657    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"
Sep 17 01:05:09.741885 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.741692    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" event={"ID":"e813b27a-dce3-4ce6-be6e-811f13b2e4a8","Type":"ContainerDied","Data":"91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397"}
Sep 17 01:05:09.741885 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.741746    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz" event={"ID":"e813b27a-dce3-4ce6-be6e-811f13b2e4a8","Type":"ContainerDied","Data":"49c9015f66df0e12970aa38a180e664dc91d2a932eba259f9613210ca3aca441"}
Sep 17 01:05:09.741885 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.741771    2576 scope.go:117] "RemoveContainer" containerID="91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397"
Sep 17 01:05:09.755355 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.755027    2576 scope.go:117] "RemoveContainer" containerID="ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8"
Sep 17 01:05:09.764241 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.764224    2576 scope.go:117] "RemoveContainer" containerID="91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397"
Sep 17 01:05:09.764511 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:05:09.764487    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397\": container with ID starting with 91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397 not found: ID does not exist" containerID="91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397"
Sep 17 01:05:09.764586 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.764520    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397"} err="failed to get container status \"91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397\": rpc error: code = NotFound desc = could not find container \"91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397\": container with ID starting with 91cf15eaf3551d2a3ebc0660cd0aaa325915aaf6dc0b31dbbedac5c0b2b54397 not found: ID does not exist"
Sep 17 01:05:09.764586 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.764545    2576 scope.go:117] "RemoveContainer" containerID="ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8"
Sep 17 01:05:09.764842 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:05:09.764822    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8\": container with ID starting with ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8 not found: ID does not exist" containerID="ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8"
Sep 17 01:05:09.764894 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.764851    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8"} err="failed to get container status \"ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8\": rpc error: code = NotFound desc = could not find container \"ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8\": container with ID starting with ba4443bc68742800ed843dc3e5fbea406ab452af314d7768192e20076363fcb8 not found: ID does not exist"
Sep 17 01:05:09.773121 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.773101    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"]
Sep 17 01:05:09.776837 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:09.776817    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9187f3-openshift-default-79494cbc64-ncxcz"]
Sep 17 01:05:10.141544 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:10.141463    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" path="/var/lib/kubelet/pods/e813b27a-dce3-4ce6-be6e-811f13b2e4a8/volumes"
Sep 17 01:05:21.163171 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.163128    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"]
Sep 17 01:05:21.163720 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.163355    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj" podUID="dadd204f-edd2-4399-9e50-ecf1cf4ae99b" containerName="payload-pre-processing" containerID="cri-o://59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25" gracePeriod=30
Sep 17 01:05:21.438764 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.438730    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:05:21.572799 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.572769    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr7l9\" (UniqueName: \"kubernetes.io/projected/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-kube-api-access-hr7l9\") pod \"dadd204f-edd2-4399-9e50-ecf1cf4ae99b\" (UID: \"dadd204f-edd2-4399-9e50-ecf1cf4ae99b\") "
Sep 17 01:05:21.572998 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.572825    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-plugins-config-volume\") pod \"dadd204f-edd2-4399-9e50-ecf1cf4ae99b\" (UID: \"dadd204f-edd2-4399-9e50-ecf1cf4ae99b\") "
Sep 17 01:05:21.573289 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.573260    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dadd204f-edd2-4399-9e50-ecf1cf4ae99b" (UID: "dadd204f-edd2-4399-9e50-ecf1cf4ae99b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:05:21.575258 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.575230    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-kube-api-access-hr7l9" (OuterVolumeSpecName: "kube-api-access-hr7l9") pod "dadd204f-edd2-4399-9e50-ecf1cf4ae99b" (UID: "dadd204f-edd2-4399-9e50-ecf1cf4ae99b"). InnerVolumeSpecName "kube-api-access-hr7l9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:05:21.674033 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.673931    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr7l9\" (UniqueName: \"kubernetes.io/projected/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-kube-api-access-hr7l9\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:05:21.674033 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.673988    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dadd204f-edd2-4399-9e50-ecf1cf4ae99b-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:05:21.809969 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.809917    2576 generic.go:356] "Generic (PLEG): container finished" podID="dadd204f-edd2-4399-9e50-ecf1cf4ae99b" containerID="59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25" exitCode=0
Sep 17 01:05:21.810154 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.809990    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"
Sep 17 01:05:21.810154 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.809999    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj" event={"ID":"dadd204f-edd2-4399-9e50-ecf1cf4ae99b","Type":"ContainerDied","Data":"59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25"}
Sep 17 01:05:21.810154 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.810062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj" event={"ID":"dadd204f-edd2-4399-9e50-ecf1cf4ae99b","Type":"ContainerDied","Data":"f3f6b929aa1dfcabf7fc7609e74e8e9bc381ac28cdf0ecac7203c8e69d1a82a2"}
Sep 17 01:05:21.810154 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.810087    2576 scope.go:117] "RemoveContainer" containerID="59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25"
Sep 17 01:05:21.822555 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.822510    2576 scope.go:117] "RemoveContainer" containerID="59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25"
Sep 17 01:05:21.823013 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:05:21.822921    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25\": container with ID starting with 59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25 not found: ID does not exist" containerID="59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25"
Sep 17 01:05:21.823013 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.822982    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25"} err="failed to get container status \"59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25\": rpc error: code = NotFound desc = could not find container \"59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25\": container with ID starting with 59c6a086631189cee403333cee4f2844df9ef91dbe22891da313c351cc1b5d25 not found: ID does not exist"
Sep 17 01:05:21.834245 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.834218    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"]
Sep 17 01:05:21.837717 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:21.837697    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7e9533-5bbd9b487d-mzzdj"]
Sep 17 01:05:22.140535 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:05:22.140439    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dadd204f-edd2-4399-9e50-ecf1cf4ae99b" path="/var/lib/kubelet/pods/dadd204f-edd2-4399-9e50-ecf1cf4ae99b/volumes"
Sep 17 01:06:08.386139 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:08.386110    2576 scope.go:117] "RemoveContainer" containerID="d524e6cb0df06e819869cb3520f4df9be77f98ae3026f3000620780a8607f9f4"
Sep 17 01:06:09.571669 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:09.571633    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"]
Sep 17 01:06:09.572119 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:09.571845    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy" containerID="cri-o://b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c" gracePeriod=30
Sep 17 01:06:11.410346 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:11.410299    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:06:11.410719 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:11.410380    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:06:14.819580 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.819556    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:06:14.954208 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954168    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-socket\") pod \"c0456e8e-f03b-48e9-8dad-300322cb61a6\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") "
Sep 17 01:06:14.954208 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954215    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-token\") pod \"c0456e8e-f03b-48e9-8dad-300322cb61a6\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") "
Sep 17 01:06:14.954451 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954253    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs6dj\" (UniqueName: \"kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-kube-api-access-fs6dj\") pod \"c0456e8e-f03b-48e9-8dad-300322cb61a6\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") "
Sep 17 01:06:14.954451 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954281    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0456e8e-f03b-48e9-8dad-300322cb61a6-istiod-ca-cert\") pod \"c0456e8e-f03b-48e9-8dad-300322cb61a6\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") "
Sep 17 01:06:14.954451 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954300    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-envoy\") pod \"c0456e8e-f03b-48e9-8dad-300322cb61a6\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") "
Sep 17 01:06:14.954451 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954340    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-data\") pod \"c0456e8e-f03b-48e9-8dad-300322cb61a6\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") "
Sep 17 01:06:14.954451 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954375    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-credential-socket\") pod \"c0456e8e-f03b-48e9-8dad-300322cb61a6\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") "
Sep 17 01:06:14.954451 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954454    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-certs\") pod \"c0456e8e-f03b-48e9-8dad-300322cb61a6\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") "
Sep 17 01:06:14.954763 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954459    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0456e8e-f03b-48e9-8dad-300322cb61a6" (UID: "c0456e8e-f03b-48e9-8dad-300322cb61a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:06:14.954763 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954512    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-podinfo\") pod \"c0456e8e-f03b-48e9-8dad-300322cb61a6\" (UID: \"c0456e8e-f03b-48e9-8dad-300322cb61a6\") "
Sep 17 01:06:14.954763 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954669    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0456e8e-f03b-48e9-8dad-300322cb61a6" (UID: "c0456e8e-f03b-48e9-8dad-300322cb61a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:06:14.954763 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954733    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0456e8e-f03b-48e9-8dad-300322cb61a6" (UID: "c0456e8e-f03b-48e9-8dad-300322cb61a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:06:14.955010 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954776    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0456e8e-f03b-48e9-8dad-300322cb61a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0456e8e-f03b-48e9-8dad-300322cb61a6" (UID: "c0456e8e-f03b-48e9-8dad-300322cb61a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:06:14.955010 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954842    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:14.955010 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954862    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0456e8e-f03b-48e9-8dad-300322cb61a6-istiod-ca-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:14.955010 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954877    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-data\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:14.955010 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954888    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-credential-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:14.955010 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.954943    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0456e8e-f03b-48e9-8dad-300322cb61a6" (UID: "c0456e8e-f03b-48e9-8dad-300322cb61a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:06:14.956799 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.956770    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0456e8e-f03b-48e9-8dad-300322cb61a6" (UID: "c0456e8e-f03b-48e9-8dad-300322cb61a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:06:14.956799 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.956774    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0456e8e-f03b-48e9-8dad-300322cb61a6" (UID: "c0456e8e-f03b-48e9-8dad-300322cb61a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:06:14.956980 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.956775    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-kube-api-access-fs6dj" (OuterVolumeSpecName: "kube-api-access-fs6dj") pod "c0456e8e-f03b-48e9-8dad-300322cb61a6" (UID: "c0456e8e-f03b-48e9-8dad-300322cb61a6"). InnerVolumeSpecName "kube-api-access-fs6dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:06:14.957132 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:14.957113    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0456e8e-f03b-48e9-8dad-300322cb61a6" (UID: "c0456e8e-f03b-48e9-8dad-300322cb61a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:06:15.055451 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.055420    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-workload-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:15.055451 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.055445    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-podinfo\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:15.055451 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.055453    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-token\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:15.055652 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.055462    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs6dj\" (UniqueName: \"kubernetes.io/projected/c0456e8e-f03b-48e9-8dad-300322cb61a6-kube-api-access-fs6dj\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:15.055652 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.055470    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0456e8e-f03b-48e9-8dad-300322cb61a6-istio-envoy\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:15.095872 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.095844    2576 generic.go:356] "Generic (PLEG): container finished" podID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerID="b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c" exitCode=0
Sep 17 01:06:15.096021 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.095896    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"
Sep 17 01:06:15.096021 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.095926    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" event={"ID":"c0456e8e-f03b-48e9-8dad-300322cb61a6","Type":"ContainerDied","Data":"b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c"}
Sep 17 01:06:15.096021 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.096006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf" event={"ID":"c0456e8e-f03b-48e9-8dad-300322cb61a6","Type":"ContainerDied","Data":"2273c841bc9be34f967fb3b84a0e1380db7a3193fee7329853f5bdc8a7d77c30"}
Sep 17 01:06:15.096176 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.096032    2576 scope.go:117] "RemoveContainer" containerID="b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c"
Sep 17 01:06:15.105750 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.105731    2576 scope.go:117] "RemoveContainer" containerID="9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb"
Sep 17 01:06:15.114553 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.114532    2576 scope.go:117] "RemoveContainer" containerID="b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c"
Sep 17 01:06:15.114829 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:06:15.114810    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c\": container with ID starting with b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c not found: ID does not exist" containerID="b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c"
Sep 17 01:06:15.114910 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.114838    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c"} err="failed to get container status \"b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c\": rpc error: code = NotFound desc = could not find container \"b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c\": container with ID starting with b00cb59429801a8c82394275e140a4a51762dcacbae3c1c5a6184095e065512c not found: ID does not exist"
Sep 17 01:06:15.114910 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.114856    2576 scope.go:117] "RemoveContainer" containerID="9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb"
Sep 17 01:06:15.115114 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:06:15.115097    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb\": container with ID starting with 9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb not found: ID does not exist" containerID="9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb"
Sep 17 01:06:15.115181 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.115119    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb"} err="failed to get container status \"9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb\": rpc error: code = NotFound desc = could not find container \"9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb\": container with ID starting with 9e6d0f873bca40a420a965e3500fa73f53c5f914238d415eaef53a0035bbfedb not found: ID does not exist"
Sep 17 01:06:15.116488 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.116465    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"]
Sep 17 01:06:15.120190 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:15.120169    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-7e9533-openshift-default-7cb9c94f74-k2wbf"]
Sep 17 01:06:16.140753 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:16.140705    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" path="/var/lib/kubelet/pods/c0456e8e-f03b-48e9-8dad-300322cb61a6/volumes"
Sep 17 01:06:37.573376 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:37.573334    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94"]
Sep 17 01:06:37.576044 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:37.576017    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d2326d-29826780-8jg94"]
Sep 17 01:06:37.610466 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:37.610433    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"]
Sep 17 01:06:37.610794 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:37.610761    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2" podUID="e91ad05c-8547-44d0-9005-16dd5c21fb04" containerName="payload-pre-processing" containerID="cri-o://b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a" gracePeriod=30
Sep 17 01:06:37.873684 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:37.873660    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 01:06:37.951227 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:37.951196    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbnss\" (UniqueName: \"kubernetes.io/projected/e91ad05c-8547-44d0-9005-16dd5c21fb04-kube-api-access-kbnss\") pod \"e91ad05c-8547-44d0-9005-16dd5c21fb04\" (UID: \"e91ad05c-8547-44d0-9005-16dd5c21fb04\") "
Sep 17 01:06:37.951391 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:37.951285    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e91ad05c-8547-44d0-9005-16dd5c21fb04-plugins-config-volume\") pod \"e91ad05c-8547-44d0-9005-16dd5c21fb04\" (UID: \"e91ad05c-8547-44d0-9005-16dd5c21fb04\") "
Sep 17 01:06:37.951677 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:37.951653    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e91ad05c-8547-44d0-9005-16dd5c21fb04-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e91ad05c-8547-44d0-9005-16dd5c21fb04" (UID: "e91ad05c-8547-44d0-9005-16dd5c21fb04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:06:37.953637 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:37.953614    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91ad05c-8547-44d0-9005-16dd5c21fb04-kube-api-access-kbnss" (OuterVolumeSpecName: "kube-api-access-kbnss") pod "e91ad05c-8547-44d0-9005-16dd5c21fb04" (UID: "e91ad05c-8547-44d0-9005-16dd5c21fb04"). InnerVolumeSpecName "kube-api-access-kbnss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:06:38.052267 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.052215    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e91ad05c-8547-44d0-9005-16dd5c21fb04-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:38.052267 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.052261    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbnss\" (UniqueName: \"kubernetes.io/projected/e91ad05c-8547-44d0-9005-16dd5c21fb04-kube-api-access-kbnss\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:38.141321 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.141246    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c10d4ec-4c83-431f-a906-d5e207e7703f" path="/var/lib/kubelet/pods/6c10d4ec-4c83-431f-a906-d5e207e7703f/volumes"
Sep 17 01:06:38.223666 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.223633    2576 generic.go:356] "Generic (PLEG): container finished" podID="e91ad05c-8547-44d0-9005-16dd5c21fb04" containerID="b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a" exitCode=0
Sep 17 01:06:38.223863 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.223692    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2" event={"ID":"e91ad05c-8547-44d0-9005-16dd5c21fb04","Type":"ContainerDied","Data":"b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a"}
Sep 17 01:06:38.223863 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.223729    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"
Sep 17 01:06:38.223863 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.223744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2" event={"ID":"e91ad05c-8547-44d0-9005-16dd5c21fb04","Type":"ContainerDied","Data":"c39b250d54324c3421096caea3f641c64e07172678b4063ce3bd47bf099afcd0"}
Sep 17 01:06:38.223863 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.223789    2576 scope.go:117] "RemoveContainer" containerID="b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a"
Sep 17 01:06:38.232825 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.232806    2576 scope.go:117] "RemoveContainer" containerID="b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a"
Sep 17 01:06:38.233127 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:06:38.233105    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a\": container with ID starting with b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a not found: ID does not exist" containerID="b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a"
Sep 17 01:06:38.233182 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.233137    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a"} err="failed to get container status \"b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a\": rpc error: code = NotFound desc = could not find container \"b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a\": container with ID starting with b2c839332fdaf24efd0f8fc5a9999f5057310ad6914e881aacfeece37a4d4f2a not found: ID does not exist"
Sep 17 01:06:38.239274 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.239252    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"]
Sep 17 01:06:38.242818 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:38.242798    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d2326d-84c9866c7d-w6qj2"]
Sep 17 01:06:40.141406 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:40.141375    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e91ad05c-8547-44d0-9005-16dd5c21fb04" path="/var/lib/kubelet/pods/e91ad05c-8547-44d0-9005-16dd5c21fb04/volumes"
Sep 17 01:06:55.063216 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:55.063177    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"]
Sep 17 01:06:55.064056 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:55.063436    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk" podUID="1c2a25ad-01a4-4d02-9a01-81e62316bec0" containerName="payload-processing" containerID="cri-o://d92082239b2e177ece19717d78e398c6c2a7b4b9ad1fc3d31842a2df2d53e207" gracePeriod=30
Sep 17 01:06:55.314853 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:55.314824    2576 generic.go:356] "Generic (PLEG): container finished" podID="1c2a25ad-01a4-4d02-9a01-81e62316bec0" containerID="d92082239b2e177ece19717d78e398c6c2a7b4b9ad1fc3d31842a2df2d53e207" exitCode=0
Sep 17 01:06:55.315022 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:55.314921    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk" event={"ID":"1c2a25ad-01a4-4d02-9a01-81e62316bec0","Type":"ContainerDied","Data":"d92082239b2e177ece19717d78e398c6c2a7b4b9ad1fc3d31842a2df2d53e207"}
Sep 17 01:06:55.328354 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:55.328333    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 01:06:55.404743 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:55.404700    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c2a25ad-01a4-4d02-9a01-81e62316bec0-plugins-config-volume\") pod \"1c2a25ad-01a4-4d02-9a01-81e62316bec0\" (UID: \"1c2a25ad-01a4-4d02-9a01-81e62316bec0\") "
Sep 17 01:06:55.404945 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:55.404822    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xb45\" (UniqueName: \"kubernetes.io/projected/1c2a25ad-01a4-4d02-9a01-81e62316bec0-kube-api-access-9xb45\") pod \"1c2a25ad-01a4-4d02-9a01-81e62316bec0\" (UID: \"1c2a25ad-01a4-4d02-9a01-81e62316bec0\") "
Sep 17 01:06:55.405199 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:55.405163    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c2a25ad-01a4-4d02-9a01-81e62316bec0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1c2a25ad-01a4-4d02-9a01-81e62316bec0" (UID: "1c2a25ad-01a4-4d02-9a01-81e62316bec0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:06:55.407871 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:55.407842    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c2a25ad-01a4-4d02-9a01-81e62316bec0-kube-api-access-9xb45" (OuterVolumeSpecName: "kube-api-access-9xb45") pod "1c2a25ad-01a4-4d02-9a01-81e62316bec0" (UID: "1c2a25ad-01a4-4d02-9a01-81e62316bec0"). InnerVolumeSpecName "kube-api-access-9xb45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:06:55.506353 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:55.506322    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xb45\" (UniqueName: \"kubernetes.io/projected/1c2a25ad-01a4-4d02-9a01-81e62316bec0-kube-api-access-9xb45\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:55.506353 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:55.506347    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c2a25ad-01a4-4d02-9a01-81e62316bec0-plugins-config-volume\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:06:56.320989 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:56.320939    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk" event={"ID":"1c2a25ad-01a4-4d02-9a01-81e62316bec0","Type":"ContainerDied","Data":"41785d1c5ba64324d1f4339d74c66717a9d0bdd6948d446112a4952ececc365c"}
Sep 17 01:06:56.321404 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:56.321005    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"
Sep 17 01:06:56.321404 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:56.321017    2576 scope.go:117] "RemoveContainer" containerID="d92082239b2e177ece19717d78e398c6c2a7b4b9ad1fc3d31842a2df2d53e207"
Sep 17 01:06:56.338061 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:56.338030    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"]
Sep 17 01:06:56.341404 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:56.341383    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bcd112-5f6fb7cf8c-ttzxk"]
Sep 17 01:06:58.140726 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:06:58.140690    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c2a25ad-01a4-4d02-9a01-81e62316bec0" path="/var/lib/kubelet/pods/1c2a25ad-01a4-4d02-9a01-81e62316bec0/volumes"
Sep 17 01:07:01.607617 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:01.607586    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"]
Sep 17 01:07:01.608204 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:01.607821    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy" containerID="cri-o://77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483" gracePeriod=30
Sep 17 01:07:01.691892 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:01.691857    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:07:01.692110 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:01.691914    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:07:04.422083 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.422050    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-mtffs"]
Sep 17 01:07:04.422539 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.422263    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs" podUID="b934b2c7-5cd1-46e9-8705-1e15bdfc7454" containerName="manager" containerID="cri-o://b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4" gracePeriod=30
Sep 17 01:07:04.665002 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.664951    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 01:07:04.790305 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.790221    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4pnx\" (UniqueName: \"kubernetes.io/projected/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-kube-api-access-c4pnx\") pod \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") "
Sep 17 01:07:04.790305 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.790263    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-metrics-certs\") pod \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") "
Sep 17 01:07:04.790305 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.790283    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-webhook-cert\") pod \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\" (UID: \"b934b2c7-5cd1-46e9-8705-1e15bdfc7454\") "
Sep 17 01:07:04.792489 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.792455    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b934b2c7-5cd1-46e9-8705-1e15bdfc7454" (UID: "b934b2c7-5cd1-46e9-8705-1e15bdfc7454"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:07:04.792489 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.792474    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b934b2c7-5cd1-46e9-8705-1e15bdfc7454" (UID: "b934b2c7-5cd1-46e9-8705-1e15bdfc7454"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:07:04.792649 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.792456    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-kube-api-access-c4pnx" (OuterVolumeSpecName: "kube-api-access-c4pnx") pod "b934b2c7-5cd1-46e9-8705-1e15bdfc7454" (UID: "b934b2c7-5cd1-46e9-8705-1e15bdfc7454"). InnerVolumeSpecName "kube-api-access-c4pnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:07:04.891459 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.891416    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4pnx\" (UniqueName: \"kubernetes.io/projected/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-kube-api-access-c4pnx\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:04.891459 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.891455    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-metrics-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:04.891459 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:04.891469    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b934b2c7-5cd1-46e9-8705-1e15bdfc7454-webhook-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:05.375724 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:05.375694    2576 generic.go:356] "Generic (PLEG): container finished" podID="b934b2c7-5cd1-46e9-8705-1e15bdfc7454" containerID="b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4" exitCode=0
Sep 17 01:07:05.375897 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:05.375733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs" event={"ID":"b934b2c7-5cd1-46e9-8705-1e15bdfc7454","Type":"ContainerDied","Data":"b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4"}
Sep 17 01:07:05.375897 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:05.375776    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs" event={"ID":"b934b2c7-5cd1-46e9-8705-1e15bdfc7454","Type":"ContainerDied","Data":"cc57c38a7b94eec716fb9283df0be7d2e731e99dc4df25d6d00a69fec8d07471"}
Sep 17 01:07:05.375897 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:05.375796    2576 scope.go:117] "RemoveContainer" containerID="b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4"
Sep 17 01:07:05.375897 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:05.375800    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6c7d56b5-mtffs"
Sep 17 01:07:05.385570 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:05.385548    2576 scope.go:117] "RemoveContainer" containerID="b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4"
Sep 17 01:07:05.385882 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:07:05.385860    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4\": container with ID starting with b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4 not found: ID does not exist" containerID="b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4"
Sep 17 01:07:05.385882 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:05.385889    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4"} err="failed to get container status \"b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4\": rpc error: code = NotFound desc = could not find container \"b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4\": container with ID starting with b30f9390a2b5c922336d974ee21439aaae9c2c4a2869091af1129fd9144a56b4 not found: ID does not exist"
Sep 17 01:07:05.395751 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:05.395728    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-mtffs"]
Sep 17 01:07:05.399302 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:05.399280    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-mtffs"]
Sep 17 01:07:06.140606 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.140570    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b934b2c7-5cd1-46e9-8705-1e15bdfc7454" path="/var/lib/kubelet/pods/b934b2c7-5cd1-46e9-8705-1e15bdfc7454/volumes"
Sep 17 01:07:06.854032 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.854010    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 01:07:06.905288 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905258    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/750bcf6e-f469-4059-b339-230e5545ebe8-istiod-ca-cert\") pod \"750bcf6e-f469-4059-b339-230e5545ebe8\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") "
Sep 17 01:07:06.905457 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905303    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-certs\") pod \"750bcf6e-f469-4059-b339-230e5545ebe8\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") "
Sep 17 01:07:06.905457 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905332    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-data\") pod \"750bcf6e-f469-4059-b339-230e5545ebe8\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") "
Sep 17 01:07:06.905457 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905430    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-envoy\") pod \"750bcf6e-f469-4059-b339-230e5545ebe8\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") "
Sep 17 01:07:06.905639 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905485    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-socket\") pod \"750bcf6e-f469-4059-b339-230e5545ebe8\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") "
Sep 17 01:07:06.905639 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905520    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-credential-socket\") pod \"750bcf6e-f469-4059-b339-230e5545ebe8\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") "
Sep 17 01:07:06.905639 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905555    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/750bcf6e-f469-4059-b339-230e5545ebe8-istio-podinfo\") pod \"750bcf6e-f469-4059-b339-230e5545ebe8\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") "
Sep 17 01:07:06.905639 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-istio-token\") pod \"750bcf6e-f469-4059-b339-230e5545ebe8\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") "
Sep 17 01:07:06.905639 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905629    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-data" (OuterVolumeSpecName: "istio-data") pod "750bcf6e-f469-4059-b339-230e5545ebe8" (UID: "750bcf6e-f469-4059-b339-230e5545ebe8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:07:06.905905 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905645    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq27k\" (UniqueName: \"kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-kube-api-access-bq27k\") pod \"750bcf6e-f469-4059-b339-230e5545ebe8\" (UID: \"750bcf6e-f469-4059-b339-230e5545ebe8\") "
Sep 17 01:07:06.905905 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905674    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "750bcf6e-f469-4059-b339-230e5545ebe8" (UID: "750bcf6e-f469-4059-b339-230e5545ebe8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:07:06.905905 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905774    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/750bcf6e-f469-4059-b339-230e5545ebe8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "750bcf6e-f469-4059-b339-230e5545ebe8" (UID: "750bcf6e-f469-4059-b339-230e5545ebe8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:07:06.905905 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905781    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "750bcf6e-f469-4059-b339-230e5545ebe8" (UID: "750bcf6e-f469-4059-b339-230e5545ebe8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:07:06.906163 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.905916    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "750bcf6e-f469-4059-b339-230e5545ebe8" (UID: "750bcf6e-f469-4059-b339-230e5545ebe8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:07:06.906163 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.906035    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:06.906163 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.906052    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-credential-socket\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:06.906163 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.906066    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/750bcf6e-f469-4059-b339-230e5545ebe8-istiod-ca-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:06.906163 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.906078    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-workload-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:06.906163 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.906089    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-data\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:06.907977 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.907924    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-istio-token" (OuterVolumeSpecName: "istio-token") pod "750bcf6e-f469-4059-b339-230e5545ebe8" (UID: "750bcf6e-f469-4059-b339-230e5545ebe8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:07:06.908106 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.908086    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "750bcf6e-f469-4059-b339-230e5545ebe8" (UID: "750bcf6e-f469-4059-b339-230e5545ebe8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:07:06.908320 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.908303    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/750bcf6e-f469-4059-b339-230e5545ebe8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "750bcf6e-f469-4059-b339-230e5545ebe8" (UID: "750bcf6e-f469-4059-b339-230e5545ebe8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:07:06.908378 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:06.908363    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-kube-api-access-bq27k" (OuterVolumeSpecName: "kube-api-access-bq27k") pod "750bcf6e-f469-4059-b339-230e5545ebe8" (UID: "750bcf6e-f469-4059-b339-230e5545ebe8"). InnerVolumeSpecName "kube-api-access-bq27k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:07:07.006640 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.006607    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/750bcf6e-f469-4059-b339-230e5545ebe8-istio-envoy\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:07.006640 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.006634    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/750bcf6e-f469-4059-b339-230e5545ebe8-istio-podinfo\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:07.006640 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.006644    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-istio-token\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:07.006847 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.006651    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq27k\" (UniqueName: \"kubernetes.io/projected/750bcf6e-f469-4059-b339-230e5545ebe8-kube-api-access-bq27k\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:07:07.388595 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.388560    2576 generic.go:356] "Generic (PLEG): container finished" podID="750bcf6e-f469-4059-b339-230e5545ebe8" containerID="77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483" exitCode=0
Sep 17 01:07:07.388994 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.388613    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"
Sep 17 01:07:07.388994 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.388637    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" event={"ID":"750bcf6e-f469-4059-b339-230e5545ebe8","Type":"ContainerDied","Data":"77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483"}
Sep 17 01:07:07.388994 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.388698    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm" event={"ID":"750bcf6e-f469-4059-b339-230e5545ebe8","Type":"ContainerDied","Data":"c3771745047bd525e7be9b5238f73b4ccd5024f7942cc0648b8fb3e6e6e50122"}
Sep 17 01:07:07.388994 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.388720    2576 scope.go:117] "RemoveContainer" containerID="77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483"
Sep 17 01:07:07.401730 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.401711    2576 scope.go:117] "RemoveContainer" containerID="9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd"
Sep 17 01:07:07.410525 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.410508    2576 scope.go:117] "RemoveContainer" containerID="77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483"
Sep 17 01:07:07.410981 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:07:07.410818    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483\": container with ID starting with 77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483 not found: ID does not exist" containerID="77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483"
Sep 17 01:07:07.410981 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.410856    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483"} err="failed to get container status \"77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483\": rpc error: code = NotFound desc = could not find container \"77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483\": container with ID starting with 77e3dd91694053c1990ae7db7dc10e3ba664041ad6885866073b4871a35b0483 not found: ID does not exist"
Sep 17 01:07:07.410981 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.410878    2576 scope.go:117] "RemoveContainer" containerID="9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd"
Sep 17 01:07:07.411223 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:07:07.411204    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd\": container with ID starting with 9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd not found: ID does not exist" containerID="9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd"
Sep 17 01:07:07.411288 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.411231    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd"} err="failed to get container status \"9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd\": rpc error: code = NotFound desc = could not find container \"9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd\": container with ID starting with 9312d452369cf0774b75da4901fff0c13b793fd95896521222f51afde12b57cd not found: ID does not exist"
Sep 17 01:07:07.412108 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.412088    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"]
Sep 17 01:07:07.415713 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:07.415692    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bcd112-openshift-default-644768f7c6-c2grm"]
Sep 17 01:07:08.141622 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:08.141582    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" path="/var/lib/kubelet/pods/750bcf6e-f469-4059-b339-230e5545ebe8/volumes"
Sep 17 01:07:08.417637 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:07:08.417602    2576 scope.go:117] "RemoveContainer" containerID="c6b455bf5f635c597b0489d92973934f2d61889f79e4b3215a57ec7c78edf197"
Sep 17 01:08:06.214593 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214557    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-4dnmt"]
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214866    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214877    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214888    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadd204f-edd2-4399-9e50-ecf1cf4ae99b" containerName="payload-pre-processing"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214894    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadd204f-edd2-4399-9e50-ecf1cf4ae99b" containerName="payload-pre-processing"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214902    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b934b2c7-5cd1-46e9-8705-1e15bdfc7454" containerName="manager"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214907    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b934b2c7-5cd1-46e9-8705-1e15bdfc7454" containerName="manager"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214915    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214921    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214928    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214934    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214939    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214944    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214952    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91ad05c-8547-44d0-9005-16dd5c21fb04" containerName="payload-pre-processing"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214972    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91ad05c-8547-44d0-9005-16dd5c21fb04" containerName="payload-pre-processing"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214982    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2a25ad-01a4-4d02-9a01-81e62316bec0" containerName="payload-processing"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214987    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2a25ad-01a4-4d02-9a01-81e62316bec0" containerName="payload-processing"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214993    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48cdfc62-e141-428e-b4f6-67a900207667" containerName="payload-pre-processing"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.214998    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48cdfc62-e141-428e-b4f6-67a900207667" containerName="payload-pre-processing"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.215066    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.215076    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.215083    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.215090    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b934b2c7-5cd1-46e9-8705-1e15bdfc7454" containerName="manager"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.215096    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e813b27a-dce3-4ce6-be6e-811f13b2e4a8" containerName="istio-proxy"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.215102    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dadd204f-edd2-4399-9e50-ecf1cf4ae99b" containerName="payload-pre-processing"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.215108    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e91ad05c-8547-44d0-9005-16dd5c21fb04" containerName="payload-pre-processing"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.215113    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c2a25ad-01a4-4d02-9a01-81e62316bec0" containerName="payload-processing"
Sep 17 01:08:06.215098 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.215117    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy"
Sep 17 01:08:06.216265 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.215123    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48cdfc62-e141-428e-b4f6-67a900207667" containerName="payload-pre-processing"
Sep 17 01:08:06.218036 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.218020    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:06.221120 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.221101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 01:08:06.221197 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.221151    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 01:08:06.221279 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.221259    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pmm2c\""
Sep 17 01:08:06.221348 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.221260    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 01:08:06.227554 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.227535    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-4dnmt"]
Sep 17 01:08:06.307844 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.307807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7msb\" (UniqueName: \"kubernetes.io/projected/13a95931-142b-4b3c-8bdd-d3353d7e932d-kube-api-access-g7msb\") pod \"maas-controller-7c6c7d56b5-4dnmt\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") " pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:06.308060 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.307872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-metrics-certs\") pod \"maas-controller-7c6c7d56b5-4dnmt\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") " pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:06.308060 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.307888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-webhook-cert\") pod \"maas-controller-7c6c7d56b5-4dnmt\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") " pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:06.408639 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.408604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-metrics-certs\") pod \"maas-controller-7c6c7d56b5-4dnmt\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") " pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:06.408639 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.408641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-webhook-cert\") pod \"maas-controller-7c6c7d56b5-4dnmt\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") " pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:06.408845 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.408685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7msb\" (UniqueName: \"kubernetes.io/projected/13a95931-142b-4b3c-8bdd-d3353d7e932d-kube-api-access-g7msb\") pod \"maas-controller-7c6c7d56b5-4dnmt\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") " pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:06.411224 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.411195    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-metrics-certs\") pod \"maas-controller-7c6c7d56b5-4dnmt\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") " pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:06.411345 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.411224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-webhook-cert\") pod \"maas-controller-7c6c7d56b5-4dnmt\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") " pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:06.416290 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.416265    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7msb\" (UniqueName: \"kubernetes.io/projected/13a95931-142b-4b3c-8bdd-d3353d7e932d-kube-api-access-g7msb\") pod \"maas-controller-7c6c7d56b5-4dnmt\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") " pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:06.529258 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.529176    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:06.798917 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.798887    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-4dnmt"]
Sep 17 01:08:06.800818 ip-10-0-128-98 kubenswrapper[2576]: W0917 01:08:06.800786    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a95931_142b_4b3c_8bdd_d3353d7e932d.slice/crio-8716417cd2e09e50a782e114c6cab315d2afbe5248a6cfc66d9fe8167c285b4f WatchSource:0}: Error finding container 8716417cd2e09e50a782e114c6cab315d2afbe5248a6cfc66d9fe8167c285b4f: Status 404 returned error can't find the container with id 8716417cd2e09e50a782e114c6cab315d2afbe5248a6cfc66d9fe8167c285b4f
Sep 17 01:08:06.802196 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:06.802175    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 01:08:07.696130 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:07.696093    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt" event={"ID":"13a95931-142b-4b3c-8bdd-d3353d7e932d","Type":"ContainerStarted","Data":"cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293"}
Sep 17 01:08:07.696549 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:07.696154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt" event={"ID":"13a95931-142b-4b3c-8bdd-d3353d7e932d","Type":"ContainerStarted","Data":"8716417cd2e09e50a782e114c6cab315d2afbe5248a6cfc66d9fe8167c285b4f"}
Sep 17 01:08:07.696549 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:07.696269    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:07.717814 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:07.717749    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt" podStartSLOduration=1.160391452 podStartE2EDuration="1.717725671s" totalImagesPullingTime="557.334219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:08:07.712104565 +0000 UTC m=+2280.139562492" watchObservedRunningTime="2026-09-17 01:08:07.717725671 +0000 UTC m=+2280.145183596"
Sep 17 01:08:18.703007 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:18.702952    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:28.008824 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.008735    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-4dnmt"]
Sep 17 01:08:28.009330 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.009110    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt" podUID="13a95931-142b-4b3c-8bdd-d3353d7e932d" containerName="manager" containerID="cri-o://cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293" gracePeriod=30
Sep 17 01:08:28.245256 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.245233    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:28.293183 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.293106    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-metrics-certs\") pod \"13a95931-142b-4b3c-8bdd-d3353d7e932d\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") "
Sep 17 01:08:28.293183 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.293166    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7msb\" (UniqueName: \"kubernetes.io/projected/13a95931-142b-4b3c-8bdd-d3353d7e932d-kube-api-access-g7msb\") pod \"13a95931-142b-4b3c-8bdd-d3353d7e932d\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") "
Sep 17 01:08:28.293412 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.293236    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-webhook-cert\") pod \"13a95931-142b-4b3c-8bdd-d3353d7e932d\" (UID: \"13a95931-142b-4b3c-8bdd-d3353d7e932d\") "
Sep 17 01:08:28.295365 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.295333    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "13a95931-142b-4b3c-8bdd-d3353d7e932d" (UID: "13a95931-142b-4b3c-8bdd-d3353d7e932d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:08:28.295484 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.295364    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "13a95931-142b-4b3c-8bdd-d3353d7e932d" (UID: "13a95931-142b-4b3c-8bdd-d3353d7e932d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:08:28.295484 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.295379    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a95931-142b-4b3c-8bdd-d3353d7e932d-kube-api-access-g7msb" (OuterVolumeSpecName: "kube-api-access-g7msb") pod "13a95931-142b-4b3c-8bdd-d3353d7e932d" (UID: "13a95931-142b-4b3c-8bdd-d3353d7e932d"). InnerVolumeSpecName "kube-api-access-g7msb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:08:28.394306 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.394273    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-metrics-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:08:28.394306 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.394299    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7msb\" (UniqueName: \"kubernetes.io/projected/13a95931-142b-4b3c-8bdd-d3353d7e932d-kube-api-access-g7msb\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:08:28.394306 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.394309    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13a95931-142b-4b3c-8bdd-d3353d7e932d-webhook-cert\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:08:28.804761 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.804716    2576 generic.go:356] "Generic (PLEG): container finished" podID="13a95931-142b-4b3c-8bdd-d3353d7e932d" containerID="cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293" exitCode=0
Sep 17 01:08:28.804987 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.804774    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt"
Sep 17 01:08:28.804987 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.804808    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt" event={"ID":"13a95931-142b-4b3c-8bdd-d3353d7e932d","Type":"ContainerDied","Data":"cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293"}
Sep 17 01:08:28.804987 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.804889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6c7d56b5-4dnmt" event={"ID":"13a95931-142b-4b3c-8bdd-d3353d7e932d","Type":"ContainerDied","Data":"8716417cd2e09e50a782e114c6cab315d2afbe5248a6cfc66d9fe8167c285b4f"}
Sep 17 01:08:28.804987 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.804912    2576 scope.go:117] "RemoveContainer" containerID="cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293"
Sep 17 01:08:28.814128 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.814108    2576 scope.go:117] "RemoveContainer" containerID="cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293"
Sep 17 01:08:28.814386 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:08:28.814366    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293\": container with ID starting with cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293 not found: ID does not exist" containerID="cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293"
Sep 17 01:08:28.814455 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.814398    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293"} err="failed to get container status \"cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293\": rpc error: code = NotFound desc = could not find container \"cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293\": container with ID starting with cc7d3febb7e00a0ea40151e8c055452365f6be709d01d7327f939cc580663293 not found: ID does not exist"
Sep 17 01:08:28.825428 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.825399    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-4dnmt"]
Sep 17 01:08:28.827373 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:28.827355    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-4dnmt"]
Sep 17 01:08:29.577474 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.577438    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-58qgv"]
Sep 17 01:08:29.577946 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.577858    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy"
Sep 17 01:08:29.577946 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.577873    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0456e8e-f03b-48e9-8dad-300322cb61a6" containerName="istio-proxy"
Sep 17 01:08:29.577946 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.577882    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a95931-142b-4b3c-8bdd-d3353d7e932d" containerName="manager"
Sep 17 01:08:29.577946 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.577888    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a95931-142b-4b3c-8bdd-d3353d7e932d" containerName="manager"
Sep 17 01:08:29.577946 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.577904    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy"
Sep 17 01:08:29.577946 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.577910    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy"
Sep 17 01:08:29.578246 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.577997    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a95931-142b-4b3c-8bdd-d3353d7e932d" containerName="manager"
Sep 17 01:08:29.578246 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.578008    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="750bcf6e-f469-4059-b339-230e5545ebe8" containerName="istio-proxy"
Sep 17 01:08:29.582154 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.582138    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:29.584278 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.584256    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pmm2c\""
Sep 17 01:08:29.585081 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.585063    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 01:08:29.585219 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.585201    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 01:08:29.585282 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.585202    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 01:08:29.590823 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.590801    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-58qgv"]
Sep 17 01:08:29.704565 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.704528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdjsw\" (UniqueName: \"kubernetes.io/projected/e56245d9-a683-4aff-9f40-1d04ba5b45d8-kube-api-access-kdjsw\") pod \"maas-controller-7c6c7d56b5-58qgv\" (UID: \"e56245d9-a683-4aff-9f40-1d04ba5b45d8\") " pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:29.704747 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.704693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e56245d9-a683-4aff-9f40-1d04ba5b45d8-webhook-cert\") pod \"maas-controller-7c6c7d56b5-58qgv\" (UID: \"e56245d9-a683-4aff-9f40-1d04ba5b45d8\") " pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:29.704747 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.704718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e56245d9-a683-4aff-9f40-1d04ba5b45d8-metrics-certs\") pod \"maas-controller-7c6c7d56b5-58qgv\" (UID: \"e56245d9-a683-4aff-9f40-1d04ba5b45d8\") " pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:29.806001 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.805953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e56245d9-a683-4aff-9f40-1d04ba5b45d8-webhook-cert\") pod \"maas-controller-7c6c7d56b5-58qgv\" (UID: \"e56245d9-a683-4aff-9f40-1d04ba5b45d8\") " pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:29.806204 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.806005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e56245d9-a683-4aff-9f40-1d04ba5b45d8-metrics-certs\") pod \"maas-controller-7c6c7d56b5-58qgv\" (UID: \"e56245d9-a683-4aff-9f40-1d04ba5b45d8\") " pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:29.806204 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.806029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdjsw\" (UniqueName: \"kubernetes.io/projected/e56245d9-a683-4aff-9f40-1d04ba5b45d8-kube-api-access-kdjsw\") pod \"maas-controller-7c6c7d56b5-58qgv\" (UID: \"e56245d9-a683-4aff-9f40-1d04ba5b45d8\") " pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:29.808661 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.808621    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e56245d9-a683-4aff-9f40-1d04ba5b45d8-webhook-cert\") pod \"maas-controller-7c6c7d56b5-58qgv\" (UID: \"e56245d9-a683-4aff-9f40-1d04ba5b45d8\") " pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:29.808865 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.808845    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e56245d9-a683-4aff-9f40-1d04ba5b45d8-metrics-certs\") pod \"maas-controller-7c6c7d56b5-58qgv\" (UID: \"e56245d9-a683-4aff-9f40-1d04ba5b45d8\") " pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:29.813677 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.813652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdjsw\" (UniqueName: \"kubernetes.io/projected/e56245d9-a683-4aff-9f40-1d04ba5b45d8-kube-api-access-kdjsw\") pod \"maas-controller-7c6c7d56b5-58qgv\" (UID: \"e56245d9-a683-4aff-9f40-1d04ba5b45d8\") " pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:29.893421 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:29.893339    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:30.141338 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:30.141306    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13a95931-142b-4b3c-8bdd-d3353d7e932d" path="/var/lib/kubelet/pods/13a95931-142b-4b3c-8bdd-d3353d7e932d/volumes"
Sep 17 01:08:30.168950 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:30.168928    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6c7d56b5-58qgv"]
Sep 17 01:08:30.170588 ip-10-0-128-98 kubenswrapper[2576]: W0917 01:08:30.170553    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode56245d9_a683_4aff_9f40_1d04ba5b45d8.slice/crio-4f76a9ae6729994fe4b3b0bca5d46aa404f693447c1d2d6d3771cc87440cf597 WatchSource:0}: Error finding container 4f76a9ae6729994fe4b3b0bca5d46aa404f693447c1d2d6d3771cc87440cf597: Status 404 returned error can't find the container with id 4f76a9ae6729994fe4b3b0bca5d46aa404f693447c1d2d6d3771cc87440cf597
Sep 17 01:08:30.819409 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:30.819328    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6c7d56b5-58qgv" event={"ID":"e56245d9-a683-4aff-9f40-1d04ba5b45d8","Type":"ContainerStarted","Data":"329fa9c8a03e6b32bea19fed243a2833b9f3f35ab87d9617a5d7f8447e58ea2d"}
Sep 17 01:08:30.819409 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:30.819382    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6c7d56b5-58qgv" event={"ID":"e56245d9-a683-4aff-9f40-1d04ba5b45d8","Type":"ContainerStarted","Data":"4f76a9ae6729994fe4b3b0bca5d46aa404f693447c1d2d6d3771cc87440cf597"}
Sep 17 01:08:30.819409 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:30.819405    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:08:30.835748 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:30.835701    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c6c7d56b5-58qgv" podStartSLOduration=1.4569535120000001 podStartE2EDuration="1.835684086s" totalImagesPullingTime="378.730574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:08:30.834140973 +0000 UTC m=+2303.261598913" watchObservedRunningTime="2026-09-17 01:08:30.835684086 +0000 UTC m=+2303.263142016"
Sep 17 01:08:41.827292 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:08:41.827257    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c6c7d56b5-58qgv"
Sep 17 01:12:28.734634 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.734598    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"]
Sep 17 01:12:28.737976 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.737930    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.740038 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.740016    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gxvb4\""
Sep 17 01:12:28.747934 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.747910    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"]
Sep 17 01:12:28.837577 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.837541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j85qh\" (UniqueName: \"kubernetes.io/projected/ef859e89-d3ca-4ceb-a643-07792b7498ff-kube-api-access-j85qh\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.837751 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.837605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef859e89-d3ca-4ceb-a643-07792b7498ff-maas-api-tls\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.837751 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.837637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef859e89-d3ca-4ceb-a643-07792b7498ff-metrics-certs\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.837751 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.837685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef859e89-d3ca-4ceb-a643-07792b7498ff-openshift-service-ca\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.938424 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.938388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef859e89-d3ca-4ceb-a643-07792b7498ff-maas-api-tls\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.938424 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.938421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef859e89-d3ca-4ceb-a643-07792b7498ff-metrics-certs\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.938657 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.938449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef859e89-d3ca-4ceb-a643-07792b7498ff-openshift-service-ca\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.938657 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.938498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85qh\" (UniqueName: \"kubernetes.io/projected/ef859e89-d3ca-4ceb-a643-07792b7498ff-kube-api-access-j85qh\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.939225 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.939199    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef859e89-d3ca-4ceb-a643-07792b7498ff-openshift-service-ca\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.941028 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.941004    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef859e89-d3ca-4ceb-a643-07792b7498ff-metrics-certs\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.941186 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.941167    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef859e89-d3ca-4ceb-a643-07792b7498ff-maas-api-tls\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:28.945301 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:28.945281    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j85qh\" (UniqueName: \"kubernetes.io/projected/ef859e89-d3ca-4ceb-a643-07792b7498ff-kube-api-access-j85qh\") pod \"maas-api-79c8ddf6d7-7tkb7\" (UID: \"ef859e89-d3ca-4ceb-a643-07792b7498ff\") " pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:29.051186 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:29.051115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:29.321756 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:29.321732    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"]
Sep 17 01:12:29.323487 ip-10-0-128-98 kubenswrapper[2576]: W0917 01:12:29.323454    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef859e89_d3ca_4ceb_a643_07792b7498ff.slice/crio-1d5e0093037d1568dcd76ceabc864b167bb6d2640890f1f39d53276008d58b31 WatchSource:0}: Error finding container 1d5e0093037d1568dcd76ceabc864b167bb6d2640890f1f39d53276008d58b31: Status 404 returned error can't find the container with id 1d5e0093037d1568dcd76ceabc864b167bb6d2640890f1f39d53276008d58b31
Sep 17 01:12:30.018018 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:30.017983    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7" event={"ID":"ef859e89-d3ca-4ceb-a643-07792b7498ff","Type":"ContainerStarted","Data":"156476ac8f203a5b0a34fabb45e7a23603325650d11b8969229ce56f4d1e15f4"}
Sep 17 01:12:30.018408 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:30.018042    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7" event={"ID":"ef859e89-d3ca-4ceb-a643-07792b7498ff","Type":"ContainerStarted","Data":"1d5e0093037d1568dcd76ceabc864b167bb6d2640890f1f39d53276008d58b31"}
Sep 17 01:12:30.018408 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:30.018172    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:30.034706 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:30.034609    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7" podStartSLOduration=1.578682097 podStartE2EDuration="2.034596143s" totalImagesPullingTime="455.914046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:12:30.033530246 +0000 UTC m=+2542.460988171" watchObservedRunningTime="2026-09-17 01:12:30.034596143 +0000 UTC m=+2542.462054065"
Sep 17 01:12:36.033883 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:36.033849    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79c8ddf6d7-7tkb7"
Sep 17 01:12:43.661980 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:43.661922    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"]
Sep 17 01:12:43.662525 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:43.662215    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8" podUID="736c1eda-6051-44a9-a80f-3cdd4e0201d7" containerName="maas-api" containerID="cri-o://fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1" gracePeriod=30
Sep 17 01:12:44.912193 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:44.912166    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 01:12:44.961345 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:44.961309    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/736c1eda-6051-44a9-a80f-3cdd4e0201d7-openshift-service-ca\") pod \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") "
Sep 17 01:12:44.961345 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:44.961354    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snw7w\" (UniqueName: \"kubernetes.io/projected/736c1eda-6051-44a9-a80f-3cdd4e0201d7-kube-api-access-snw7w\") pod \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") "
Sep 17 01:12:44.961559 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:44.961410    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-maas-api-tls\") pod \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") "
Sep 17 01:12:44.961559 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:44.961466    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-metrics-certs\") pod \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\" (UID: \"736c1eda-6051-44a9-a80f-3cdd4e0201d7\") "
Sep 17 01:12:44.961772 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:44.961748    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736c1eda-6051-44a9-a80f-3cdd4e0201d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "736c1eda-6051-44a9-a80f-3cdd4e0201d7" (UID: "736c1eda-6051-44a9-a80f-3cdd4e0201d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:12:44.963725 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:44.963693    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "736c1eda-6051-44a9-a80f-3cdd4e0201d7" (UID: "736c1eda-6051-44a9-a80f-3cdd4e0201d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:12:44.963840 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:44.963738    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "736c1eda-6051-44a9-a80f-3cdd4e0201d7" (UID: "736c1eda-6051-44a9-a80f-3cdd4e0201d7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:12:44.963840 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:44.963799    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/736c1eda-6051-44a9-a80f-3cdd4e0201d7-kube-api-access-snw7w" (OuterVolumeSpecName: "kube-api-access-snw7w") pod "736c1eda-6051-44a9-a80f-3cdd4e0201d7" (UID: "736c1eda-6051-44a9-a80f-3cdd4e0201d7"). InnerVolumeSpecName "kube-api-access-snw7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:12:45.062701 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.062610    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/736c1eda-6051-44a9-a80f-3cdd4e0201d7-openshift-service-ca\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:12:45.062701 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.062644    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snw7w\" (UniqueName: \"kubernetes.io/projected/736c1eda-6051-44a9-a80f-3cdd4e0201d7-kube-api-access-snw7w\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:12:45.062701 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.062656    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-maas-api-tls\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:12:45.062701 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.062665    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736c1eda-6051-44a9-a80f-3cdd4e0201d7-metrics-certs\") on node \"ip-10-0-128-98.ec2.internal\" DevicePath \"\""
Sep 17 01:12:45.099487 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.099451    2576 generic.go:356] "Generic (PLEG): container finished" podID="736c1eda-6051-44a9-a80f-3cdd4e0201d7" containerID="fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1" exitCode=0
Sep 17 01:12:45.099679 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.099511    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"
Sep 17 01:12:45.099679 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.099548    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8" event={"ID":"736c1eda-6051-44a9-a80f-3cdd4e0201d7","Type":"ContainerDied","Data":"fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1"}
Sep 17 01:12:45.099679 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.099612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8" event={"ID":"736c1eda-6051-44a9-a80f-3cdd4e0201d7","Type":"ContainerDied","Data":"7f49105a70f203e4117545181fbdadd3cdc5ee177116228b6cb3371a702a0e55"}
Sep 17 01:12:45.099679 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.099641    2576 scope.go:117] "RemoveContainer" containerID="fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1"
Sep 17 01:12:45.108764 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.108741    2576 scope.go:117] "RemoveContainer" containerID="fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1"
Sep 17 01:12:45.109092 ip-10-0-128-98 kubenswrapper[2576]: E0917 01:12:45.109072    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1\": container with ID starting with fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1 not found: ID does not exist" containerID="fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1"
Sep 17 01:12:45.109165 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.109103    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1"} err="failed to get container status \"fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1\": rpc error: code = NotFound desc = could not find container \"fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1\": container with ID starting with fe5ba5fc17a8929b977decd07a0c4f75e1927617b0b71199edb4a52a4ab2afe1 not found: ID does not exist"
Sep 17 01:12:45.120682 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.120644    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"]
Sep 17 01:12:45.127805 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:45.127777    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-cf64cbd4c-wp8h8"]
Sep 17 01:12:46.141177 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:12:46.141145    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="736c1eda-6051-44a9-a80f-3cdd4e0201d7" path="/var/lib/kubelet/pods/736c1eda-6051-44a9-a80f-3cdd4e0201d7/volumes"
Sep 17 01:13:07.244449 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:07.244418    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c6c7d56b5-58qgv_e56245d9-a683-4aff-9f40-1d04ba5b45d8/manager/0.log"
Sep 17 01:13:07.599062 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:07.598991    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-596c59f645-gxlg5_47666fe1-e069-4ffb-9b2e-cc74f282e3fc/copy-manifests/0.log"
Sep 17 01:13:07.611436 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:07.611403    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-596c59f645-gxlg5_47666fe1-e069-4ffb-9b2e-cc74f282e3fc/manager/0.log"
Sep 17 01:13:08.211337 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:08.211291    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-79c8ddf6d7-7tkb7_ef859e89-d3ca-4ceb-a643-07792b7498ff/maas-api/0.log"
Sep 17 01:13:09.539447 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:09.539413    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rqbzc_1f8a8f63-a361-4e35-ac0b-c5cb7e727e64/manager/0.log"
Sep 17 01:13:09.644093 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:09.644061    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-6mvnm_3a6fa024-7376-44d9-b850-d5d5bddc64e3/manager/0.log"
Sep 17 01:13:10.112297 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:10.112268    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-b2kkn_bfba5377-ca9c-4080-b3b2-00855912929e/manager/0.log"
Sep 17 01:13:10.460033 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:10.460006    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t_5a2ed0ab-dcc7-4537-9691-ed13d161497e/istio-proxy/0.log"
Sep 17 01:13:10.574567 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:10.574540    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-72v28_a31671c0-3821-45d8-99dd-e7c68acad3b7/discovery/0.log"
Sep 17 01:13:10.686947 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:10.686919    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67475995c-8zxcm_3383b705-fc43-4b86-9c77-725bcac9b006/kube-auth-proxy/0.log"
Sep 17 01:13:11.162949 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:11.162916    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7mk8t_7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f/payload-processing/0.log"
Sep 17 01:13:11.969373 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:11.969342    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-b2hhn_6d6791cd-5d02-4bcc-b9ad-76f5cede7b36/main/0.log"
Sep 17 01:13:12.188819 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:12.188794    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-6fzpd_001305e4-e2d5-447f-bad3-79b263cc1290/main/0.log"
Sep 17 01:13:12.298346 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:12.298274    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-k6f6v_c0479218-e479-446d-ab22-c7ed691dee84/main/0.log"
Sep 17 01:13:20.573275 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:20.573247    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-drkmn_c4b2a03a-fc36-4bdd-9de2-5bb7ac6ccee3/global-pull-secret-syncer/0.log"
Sep 17 01:13:20.720328 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:20.720298    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z65fg_d028a8f3-fd72-4b0d-80cf-5b42b0d344bd/konnectivity-agent/0.log"
Sep 17 01:13:20.738568 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:20.738543    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-98.ec2.internal_ee2bbf241d4d47d45cb8a3bfac597f7f/haproxy/0.log"
Sep 17 01:13:25.969139 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:25.969106    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rqbzc_1f8a8f63-a361-4e35-ac0b-c5cb7e727e64/manager/0.log"
Sep 17 01:13:25.991610 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:25.991583    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-6mvnm_3a6fa024-7376-44d9-b850-d5d5bddc64e3/manager/0.log"
Sep 17 01:13:26.133330 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:26.133304    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-b2kkn_bfba5377-ca9c-4080-b3b2-00855912929e/manager/0.log"
Sep 17 01:13:27.770610 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:27.770581    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8llp_a6cb4e3b-3458-4135-9900-a2d33ac95f36/node-exporter/0.log"
Sep 17 01:13:27.792149 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:27.792130    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8llp_a6cb4e3b-3458-4135-9900-a2d33ac95f36/kube-rbac-proxy/0.log"
Sep 17 01:13:27.817676 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:27.817655    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8llp_a6cb4e3b-3458-4135-9900-a2d33ac95f36/init-textfile/0.log"
Sep 17 01:13:30.355006 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.354907    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"]
Sep 17 01:13:30.355442 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.355272    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736c1eda-6051-44a9-a80f-3cdd4e0201d7" containerName="maas-api"
Sep 17 01:13:30.355442 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.355285    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="736c1eda-6051-44a9-a80f-3cdd4e0201d7" containerName="maas-api"
Sep 17 01:13:30.355442 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.355354    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="736c1eda-6051-44a9-a80f-3cdd4e0201d7" containerName="maas-api"
Sep 17 01:13:30.362765 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.362734    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.365303 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.365283    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jsqsk\"/\"kube-root-ca.crt\""
Sep 17 01:13:30.365427 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.365336    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jsqsk\"/\"openshift-service-ca.crt\""
Sep 17 01:13:30.366332 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.366310    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jsqsk\"/\"default-dockercfg-bt7hf\""
Sep 17 01:13:30.369215 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.369194    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"]
Sep 17 01:13:30.444416 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.444381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-lib-modules\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.444597 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.444420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-podres\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.444597 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.444492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-proc\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.444597 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.444518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2th56\" (UniqueName: \"kubernetes.io/projected/17661e65-ada9-4094-b41c-f438116e8b4b-kube-api-access-2th56\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.444597 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.444558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-sys\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.545728 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.545691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-lib-modules\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.545895 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.545742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-podres\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.545895 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.545804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-proc\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.545895 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.545833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2th56\" (UniqueName: \"kubernetes.io/projected/17661e65-ada9-4094-b41c-f438116e8b4b-kube-api-access-2th56\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.545895 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.545843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-lib-modules\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.545895 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.545856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-sys\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.546126 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.545903    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-proc\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.546126 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.545912    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-podres\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.546126 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.545939    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17661e65-ada9-4094-b41c-f438116e8b4b-sys\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.553044 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.553022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2th56\" (UniqueName: \"kubernetes.io/projected/17661e65-ada9-4094-b41c-f438116e8b4b-kube-api-access-2th56\") pod \"perf-node-gather-daemonset-kfxks\" (UID: \"17661e65-ada9-4094-b41c-f438116e8b4b\") " pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.673795 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.673770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:30.892060 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.892030    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d4b5c5f-jdm9t_02d1fa35-5b4f-4872-bbab-0183b5f5d5ba/console/0.log"
Sep 17 01:13:30.943399 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:30.943358    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"]
Sep 17 01:13:30.945031 ip-10-0-128-98 kubenswrapper[2576]: W0917 01:13:30.945004    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod17661e65_ada9_4094_b41c_f438116e8b4b.slice/crio-079052bf0cbd9e4e63b5421a22de5290483c0b16483d7a6538b1d4b46a9827dc WatchSource:0}: Error finding container 079052bf0cbd9e4e63b5421a22de5290483c0b16483d7a6538b1d4b46a9827dc: Status 404 returned error can't find the container with id 079052bf0cbd9e4e63b5421a22de5290483c0b16483d7a6538b1d4b46a9827dc
Sep 17 01:13:31.347691 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:31.347585    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks" event={"ID":"17661e65-ada9-4094-b41c-f438116e8b4b","Type":"ContainerStarted","Data":"4f050acd3ea858cd7686c324eb552045a7b220a8cf24f868a1f7fcebcea6c574"}
Sep 17 01:13:31.347691 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:31.347664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks" event={"ID":"17661e65-ada9-4094-b41c-f438116e8b4b","Type":"ContainerStarted","Data":"079052bf0cbd9e4e63b5421a22de5290483c0b16483d7a6538b1d4b46a9827dc"}
Sep 17 01:13:31.347868 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:31.347697    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:31.362070 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:31.362026    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks" podStartSLOduration=1.362011447 podStartE2EDuration="1.362011447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:13:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:13:31.360266086 +0000 UTC m=+2603.787724011" watchObservedRunningTime="2026-09-17 01:13:31.362011447 +0000 UTC m=+2603.789469369"
Sep 17 01:13:32.808837 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:32.808809    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-thdzd_44e39968-25a0-4b24-9f29-22e64c88ebe1/dns/0.log"
Sep 17 01:13:32.827332 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:32.827312    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-thdzd_44e39968-25a0-4b24-9f29-22e64c88ebe1/kube-rbac-proxy/0.log"
Sep 17 01:13:32.849213 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:32.849193    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b6lfq_a2b64bdf-fb1b-44bc-96ae-83a0b56d1c3b/dns-node-resolver/0.log"
Sep 17 01:13:33.377888 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:33.377858    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d55b595c7-ltl2k_c5685fe3-0998-4bb8-bafc-1e66ee55174a/registry/0.log"
Sep 17 01:13:33.438122 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:33.438095    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xv89m_1fba316c-30a0-4da6-b8fb-cc90962a2984/node-ca/0.log"
Sep 17 01:13:34.307475 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:34.307446    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t_5a2ed0ab-dcc7-4537-9691-ed13d161497e/istio-proxy/0.log"
Sep 17 01:13:34.669297 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:34.669266    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-72v28_a31671c0-3821-45d8-99dd-e7c68acad3b7/discovery/0.log"
Sep 17 01:13:34.689097 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:34.689063    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67475995c-8zxcm_3383b705-fc43-4b86-9c77-725bcac9b006/kube-auth-proxy/0.log"
Sep 17 01:13:34.816951 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:34.816923    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7mk8t_7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f/payload-processing/0.log"
Sep 17 01:13:35.703728 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:35.703674    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h6jkw_f7be6e12-562d-48cd-bec6-9f4a39ca9862/serve-healthcheck-canary/0.log"
Sep 17 01:13:36.242804 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:36.242780    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qm42r_b50420e4-bdcc-4a03-85e0-39ed24a11a99/kube-rbac-proxy/0.log"
Sep 17 01:13:36.260470 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:36.260447    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qm42r_b50420e4-bdcc-4a03-85e0-39ed24a11a99/exporter/0.log"
Sep 17 01:13:36.279451 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:36.279429    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qm42r_b50420e4-bdcc-4a03-85e0-39ed24a11a99/extractor/0.log"
Sep 17 01:13:37.362021 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:37.361990    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jsqsk/perf-node-gather-daemonset-kfxks"
Sep 17 01:13:38.830555 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:38.830526    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c6c7d56b5-58qgv_e56245d9-a683-4aff-9f40-1d04ba5b45d8/manager/0.log"
Sep 17 01:13:39.050753 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:39.050726    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-596c59f645-gxlg5_47666fe1-e069-4ffb-9b2e-cc74f282e3fc/manager/0.log"
Sep 17 01:13:39.070466 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:39.070438    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-596c59f645-gxlg5_47666fe1-e069-4ffb-9b2e-cc74f282e3fc/copy-manifests/0.log"
Sep 17 01:13:41.074970 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:41.074934    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t_5a2ed0ab-dcc7-4537-9691-ed13d161497e/istio-proxy/0.log"
Sep 17 01:13:41.443732 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:41.443699    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-72v28_a31671c0-3821-45d8-99dd-e7c68acad3b7/discovery/0.log"
Sep 17 01:13:41.468181 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:41.468159    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67475995c-8zxcm_3383b705-fc43-4b86-9c77-725bcac9b006/kube-auth-proxy/0.log"
Sep 17 01:13:41.561862 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:41.561827    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7mk8t_7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f/payload-processing/0.log"
Sep 17 01:13:43.023567 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:43.023535    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwrq4t_5a2ed0ab-dcc7-4537-9691-ed13d161497e/istio-proxy/0.log"
Sep 17 01:13:43.394276 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:43.394170    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-72v28_a31671c0-3821-45d8-99dd-e7c68acad3b7/discovery/0.log"
Sep 17 01:13:43.417288 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:43.417264    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67475995c-8zxcm_3383b705-fc43-4b86-9c77-725bcac9b006/kube-auth-proxy/0.log"
Sep 17 01:13:43.507688 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:43.507665    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7mk8t_7adbe5fa-eb75-423f-9a36-e31e2b4f4e4f/payload-processing/0.log"
Sep 17 01:13:45.550488 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:45.550459    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-4qd9k_0cc8b73f-d364-48f4-bcee-0403859d6fbe/migrator/0.log"
Sep 17 01:13:45.571161 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:45.571128    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-4qd9k_0cc8b73f-d364-48f4-bcee-0403859d6fbe/graceful-termination/0.log"
Sep 17 01:13:46.786993 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:46.786902    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m9vh_b09882e1-0cd9-4fbe-941a-fa217471afbb/kube-multus-additional-cni-plugins/0.log"
Sep 17 01:13:46.804700 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:46.804674    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m9vh_b09882e1-0cd9-4fbe-941a-fa217471afbb/egress-router-binary-copy/0.log"
Sep 17 01:13:46.822875 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:46.822858    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m9vh_b09882e1-0cd9-4fbe-941a-fa217471afbb/cni-plugins/0.log"
Sep 17 01:13:46.840719 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:46.840692    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m9vh_b09882e1-0cd9-4fbe-941a-fa217471afbb/bond-cni-plugin/0.log"
Sep 17 01:13:46.858576 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:46.858545    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m9vh_b09882e1-0cd9-4fbe-941a-fa217471afbb/routeoverride-cni/0.log"
Sep 17 01:13:46.878548 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:46.878529    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m9vh_b09882e1-0cd9-4fbe-941a-fa217471afbb/whereabouts-cni-bincopy/0.log"
Sep 17 01:13:46.896155 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:46.896136    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m9vh_b09882e1-0cd9-4fbe-941a-fa217471afbb/whereabouts-cni/0.log"
Sep 17 01:13:47.321258 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:47.321229    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xm8jp_138ffd91-a273-46b4-bd1a-b59abe010b48/kube-multus/0.log"
Sep 17 01:13:47.339741 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:47.339716    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hf4kw_f3834b70-3e64-4873-ab8e-b551c9504f6d/network-metrics-daemon/0.log"
Sep 17 01:13:47.356252 ip-10-0-128-98 kubenswrapper[2576]: I0917 01:13:47.356232    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hf4kw_f3834b70-3e64-4873-ab8e-b551c9504f6d/kube-rbac-proxy/0.log"