Sep 18 13:44:32.689434 ip-10-0-136-76 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 13:44:36.053795 ip-10-0-136-76 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:44:36.053795 ip-10-0-136-76 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 13:44:36.053795 ip-10-0-136-76 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:44:36.053795 ip-10-0-136-76 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 13:44:36.053795 ip-10-0-136-76 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:44:36.054536 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.053866    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 13:44:36.059568 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059551    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:36.059568 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059568    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059572    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059576    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059579    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059582    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059584    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059587    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059590    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059593    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059596    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059598    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059602    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059605    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059608    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059611    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059614    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059618    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059622    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059625    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:36.059639 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059628    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059631    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059634    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059637    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059640    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059643    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059646    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059649    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059652    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059655    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059658    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059660    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059663    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059666    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059668    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059671    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059674    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059677    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059679    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059682    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:36.060090 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059684    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059687    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059690    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059692    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059694    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059697    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059699    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059702    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059704    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059707    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059710    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059712    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059715    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059717    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059720    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059723    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059726    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059728    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059731    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059733    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:36.060627 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059737    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059740    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059742    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059745    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059747    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059750    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059752    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059755    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059758    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059761    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059763    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059766    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059768    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059771    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059773    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059777    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059779    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059782    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059785    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059787    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:36.061104 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059790    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059792    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059795    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059797    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059800    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059802    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059805    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059808    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059811    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059813    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059816    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059818    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059823    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059826    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059828    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059831    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059835    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059839    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.059843    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:36.061902 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060583    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060590    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060594    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060597    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060600    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060602    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060606    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060608    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060611    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060613    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060616    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060620    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060622    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060625    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060628    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060631    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060634    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060637    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060639    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:36.062623 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060644    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060649    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060652    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060654    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060657    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060660    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060662    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060665    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060668    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060670    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060674    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060677    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060679    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060682    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060684    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060687    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060690    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060692    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060695    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060697    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:36.063186 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060700    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060702    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060705    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060707    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060710    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060713    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060715    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060718    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060720    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060723    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060725    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060728    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060731    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060734    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060736    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060739    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060741    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060744    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060746    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060749    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:36.063727 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060751    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060753    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060756    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060758    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060761    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060763    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060768    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060771    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060774    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060777    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060779    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060782    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060784    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060787    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060790    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060793    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060796    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060798    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060801    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:36.064242 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060803    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060805    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060808    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060810    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060813    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060816    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060818    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060821    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060825    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060828    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060831    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060834    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060837    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060840    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060843    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060846    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060849    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060851    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060854    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060856    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:36.064712 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.060859    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.062984    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.062997    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063001    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063004    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063007    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063010    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063014    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063017    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063021    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063025    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063029    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063032    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063035    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063037    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063040    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063043    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063045    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063048    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063051    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:36.065212 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063054    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063056    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063059    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063062    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063065    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063074    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063078    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063081    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063083    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063086    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063089    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063092    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063094    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063098    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063101    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063104    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063107    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063110    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063113    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:36.065693 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063116    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063120    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063123    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063126    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063142    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063147    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063150    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063152    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063155    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063158    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063161    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063163    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063167    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063171    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063174    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063177    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063180    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063183    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063186    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:36.066177 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063188    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063191    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063194    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063197    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063200    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063203    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063206    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063208    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063211    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063215    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063217    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063220    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063222    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063225    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063228    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063232    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063234    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063237    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063239    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063242    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:36.066635 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063244    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063247    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063250    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063252    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063255    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063258    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063261    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063264    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063266    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063269    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063271    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063274    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063277    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063279    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063282    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063284    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063287    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063290    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063292    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063295    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:36.067145 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063298    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.063301    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063378    2575 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063422    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063430    2575 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063434    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063439    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063442    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063447    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063451    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063455    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063458    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063461    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063465    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063468    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063471    2575 flags.go:64] FLAG: --cgroup-root=""
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063474    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063477    2575 flags.go:64] FLAG: --client-ca-file=""
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063480    2575 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063484    2575 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063489    2575 flags.go:64] FLAG: --cluster-domain=""
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063492    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063495    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 13:44:36.067630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063499    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063502    2575 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063506    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063509    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063513    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063516    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063519    2575 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063522    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063525    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063529    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063532    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063536    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063540    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063543    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063545    2575 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063549    2575 flags.go:64] FLAG: --enable-server="true"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063551    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063556    2575 flags.go:64] FLAG: --event-burst="100"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063559    2575 flags.go:64] FLAG: --event-qps="50"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063563    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063566    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063569    2575 flags.go:64] FLAG: --eviction-hard=""
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063573    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063576    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063579    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 13:44:36.068216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063582    2575 flags.go:64] FLAG: --eviction-soft=""
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063585    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063588    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063591    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063594    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063597    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063600    2575 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063603    2575 flags.go:64] FLAG: --feature-gates=""
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063607    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063610    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063614    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063617    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063620    2575 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063623    2575 flags.go:64] FLAG: --help="false"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063626    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063629    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063633    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063636    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063640    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063643    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063646    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063649    2575 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063652    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 13:44:36.068804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063655    2575 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063658    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063661    2575 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063664    2575 flags.go:64] FLAG: --kube-reserved=""
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063666    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063669    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063672    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063675    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063678    2575 flags.go:64] FLAG: --lock-file=""
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063681    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063683    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063686    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063692    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063694    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063698    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063701    2575 flags.go:64] FLAG: --logging-format="text"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063703    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063707    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063710    2575 flags.go:64] FLAG: --manifest-url=""
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063713    2575 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063717    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063720    2575 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063724    2575 flags.go:64] FLAG: --max-pods="110"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063727    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063731    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 13:44:36.069443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063734    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063737    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063741    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063744    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063747    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063755    2575 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063759    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063762    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063765    2575 flags.go:64] FLAG: --pod-cidr=""
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063768    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063775    2575 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063778    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063781    2575 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063784    2575 flags.go:64] FLAG: --port="10250"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063787    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063790    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e124dfc342517aca"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063793    2575 flags.go:64] FLAG: --qos-reserved=""
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063796    2575 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063799    2575 flags.go:64] FLAG: --register-node="true"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063802    2575 flags.go:64] FLAG: --register-with-taints=""
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063806    2575 flags.go:64] FLAG: --registry-burst="10"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063809    2575 flags.go:64] FLAG: --registry-qps="5"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063812    2575 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063816    2575 flags.go:64] FLAG: --reserved-memory=""
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063819    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 13:44:36.070043 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063822    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063825    2575 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063828    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063831    2575 flags.go:64] FLAG: --runonce="false"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063834    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063837    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063840    2575 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063843    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063845    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063849    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063852    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063855    2575 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063858    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063860    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063863    2575 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063866    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063869    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063872    2575 flags.go:64] FLAG: --system-cgroups=""
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063875    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063881    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063884    2575 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063887    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063891    2575 flags.go:64] FLAG: --tls-min-version=""
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063894    2575 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063897    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 13:44:36.070719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063900    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063903    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063906    2575 flags.go:64] FLAG: --v="2"
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063910    2575 flags.go:64] FLAG: --version="false"
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063914    2575 flags.go:64] FLAG: --vmodule=""
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063918    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.063921    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064054    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064058    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064061    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064064    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064068    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064070    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064073    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064079    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064082    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064085    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064088    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064091    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064094    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064097    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:36.071347 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064100    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064102    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064105    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064108    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064110    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064114    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064116    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064119    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064122    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064124    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064127    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064143    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064146    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064149    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064151    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064154    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064157    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064160    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064163    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064167    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:36.071862 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064171    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064174    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064177    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064180    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064183    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064187    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064192    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064195    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064198    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064201    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064204    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064206    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064210    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064213    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064215    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064218    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064221    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064223    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064226    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064229    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:36.072366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064232    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064234    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064237    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064240    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064243    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064246    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064248    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064251    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064254    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064257    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064260    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064263    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064267    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064269    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064272    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064275    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064277    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064281    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064287    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064291    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:36.072863 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064295    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064298    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064301    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064304    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064306    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064309    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064312    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064315    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064318    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064322    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064326    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064328    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064331    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064334    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064337    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064339    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064342    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064345    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064347    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:36.073364 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064350    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064353    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064355    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064358    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064361    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.064364    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.065159    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.072003    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.072018    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.072037    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.072046    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072101    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072106    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072109    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072113    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:36.073828 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072115    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072118    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072121    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072124    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072127    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072146    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072149    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072152    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072155    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072157    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072160    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072163    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072165    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072168    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072170    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072172    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072175    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072177    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072180    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:36.074232 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072182    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072187    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072190    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072193    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072196    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072199    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072203    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072206    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072209    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072212    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072215    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072217    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072220    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072223    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072226    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072230    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072233    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072236    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072239    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072242    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:36.074692 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072245    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072248    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072251    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072253    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072256    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072259    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072262    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072265    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072267    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072270    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072272    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072275    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072278    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072280    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072283    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072285    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072288    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072291    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072294    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:36.075237 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072298    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072301    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072304    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072306    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072309    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072312    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072314    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072317    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072319    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072322    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072324    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072327    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072330    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072333    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072335    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072338    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072340    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072343    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072346    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072349    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:36.075706 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072351    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072354    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072356    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072359    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072361    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072364    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072366    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072369    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072373    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072377    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072380    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072383    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072386    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072394    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072397    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072399    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:36.076346 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072402    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.072407    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072516    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072521    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072524    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072527    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072529    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072532    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072535    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072538    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072540    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072543    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072547    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072551    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:36.076961 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072554    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072557    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072560    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072563    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072566    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072569    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072572    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072574    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072577    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072580    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072582    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072585    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072588    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072590    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072593    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072596    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072599    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072602    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072604    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072607    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:36.077565 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072609    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072612    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072614    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072617    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072620    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072622    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072625    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072627    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072630    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072632    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072635    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072637    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072640    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072643    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072647    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072649    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072652    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072654    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072657    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072659    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:36.078203 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072662    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072664    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072667    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072669    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072672    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072675    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072677    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072680    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072682    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072685    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072688    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072690    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072693    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072695    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072698    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072700    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072703    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072705    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072708    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072710    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:36.078752 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072713    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072715    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072718    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072720    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072723    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072725    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072728    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072730    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072733    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072735    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072738    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072740    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072743    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072745    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072748    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072750    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072753    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072756    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072758    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072761    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:36.079330 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072763    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072766    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072769    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072772    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072774    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072777    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:36.072779    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.072784    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.072890    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.074830    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.075661    2575 server.go:1019] "Starting client certificate rotation"
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.075780    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.076469    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 13:44:36.079974 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.077950    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 13:44:36.080411 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.079056    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 13:44:36.083515 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.083496    2575 log.go:25] "Validated CRI v1 runtime API"
Sep 18 13:44:36.087880 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.087864    2575 log.go:25] "Validated CRI v1 image API"
Sep 18 13:44:36.088766 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.088751    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 13:44:36.091515 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.091496    2575 fs.go:135] Filesystem UUIDs: map[34313ca7-b0b7-4d3d-a8e5-564b66e1ef9e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b889a138-6e7f-4ad1-a1af-2801e8b131e5:/dev/nvme0n1p4]
Sep 18 13:44:36.091569 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.091514    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 13:44:36.095355 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.095249    2575 manager.go:216] Machine: {Timestamp:2026-09-18 13:44:36.094765882 +0000 UTC m=+1.930604586 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101367 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec279e98cdd4e30eb8bbb3aa075ec577 SystemUUID:ec279e98-cdd4-e30e-b8bb-b3aa075ec577 BootID:0e84b162-96db-471d-a96a-ca865e51449e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:da:ec:99:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:da:ec:99:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:e3:d6:5a:95:5c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 13:44:36.095355 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.095354    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 13:44:36.095465 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.095454    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 13:44:36.096843 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.096814    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 13:44:36.096975 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.096847    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-76.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 13:44:36.098041 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.098031    2575 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 13:44:36.098074 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.098043    2575 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 13:44:36.098074 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.098051    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 13:44:36.098074 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.098062    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 13:44:36.098182 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.098146    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 13:44:36.102524 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.102512    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 13:44:36.102641 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.102631    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 13:44:36.102677 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.102663    2575 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 13:44:36.102707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.102676    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 13:44:36.102707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.102699    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 13:44:36.102761 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.102713    2575 kubelet.go:398] "Adding apiserver pod source"
Sep 18 13:44:36.102761 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.102725    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 13:44:36.103144 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.103120    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 13:44:36.103188 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.103157    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 13:44:36.103676 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.103656    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 13:44:36.105177 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.105162    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 13:44:36.109034 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.109018    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 13:44:36.109101 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.109049    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 13:44:36.110039 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110028    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 13:44:36.110071 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110044    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 13:44:36.110071 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110051    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 13:44:36.110071 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110056    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 13:44:36.110172 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110074    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 13:44:36.110172 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110080    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 13:44:36.110172 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110094    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 13:44:36.110172 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110099    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 13:44:36.110172 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110106    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 13:44:36.110172 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110111    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 13:44:36.110172 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110125    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 13:44:36.110172 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110147    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 13:44:36.110172 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110173    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 13:44:36.110401 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.110179    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 13:44:36.113787 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.113768    2575 server.go:1268] "Started kubelet"
Sep 18 13:44:36.114038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.114006    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 13:44:36.114652 ip-10-0-136-76 systemd[1]: Started Kubernetes Kubelet.
Sep 18 13:44:36.115282 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.113918    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 13:44:36.115282 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.114748    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 13:44:36.115466 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.115292    2575 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 13:44:36.115782 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.115761    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 13:44:36.148034 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.148007    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lvz5n"
Sep 18 13:44:36.148194 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.148174    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lvz5n"
Sep 18 13:44:36.148487 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.148464    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 13:44:36.150658 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.150634    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-76.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 13:44:36.150749 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.150703    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-76.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 13:44:36.150749 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.150702    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 13:44:36.152241 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.152227    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 13:44:36.152316 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.152244    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 13:44:36.152365 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.152332    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-76.ec2.internal\" not found"
Sep 18 13:44:36.152848 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.152828    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 13:44:36.152938 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.152866    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 13:44:36.152938 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.152881    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 13:44:36.153054 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.152987    2575 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 13:44:36.153054 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.152997    2575 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 13:44:36.153165 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.153154    2575 factory.go:55] Registering systemd factory
Sep 18 13:44:36.153227 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.153169    2575 factory.go:223] Registration of the systemd container factory successfully
Sep 18 13:44:36.153227 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.152152    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-76.ec2.internal.18d66e351065295b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-76.ec2.internal,UID:ip-10-0-136-76.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-76.ec2.internal,},FirstTimestamp:2026-09-18 13:44:36.113738075 +0000 UTC m=+1.949576779,LastTimestamp:2026-09-18 13:44:36.113738075 +0000 UTC m=+1.949576779,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-76.ec2.internal,}"
Sep 18 13:44:36.153443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.153429    2575 factory.go:153] Registering CRI-O factory
Sep 18 13:44:36.153443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.153444    2575 factory.go:223] Registration of the crio container factory successfully
Sep 18 13:44:36.153569 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.153497    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 13:44:36.153569 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.153515    2575 factory.go:103] Registering Raw factory
Sep 18 13:44:36.153569 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.153531    2575 manager.go:1196] Started watching for new ooms in manager
Sep 18 13:44:36.154017 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.154000    2575 manager.go:349] Starting recovery of all containers
Sep 18 13:44:36.159854 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.159834    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:36.163362 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.163338    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-76.ec2.internal\" not found" node="ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.164392 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.164375    2575 manager.go:354] Recovery completed
Sep 18 13:44:36.168321 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.168309    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:36.170162 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.170147    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:36.170238 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.170179    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:36.170238 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.170193    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:36.170787 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.170774    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 13:44:36.170787 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.170783    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:36.170875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.170788    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 13:44:36.170875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.170807    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 13:44:36.171897 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.171883    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:36.171957 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.171908    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:36.171957 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.171919    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:36.172934 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.172923    2575 policy_none.go:49] "None policy: Start"
Sep 18 13:44:36.172971 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.172938    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 13:44:36.172971 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.172949    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 13:44:36.174913 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.174902    2575 policy_none.go:47] "Start"
Sep 18 13:44:36.215856 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.215694    2575 manager.go:337] "Starting Device Plugin manager"
Sep 18 13:44:36.232670 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.215890    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 13:44:36.232670 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.215904    2575 server.go:87] "Starting device plugin registration server"
Sep 18 13:44:36.232670 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.216173    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 13:44:36.232670 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.216196    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 13:44:36.232670 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.216286    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 13:44:36.232670 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.216366    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 13:44:36.232670 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.216374    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 13:44:36.232670 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.216951    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 13:44:36.232670 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.216991    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-76.ec2.internal\" not found"
Sep 18 13:44:36.284650 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.284615    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 13:44:36.285826 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.285804    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 13:44:36.285939 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.285866    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 13:44:36.285939 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.285897    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 13:44:36.285939 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.285937    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 13:44:36.288452 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.288432    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:36.316575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.316518    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:36.317446 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.317431    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:36.317532 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.317458    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:36.317532 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.317472    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:36.317532 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.317497    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.327798 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.327775    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.327888 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.327803    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-76.ec2.internal\": node \"ip-10-0-136-76.ec2.internal\" not found"
Sep 18 13:44:36.367988 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.367961    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-76.ec2.internal\" not found"
Sep 18 13:44:36.386173 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.386144    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-76.ec2.internal"]
Sep 18 13:44:36.386266 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.386221    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:36.387761 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.387744    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:36.387861 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.387772    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:36.387861 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.387783    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:36.390063 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.390051    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:36.390207 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.390178    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.390254 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.390212    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:36.391781 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.391763    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:36.391877 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.391794    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:36.391877 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.391809    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:36.391877 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.391816    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:36.391877 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.391839    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:36.391877 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.391853    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:36.394070 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.394050    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.394180 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.394076    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:36.394867 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.394848    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:36.394957 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.394880    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:36.394957 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.394895    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:36.419899 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.419872    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-76.ec2.internal\" not found" node="ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.424268 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.424251    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-76.ec2.internal\" not found" node="ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.455500 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.455476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e6902dcd87a37ad8d4a5d129ac419a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal\" (UID: \"6e6902dcd87a37ad8d4a5d129ac419a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.455604 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.455508    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e6902dcd87a37ad8d4a5d129ac419a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal\" (UID: \"6e6902dcd87a37ad8d4a5d129ac419a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.455604 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.455535    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9485666a2553da508936cccb36d7017e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-76.ec2.internal\" (UID: \"9485666a2553da508936cccb36d7017e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.468523 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.468503    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-76.ec2.internal\" not found"
Sep 18 13:44:36.556389 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.556359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e6902dcd87a37ad8d4a5d129ac419a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal\" (UID: \"6e6902dcd87a37ad8d4a5d129ac419a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.556389 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.556390    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e6902dcd87a37ad8d4a5d129ac419a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal\" (UID: \"6e6902dcd87a37ad8d4a5d129ac419a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.556581 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.556407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9485666a2553da508936cccb36d7017e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-76.ec2.internal\" (UID: \"9485666a2553da508936cccb36d7017e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.556581 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.556457    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9485666a2553da508936cccb36d7017e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-76.ec2.internal\" (UID: \"9485666a2553da508936cccb36d7017e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.556581 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.556472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e6902dcd87a37ad8d4a5d129ac419a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal\" (UID: \"6e6902dcd87a37ad8d4a5d129ac419a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.556581 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.556470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e6902dcd87a37ad8d4a5d129ac419a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal\" (UID: \"6e6902dcd87a37ad8d4a5d129ac419a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.569508 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.569458    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-76.ec2.internal\" not found"
Sep 18 13:44:36.670203 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.670176    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-76.ec2.internal\" not found"
Sep 18 13:44:36.724383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.724347    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.728283 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:36.728265    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:36.771177 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.771150    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-76.ec2.internal\" not found"
Sep 18 13:44:36.871703 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.871623    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-76.ec2.internal\" not found"
Sep 18 13:44:36.972189 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:36.972164    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-76.ec2.internal\" not found"
Sep 18 13:44:37.072663 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:37.072637    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-76.ec2.internal\" not found"
Sep 18 13:44:37.075821 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.075792    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 13:44:37.075968 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.075943    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 13:44:37.076015 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.075956    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 13:44:37.114345 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.114318    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:37.152632 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.152558    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:37.152632 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.152572    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 13:44:37.153851 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.153824    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 13:39:36 +0000 UTC" deadline="2028-06-08 02:47:13.53611671 +0000 UTC"
Sep 18 13:44:37.153903 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.153851    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15085h2m36.382268014s"
Sep 18 13:44:37.166555 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.166524    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 13:44:37.168168 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.168153    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-76.ec2.internal"
Sep 18 13:44:37.168702 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.168686    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 13:44:37.175267 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.175250    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 13:44:37.190387 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.190363    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d4rdt"
Sep 18 13:44:37.199282 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.199265    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d4rdt"
Sep 18 13:44:37.498905 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:37.498856    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9485666a2553da508936cccb36d7017e.slice/crio-eb79d10210feaaa5e80b3a86913a87bebd3d56b73a4ecc6c35ace290335dddff WatchSource:0}: Error finding container eb79d10210feaaa5e80b3a86913a87bebd3d56b73a4ecc6c35ace290335dddff: Status 404 returned error can't find the container with id eb79d10210feaaa5e80b3a86913a87bebd3d56b73a4ecc6c35ace290335dddff
Sep 18 13:44:37.499288 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:37.499260    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6902dcd87a37ad8d4a5d129ac419a5.slice/crio-374b07f8de338e7a0c7888dd78a70d1faca470852ae91faf28e9dc5e3c5efb5a WatchSource:0}: Error finding container 374b07f8de338e7a0c7888dd78a70d1faca470852ae91faf28e9dc5e3c5efb5a: Status 404 returned error can't find the container with id 374b07f8de338e7a0c7888dd78a70d1faca470852ae91faf28e9dc5e3c5efb5a
Sep 18 13:44:37.504605 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.504586    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:44:37.654048 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:37.654015    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:38.104745 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.104691    2575 apiserver.go:52] "Watching apiserver"
Sep 18 13:44:38.113180 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.113150    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 13:44:38.113571 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.113537    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-76.ec2.internal","openshift-multus/multus-additional-cni-plugins-fcdls","openshift-network-diagnostics/network-check-target-5tmw4","openshift-network-operator/iptables-alerter-v7hzv","openshift-ovn-kubernetes/ovnkube-node-qssl2","kube-system/konnectivity-agent-8zn42","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh","openshift-cluster-node-tuning-operator/tuned-9r7tb","openshift-dns/node-resolver-cxdkt","openshift-image-registry/node-ca-bkvl8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal","openshift-multus/multus-94xfb","openshift-multus/network-metrics-daemon-pp58f","kube-system/global-pull-secret-syncer-4jndn"]
Sep 18 13:44:38.116317 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.116119    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.120063 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.119263    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-swhqc\""
Sep 18 13:44:38.120063 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.119459    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 13:44:38.120063 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.119688    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 13:44:38.120063 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.119830    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 13:44:38.126945 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.122685    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:38.126945 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.122776    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:44:38.129074 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.128948    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:38.129074 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.129033    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:44:38.132782 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.131955    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v7hzv"
Sep 18 13:44:38.135386 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.134700    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.135386 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.135107    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 13:44:38.135386 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.135282    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-flpdq\""
Sep 18 13:44:38.135386 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.135370    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 13:44:38.135712 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.135687    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:44:38.137281 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.137223    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:44:38.138604 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.138074    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 13:44:38.138604 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.138123    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 13:44:38.138604 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.138332    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 13:44:38.138604 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.138340    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 13:44:38.138604 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.138590    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 13:44:38.139680 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.139376    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zzjhx\""
Sep 18 13:44:38.139680 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.139593    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 13:44:38.139680 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.139658    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cxdkt"
Sep 18 13:44:38.140254 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.140235    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 13:44:38.140448 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.140432    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4wv82\""
Sep 18 13:44:38.140780 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.140763    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 13:44:38.142096 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.142075    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:38.142211 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.142188    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:44:38.143163 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.142672    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xl4df\""
Sep 18 13:44:38.143163 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.142824    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 13:44:38.143163 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.142977    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 13:44:38.144120 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.144099    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.146402 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.146381    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 13:44:38.146817 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.146799    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hhjxb\""
Sep 18 13:44:38.147811 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.147187    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bkvl8"
Sep 18 13:44:38.147811 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.147350    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 13:44:38.147811 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.147652    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 13:44:38.147811 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.147758    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 13:44:38.147811 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.147788    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 13:44:38.149373 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.149010    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.149767 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.149742    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 13:44:38.149861 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.149793    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 13:44:38.150018 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.149998    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 13:44:38.150115 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.150104    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hwjhn\""
Sep 18 13:44:38.151508 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.151488    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.152051 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.152029    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:44:38.152259 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.152241    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 13:44:38.152335 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.152282    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pj9t4\""
Sep 18 13:44:38.154350 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.154054    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 13:44:38.154350 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.154327    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 13:44:38.154350 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.154347    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jc4bs\""
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd112042-77f9-4d45-a8b6-6e83b91c2bb3-tmp-dir\") pod \"node-resolver-cxdkt\" (UID: \"fd112042-77f9-4d45-a8b6-6e83b91c2bb3\") " pod="openshift-dns/node-resolver-cxdkt"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbgdf\" (UniqueName: \"kubernetes.io/projected/fd112042-77f9-4d45-a8b6-6e83b91c2bb3-kube-api-access-qbgdf\") pod \"node-resolver-cxdkt\" (UID: \"fd112042-77f9-4d45-a8b6-6e83b91c2bb3\") " pod="openshift-dns/node-resolver-cxdkt"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-kubernetes\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-sysctl-d\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165561    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-systemd\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1b6473d-cfa1-4894-a473-6d83bb810cab-kubelet-config\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1b6473d-cfa1-4894-a473-6d83bb810cab-dbus\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-cni-binary-copy\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-socket-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-etc-kubernetes\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97a92fc9-26f8-4450-8f50-88330c550257-iptables-alerter-script\") pod \"iptables-alerter-v7hzv\" (UID: \"97a92fc9-26f8-4450-8f50-88330c550257\") " pod="openshift-network-operator/iptables-alerter-v7hzv"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165776    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-host\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165822    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-var-lib-openvswitch\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz4mm\" (UniqueName: \"kubernetes.io/projected/fcd2b632-1411-45f7-b108-13d885d68910-kube-api-access-vz4mm\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.166916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165907    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-var-lib-kubelet\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-log-socket\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.165974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-system-cni-dir\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcd2b632-1411-45f7-b108-13d885d68910-cni-binary-copy\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-run-ovn-kubernetes\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94bd071d-9824-45bf-b051-503e6b8d7743-ovnkube-config\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtk5b\" (UniqueName: \"kubernetes.io/projected/94bd071d-9824-45bf-b051-503e6b8d7743-kube-api-access-wtk5b\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166160    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-sys-fs\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-slash\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166249    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94bd071d-9824-45bf-b051-503e6b8d7743-ovn-node-metrics-cert\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166282    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls7kw\" (UniqueName: \"kubernetes.io/projected/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-kube-api-access-ls7kw\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-var-lib-cni-bin\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166373    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t86sw\" (UniqueName: \"kubernetes.io/projected/904528e0-ab8e-449a-9c7f-87884bbf5829-kube-api-access-t86sw\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166403    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-run\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.167809 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-cnibin\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-cnibin\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-var-lib-kubelet\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166501    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-etc-openvswitch\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-cni-netd\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97a92fc9-26f8-4450-8f50-88330c550257-host-slash\") pod \"iptables-alerter-v7hzv\" (UID: \"97a92fc9-26f8-4450-8f50-88330c550257\") " pod="openshift-network-operator/iptables-alerter-v7hzv"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9ktx\" (UniqueName: \"kubernetes.io/projected/97a92fc9-26f8-4450-8f50-88330c550257-kube-api-access-f9ktx\") pod \"iptables-alerter-v7hzv\" (UID: \"97a92fc9-26f8-4450-8f50-88330c550257\") " pod="openshift-network-operator/iptables-alerter-v7hzv"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166711    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76k2t\" (UniqueName: \"kubernetes.io/projected/fc9e1723-2aa9-424d-a2e1-33af09eb8e32-kube-api-access-76k2t\") pod \"node-ca-bkvl8\" (UID: \"fc9e1723-2aa9-424d-a2e1-33af09eb8e32\") " pod="openshift-image-registry/node-ca-bkvl8"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-tmp\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz6ql\" (UniqueName: \"kubernetes.io/projected/f6ef7168-1b39-4e49-8a76-5367e8067cd9-kube-api-access-pz6ql\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqkh2\" (UniqueName: \"kubernetes.io/projected/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-kube-api-access-tqkh2\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-node-log\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94bd071d-9824-45bf-b051-503e6b8d7743-env-overrides\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-run-netns\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-run-systemd\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.168863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-multus-cni-dir\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.166967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-run-k8s-cni-cncf-io\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-var-lib-cni-multus\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-sys\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-tuned\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167093    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-system-cni-dir\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-multus-socket-dir-parent\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd112042-77f9-4d45-a8b6-6e83b91c2bb3-hosts-file\") pod \"node-resolver-cxdkt\" (UID: \"fd112042-77f9-4d45-a8b6-6e83b91c2bb3\") " pod="openshift-dns/node-resolver-cxdkt"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc9e1723-2aa9-424d-a2e1-33af09eb8e32-host\") pod \"node-ca-bkvl8\" (UID: \"fc9e1723-2aa9-424d-a2e1-33af09eb8e32\") " pod="openshift-image-registry/node-ca-bkvl8"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-sysconfig\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-run-netns\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcd2b632-1411-45f7-b108-13d885d68910-multus-daemon-config\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-run-multus-certs\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167428    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9396c3f0-550f-44f2-b331-dd4cfab9db06-konnectivity-ca\") pod \"konnectivity-agent-8zn42\" (UID: \"9396c3f0-550f-44f2-b331-dd4cfab9db06\") " pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-cni-bin\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.169653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-registration-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167547    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9396c3f0-550f-44f2-b331-dd4cfab9db06-agent-certs\") pod \"konnectivity-agent-8zn42\" (UID: \"9396c3f0-550f-44f2-b331-dd4cfab9db06\") " pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-lib-modules\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-etc-selinux\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-kubelet\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167652    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-device-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-modprobe-d\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-sysctl-conf\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llwtv\" (UniqueName: \"kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv\") pod \"network-check-target-5tmw4\" (UID: \"bff89b94-742d-4151-92cd-3d7b83282fb7\") " pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-systemd-units\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94bd071d-9824-45bf-b051-503e6b8d7743-ovnkube-script-lib\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-hostroot\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-run-openvswitch\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-run-ovn\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.167974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc9e1723-2aa9-424d-a2e1-33af09eb8e32-serviceca\") pod \"node-ca-bkvl8\" (UID: \"fc9e1723-2aa9-424d-a2e1-33af09eb8e32\") " pod="openshift-image-registry/node-ca-bkvl8"
Sep 18 13:44:38.170566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.168000    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-multus-conf-dir\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.202564 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.202455    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:39:37 +0000 UTC" deadline="2028-03-27 01:30:18.887644768 +0000 UTC"
Sep 18 13:44:38.202564 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.202510    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13331h45m40.685139004s"
Sep 18 13:44:38.244832 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.244807    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:38.268386 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd112042-77f9-4d45-a8b6-6e83b91c2bb3-tmp-dir\") pod \"node-resolver-cxdkt\" (UID: \"fd112042-77f9-4d45-a8b6-6e83b91c2bb3\") " pod="openshift-dns/node-resolver-cxdkt"
Sep 18 13:44:38.268562 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbgdf\" (UniqueName: \"kubernetes.io/projected/fd112042-77f9-4d45-a8b6-6e83b91c2bb3-kube-api-access-qbgdf\") pod \"node-resolver-cxdkt\" (UID: \"fd112042-77f9-4d45-a8b6-6e83b91c2bb3\") " pod="openshift-dns/node-resolver-cxdkt"
Sep 18 13:44:38.268562 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-kubernetes\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.268562 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-sysctl-d\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.268562 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-systemd\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.268562 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1b6473d-cfa1-4894-a473-6d83bb810cab-kubelet-config\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:38.268562 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1b6473d-cfa1-4894-a473-6d83bb810cab-dbus\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:38.268562 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268527    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-kubernetes\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.268562 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-cni-binary-copy\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268570    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-systemd\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268610    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1b6473d-cfa1-4894-a473-6d83bb810cab-kubelet-config\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268610    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-sysctl-d\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-socket-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268720    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1b6473d-cfa1-4894-a473-6d83bb810cab-dbus\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-etc-kubernetes\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97a92fc9-26f8-4450-8f50-88330c550257-iptables-alerter-script\") pod \"iptables-alerter-v7hzv\" (UID: \"97a92fc9-26f8-4450-8f50-88330c550257\") " pod="openshift-network-operator/iptables-alerter-v7hzv"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268796    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-host\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-var-lib-openvswitch\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268829    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-etc-kubernetes\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268845    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz4mm\" (UniqueName: \"kubernetes.io/projected/fcd2b632-1411-45f7-b108-13d885d68910-kube-api-access-vz4mm\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268913    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd112042-77f9-4d45-a8b6-6e83b91c2bb3-tmp-dir\") pod \"node-resolver-cxdkt\" (UID: \"fd112042-77f9-4d45-a8b6-6e83b91c2bb3\") " pod="openshift-dns/node-resolver-cxdkt"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268916    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-var-lib-kubelet\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-log-socket\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.268964 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-system-cni-dir\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268993    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-var-lib-kubelet\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcd2b632-1411-45f7-b108-13d885d68910-cni-binary-copy\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269019    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-run-ovn-kubernetes\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94bd071d-9824-45bf-b051-503e6b8d7743-ovnkube-config\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269054    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-system-cni-dir\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269064    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-host\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269066    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtk5b\" (UniqueName: \"kubernetes.io/projected/94bd071d-9824-45bf-b051-503e6b8d7743-kube-api-access-wtk5b\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269106    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-run-ovn-kubernetes\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.268820    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-socket-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269156    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-cni-binary-copy\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.269234    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-sys-fs\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-sys-fs\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.269733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269275    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-slash\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-var-lib-openvswitch\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.269319    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret podName:d1b6473d-cfa1-4894-a473-6d83bb810cab nodeName:}" failed. No retries permitted until 2026-09-18 13:44:38.769278777 +0000 UTC m=+4.605117485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret") pod "global-pull-secret-syncer-4jndn" (UID: "d1b6473d-cfa1-4894-a473-6d83bb810cab") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269320    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97a92fc9-26f8-4450-8f50-88330c550257-iptables-alerter-script\") pod \"iptables-alerter-v7hzv\" (UID: \"97a92fc9-26f8-4450-8f50-88330c550257\") " pod="openshift-network-operator/iptables-alerter-v7hzv"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-log-socket\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269319    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-slash\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94bd071d-9824-45bf-b051-503e6b8d7743-ovn-node-metrics-cert\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls7kw\" (UniqueName: \"kubernetes.io/projected/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-kube-api-access-ls7kw\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-var-lib-cni-bin\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t86sw\" (UniqueName: \"kubernetes.io/projected/904528e0-ab8e-449a-9c7f-87884bbf5829-kube-api-access-t86sw\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269468    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-run\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-cnibin\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-cnibin\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-var-lib-cni-bin\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-var-lib-kubelet\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-etc-openvswitch\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-cni-netd\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.270495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-run\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269629    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-cnibin\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-var-lib-kubelet\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269679    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-cnibin\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269689    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcd2b632-1411-45f7-b108-13d885d68910-cni-binary-copy\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-etc-openvswitch\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-cni-netd\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269708    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269774    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97a92fc9-26f8-4450-8f50-88330c550257-host-slash\") pod \"iptables-alerter-v7hzv\" (UID: \"97a92fc9-26f8-4450-8f50-88330c550257\") " pod="openshift-network-operator/iptables-alerter-v7hzv"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269821    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94bd071d-9824-45bf-b051-503e6b8d7743-ovnkube-config\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269844    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97a92fc9-26f8-4450-8f50-88330c550257-host-slash\") pod \"iptables-alerter-v7hzv\" (UID: \"97a92fc9-26f8-4450-8f50-88330c550257\") " pod="openshift-network-operator/iptables-alerter-v7hzv"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269913    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9ktx\" (UniqueName: \"kubernetes.io/projected/97a92fc9-26f8-4450-8f50-88330c550257-kube-api-access-f9ktx\") pod \"iptables-alerter-v7hzv\" (UID: \"97a92fc9-26f8-4450-8f50-88330c550257\") " pod="openshift-network-operator/iptables-alerter-v7hzv"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76k2t\" (UniqueName: \"kubernetes.io/projected/fc9e1723-2aa9-424d-a2e1-33af09eb8e32-kube-api-access-76k2t\") pod \"node-ca-bkvl8\" (UID: \"fc9e1723-2aa9-424d-a2e1-33af09eb8e32\") " pod="openshift-image-registry/node-ca-bkvl8"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269970    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-tmp\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.269994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz6ql\" (UniqueName: \"kubernetes.io/projected/f6ef7168-1b39-4e49-8a76-5367e8067cd9-kube-api-access-pz6ql\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqkh2\" (UniqueName: \"kubernetes.io/projected/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-kube-api-access-tqkh2\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.271330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-node-log\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94bd071d-9824-45bf-b051-503e6b8d7743-env-overrides\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270098    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-run-netns\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270121    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-run-systemd\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270155    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270160    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-multus-cni-dir\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-node-log\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-run-k8s-cni-cncf-io\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270249    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-run-k8s-cni-cncf-io\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-multus-cni-dir\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-run-netns\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270454    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-run-systemd\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-var-lib-cni-multus\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-sys\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270606    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94bd071d-9824-45bf-b051-503e6b8d7743-env-overrides\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270622    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-var-lib-cni-multus\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270674    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-sys\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270611    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-tuned\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.272164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-system-cni-dir\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270776    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-multus-socket-dir-parent\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270802    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd112042-77f9-4d45-a8b6-6e83b91c2bb3-hosts-file\") pod \"node-resolver-cxdkt\" (UID: \"fd112042-77f9-4d45-a8b6-6e83b91c2bb3\") " pod="openshift-dns/node-resolver-cxdkt"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc9e1723-2aa9-424d-a2e1-33af09eb8e32-host\") pod \"node-ca-bkvl8\" (UID: \"fc9e1723-2aa9-424d-a2e1-33af09eb8e32\") " pod="openshift-image-registry/node-ca-bkvl8"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-sysconfig\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270881    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-run-netns\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-system-cni-dir\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcd2b632-1411-45f7-b108-13d885d68910-multus-daemon-config\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270932    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc9e1723-2aa9-424d-a2e1-33af09eb8e32-host\") pod \"node-ca-bkvl8\" (UID: \"fc9e1723-2aa9-424d-a2e1-33af09eb8e32\") " pod="openshift-image-registry/node-ca-bkvl8"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-run-multus-certs\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9396c3f0-550f-44f2-b331-dd4cfab9db06-konnectivity-ca\") pod \"konnectivity-agent-8zn42\" (UID: \"9396c3f0-550f-44f2-b331-dd4cfab9db06\") " pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.270963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd112042-77f9-4d45-a8b6-6e83b91c2bb3-hosts-file\") pod \"node-resolver-cxdkt\" (UID: \"fd112042-77f9-4d45-a8b6-6e83b91c2bb3\") " pod="openshift-dns/node-resolver-cxdkt"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271041    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-multus-socket-dir-parent\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271050    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-run-netns\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-cni-bin\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-host-run-multus-certs\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.273011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-sysconfig\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271198    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-cni-bin\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-registration-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271280    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9396c3f0-550f-44f2-b331-dd4cfab9db06-agent-certs\") pod \"konnectivity-agent-8zn42\" (UID: \"9396c3f0-550f-44f2-b331-dd4cfab9db06\") " pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-lib-modules\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271339    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271350    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-etc-selinux\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-kubelet\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-device-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-modprobe-d\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271431    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcd2b632-1411-45f7-b108-13d885d68910-multus-daemon-config\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-sysctl-conf\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-etc-selinux\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-registration-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwtv\" (UniqueName: \"kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv\") pod \"network-check-target-5tmw4\" (UID: \"bff89b94-742d-4151-92cd-3d7b83282fb7\") " pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:38.273844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-systemd-units\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94bd071d-9824-45bf-b051-503e6b8d7743-ovnkube-script-lib\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-hostroot\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-host-kubelet\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-run-openvswitch\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9396c3f0-550f-44f2-b331-dd4cfab9db06-konnectivity-ca\") pod \"konnectivity-agent-8zn42\" (UID: \"9396c3f0-550f-44f2-b331-dd4cfab9db06\") " pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271701    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-run-ovn\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.271725    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.271770    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs podName:f6ef7168-1b39-4e49-8a76-5367e8067cd9 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:38.771753966 +0000 UTC m=+4.607592657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs") pod "network-metrics-daemon-pp58f" (UID: "f6ef7168-1b39-4e49-8a76-5367e8067cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271781    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-modprobe-d\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/904528e0-ab8e-449a-9c7f-87884bbf5829-device-dir\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271872    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-run-openvswitch\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271907    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-hostroot\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271942    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-run-ovn\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-lib-modules\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.271725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc9e1723-2aa9-424d-a2e1-33af09eb8e32-serviceca\") pod \"node-ca-bkvl8\" (UID: \"fc9e1723-2aa9-424d-a2e1-33af09eb8e32\") " pod="openshift-image-registry/node-ca-bkvl8"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.272003    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94bd071d-9824-45bf-b051-503e6b8d7743-systemd-units\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.272005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-multus-conf-dir\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.274655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.272040    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcd2b632-1411-45f7-b108-13d885d68910-multus-conf-dir\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.275513 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.272109    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc9e1723-2aa9-424d-a2e1-33af09eb8e32-serviceca\") pod \"node-ca-bkvl8\" (UID: \"fc9e1723-2aa9-424d-a2e1-33af09eb8e32\") " pod="openshift-image-registry/node-ca-bkvl8"
Sep 18 13:44:38.275513 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.272166    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-sysctl-conf\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.275513 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.272558    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94bd071d-9824-45bf-b051-503e6b8d7743-ovnkube-script-lib\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.275513 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.274427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-etc-tuned\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.275513 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.274503    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9396c3f0-550f-44f2-b331-dd4cfab9db06-agent-certs\") pod \"konnectivity-agent-8zn42\" (UID: \"9396c3f0-550f-44f2-b331-dd4cfab9db06\") " pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:44:38.275713 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.275594    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94bd071d-9824-45bf-b051-503e6b8d7743-ovn-node-metrics-cert\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.278077 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.278048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-tmp\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.280700 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.280406    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:38.280700 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.280430    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:38.280700 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.280444    2575 projected.go:196] Error preparing data for projected volume kube-api-access-llwtv for pod openshift-network-diagnostics/network-check-target-5tmw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:38.280700 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.280512    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv podName:bff89b94-742d-4151-92cd-3d7b83282fb7 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:38.78049381 +0000 UTC m=+4.616332521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-llwtv" (UniqueName: "kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv") pod "network-check-target-5tmw4" (UID: "bff89b94-742d-4151-92cd-3d7b83282fb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:38.280700 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.280528    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtk5b\" (UniqueName: \"kubernetes.io/projected/94bd071d-9824-45bf-b051-503e6b8d7743-kube-api-access-wtk5b\") pod \"ovnkube-node-qssl2\" (UID: \"94bd071d-9824-45bf-b051-503e6b8d7743\") " pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.280700 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.280553    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t86sw\" (UniqueName: \"kubernetes.io/projected/904528e0-ab8e-449a-9c7f-87884bbf5829-kube-api-access-t86sw\") pod \"aws-ebs-csi-driver-node-zb7dh\" (UID: \"904528e0-ab8e-449a-9c7f-87884bbf5829\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.280700 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.280662    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz6ql\" (UniqueName: \"kubernetes.io/projected/f6ef7168-1b39-4e49-8a76-5367e8067cd9-kube-api-access-pz6ql\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:38.283221 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.283177    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz4mm\" (UniqueName: \"kubernetes.io/projected/fcd2b632-1411-45f7-b108-13d885d68910-kube-api-access-vz4mm\") pod \"multus-94xfb\" (UID: \"fcd2b632-1411-45f7-b108-13d885d68910\") " pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.283312 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.283239    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqkh2\" (UniqueName: \"kubernetes.io/projected/f1d5dbf1-48bc-48cb-ae34-c08c64df818e-kube-api-access-tqkh2\") pod \"tuned-9r7tb\" (UID: \"f1d5dbf1-48bc-48cb-ae34-c08c64df818e\") " pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.283456 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.283437    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76k2t\" (UniqueName: \"kubernetes.io/projected/fc9e1723-2aa9-424d-a2e1-33af09eb8e32-kube-api-access-76k2t\") pod \"node-ca-bkvl8\" (UID: \"fc9e1723-2aa9-424d-a2e1-33af09eb8e32\") " pod="openshift-image-registry/node-ca-bkvl8"
Sep 18 13:44:38.283520 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.283442    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9ktx\" (UniqueName: \"kubernetes.io/projected/97a92fc9-26f8-4450-8f50-88330c550257-kube-api-access-f9ktx\") pod \"iptables-alerter-v7hzv\" (UID: \"97a92fc9-26f8-4450-8f50-88330c550257\") " pod="openshift-network-operator/iptables-alerter-v7hzv"
Sep 18 13:44:38.283656 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.283632    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls7kw\" (UniqueName: \"kubernetes.io/projected/82adfcd0-c5e4-4bfd-b693-04fa2b6b4929-kube-api-access-ls7kw\") pod \"multus-additional-cni-plugins-fcdls\" (UID: \"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929\") " pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.284020 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.283999    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbgdf\" (UniqueName: \"kubernetes.io/projected/fd112042-77f9-4d45-a8b6-6e83b91c2bb3-kube-api-access-qbgdf\") pod \"node-resolver-cxdkt\" (UID: \"fd112042-77f9-4d45-a8b6-6e83b91c2bb3\") " pod="openshift-dns/node-resolver-cxdkt"
Sep 18 13:44:38.292144 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.292079    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal" event={"ID":"6e6902dcd87a37ad8d4a5d129ac419a5","Type":"ContainerStarted","Data":"374b07f8de338e7a0c7888dd78a70d1faca470852ae91faf28e9dc5e3c5efb5a"}
Sep 18 13:44:38.293594 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.293569    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-76.ec2.internal" event={"ID":"9485666a2553da508936cccb36d7017e","Type":"ContainerStarted","Data":"eb79d10210feaaa5e80b3a86913a87bebd3d56b73a4ecc6c35ace290335dddff"}
Sep 18 13:44:38.437440 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.437361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh"
Sep 18 13:44:38.449390 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.449362    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v7hzv"
Sep 18 13:44:38.458430 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.458408    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:44:38.469155 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.469122    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:44:38.477860 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.477841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cxdkt"
Sep 18 13:44:38.490537 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.490517    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fcdls"
Sep 18 13:44:38.498219 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.498199    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bkvl8"
Sep 18 13:44:38.509171 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.509150    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9r7tb"
Sep 18 13:44:38.512669 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.512651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-94xfb"
Sep 18 13:44:38.638857 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.638823    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:38.776032 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.775940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:38.776231 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.776032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:38.776231 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.776145    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:38.776231 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.776170    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:38.776231 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.776231    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs podName:f6ef7168-1b39-4e49-8a76-5367e8067cd9 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:39.77620923 +0000 UTC m=+5.612047936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs") pod "network-metrics-daemon-pp58f" (UID: "f6ef7168-1b39-4e49-8a76-5367e8067cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:38.776385 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.776251    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret podName:d1b6473d-cfa1-4894-a473-6d83bb810cab nodeName:}" failed. No retries permitted until 2026-09-18 13:44:39.776242226 +0000 UTC m=+5.612080920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret") pod "global-pull-secret-syncer-4jndn" (UID: "d1b6473d-cfa1-4894-a473-6d83bb810cab") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:38.876715 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:38.876667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwtv\" (UniqueName: \"kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv\") pod \"network-check-target-5tmw4\" (UID: \"bff89b94-742d-4151-92cd-3d7b83282fb7\") " pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:38.876871 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.876821    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:38.876871 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.876841    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:38.876871 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.876854    2575 projected.go:196] Error preparing data for projected volume kube-api-access-llwtv for pod openshift-network-diagnostics/network-check-target-5tmw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:38.876974 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:38.876916    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv podName:bff89b94-742d-4151-92cd-3d7b83282fb7 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:39.876901436 +0000 UTC m=+5.712740147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-llwtv" (UniqueName: "kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv") pod "network-check-target-5tmw4" (UID: "bff89b94-742d-4151-92cd-3d7b83282fb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:39.203372 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:39.203266    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:39:37 +0000 UTC" deadline="2028-06-06 23:30:15.163544754 +0000 UTC"
Sep 18 13:44:39.203372 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:39.203318    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15057h45m35.960231267s"
Sep 18 13:44:39.287184 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:39.287149    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:39.287350 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:39.287281    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:44:39.348272 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:39.348245    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82adfcd0_c5e4_4bfd_b693_04fa2b6b4929.slice/crio-f645534813cb20b90acebaf88c3e4cbab7dc46647be5cc03ad6ed05e8b48ab42 WatchSource:0}: Error finding container f645534813cb20b90acebaf88c3e4cbab7dc46647be5cc03ad6ed05e8b48ab42: Status 404 returned error can't find the container with id f645534813cb20b90acebaf88c3e4cbab7dc46647be5cc03ad6ed05e8b48ab42
Sep 18 13:44:39.351670 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:39.351478    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9e1723_2aa9_424d_a2e1_33af09eb8e32.slice/crio-77a2684db10e76819b1223ddde0a016c59c275bbc309915b5388417637dcba3b WatchSource:0}: Error finding container 77a2684db10e76819b1223ddde0a016c59c275bbc309915b5388417637dcba3b: Status 404 returned error can't find the container with id 77a2684db10e76819b1223ddde0a016c59c275bbc309915b5388417637dcba3b
Sep 18 13:44:39.354456 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:39.354348    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d5dbf1_48bc_48cb_ae34_c08c64df818e.slice/crio-b57c4847eb65ab25f26afe7c3337e84f003bfe4358d1722afd5513f407166870 WatchSource:0}: Error finding container b57c4847eb65ab25f26afe7c3337e84f003bfe4358d1722afd5513f407166870: Status 404 returned error can't find the container with id b57c4847eb65ab25f26afe7c3337e84f003bfe4358d1722afd5513f407166870
Sep 18 13:44:39.355766 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:39.355741    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd2b632_1411_45f7_b108_13d885d68910.slice/crio-27bc1babdb027b0bcb29f1f04fb70a22803774215bf484d3bcf2b9a2b4648393 WatchSource:0}: Error finding container 27bc1babdb027b0bcb29f1f04fb70a22803774215bf484d3bcf2b9a2b4648393: Status 404 returned error can't find the container with id 27bc1babdb027b0bcb29f1f04fb70a22803774215bf484d3bcf2b9a2b4648393
Sep 18 13:44:39.357052 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:39.357002    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd112042_77f9_4d45_a8b6_6e83b91c2bb3.slice/crio-2fcab899ed545f82e0c8945e2d11a861003b78bca35504ced8f3d130ad20676a WatchSource:0}: Error finding container 2fcab899ed545f82e0c8945e2d11a861003b78bca35504ced8f3d130ad20676a: Status 404 returned error can't find the container with id 2fcab899ed545f82e0c8945e2d11a861003b78bca35504ced8f3d130ad20676a
Sep 18 13:44:39.357366 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:39.357343    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9396c3f0_550f_44f2_b331_dd4cfab9db06.slice/crio-df17c768ec60e492e001bc13a69e1600c1acd0444295d1373db221c9ce6e10d6 WatchSource:0}: Error finding container df17c768ec60e492e001bc13a69e1600c1acd0444295d1373db221c9ce6e10d6: Status 404 returned error can't find the container with id df17c768ec60e492e001bc13a69e1600c1acd0444295d1373db221c9ce6e10d6
Sep 18 13:44:39.359215 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:39.359192    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94bd071d_9824_45bf_b051_503e6b8d7743.slice/crio-905d0deab5a196b6679c0badeb3e70228e506b699403d8c06bc81af9b711dad0 WatchSource:0}: Error finding container 905d0deab5a196b6679c0badeb3e70228e506b699403d8c06bc81af9b711dad0: Status 404 returned error can't find the container with id 905d0deab5a196b6679c0badeb3e70228e506b699403d8c06bc81af9b711dad0
Sep 18 13:44:39.360832 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:39.360807    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a92fc9_26f8_4450_8f50_88330c550257.slice/crio-202d83187ef72f3c5c3ca6ad05d516a5653c660242fb650c3f1d08f1b8add864 WatchSource:0}: Error finding container 202d83187ef72f3c5c3ca6ad05d516a5653c660242fb650c3f1d08f1b8add864: Status 404 returned error can't find the container with id 202d83187ef72f3c5c3ca6ad05d516a5653c660242fb650c3f1d08f1b8add864
Sep 18 13:44:39.384269 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:44:39.384245    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904528e0_ab8e_449a_9c7f_87884bbf5829.slice/crio-d0bfca9a92a62bb65b4554ddeec63056cd715601524681e39dfce0cc00c3807a WatchSource:0}: Error finding container d0bfca9a92a62bb65b4554ddeec63056cd715601524681e39dfce0cc00c3807a: Status 404 returned error can't find the container with id d0bfca9a92a62bb65b4554ddeec63056cd715601524681e39dfce0cc00c3807a
Sep 18 13:44:39.784305 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:39.784215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:39.784461 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:39.784304    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:39.784461 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:39.784388    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:39.784461 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:39.784424    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:39.784623 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:39.784463    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs podName:f6ef7168-1b39-4e49-8a76-5367e8067cd9 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:41.784442647 +0000 UTC m=+7.620281343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs") pod "network-metrics-daemon-pp58f" (UID: "f6ef7168-1b39-4e49-8a76-5367e8067cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:39.784623 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:39.784485    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret podName:d1b6473d-cfa1-4894-a473-6d83bb810cab nodeName:}" failed. No retries permitted until 2026-09-18 13:44:41.784475751 +0000 UTC m=+7.620314446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret") pod "global-pull-secret-syncer-4jndn" (UID: "d1b6473d-cfa1-4894-a473-6d83bb810cab") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:39.884696 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:39.884660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwtv\" (UniqueName: \"kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv\") pod \"network-check-target-5tmw4\" (UID: \"bff89b94-742d-4151-92cd-3d7b83282fb7\") " pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:39.884923 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:39.884841    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:39.884923 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:39.884869    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:39.884923 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:39.884881    2575 projected.go:196] Error preparing data for projected volume kube-api-access-llwtv for pod openshift-network-diagnostics/network-check-target-5tmw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:39.885082 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:39.884939    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv podName:bff89b94-742d-4151-92cd-3d7b83282fb7 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:41.884921095 +0000 UTC m=+7.720759786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-llwtv" (UniqueName: "kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv") pod "network-check-target-5tmw4" (UID: "bff89b94-742d-4151-92cd-3d7b83282fb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:40.287379 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.287260    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:40.287937 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:40.287402    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:44:40.289573 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.289537    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:40.289677 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:40.289634    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:44:40.310247 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.310217    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh" event={"ID":"904528e0-ab8e-449a-9c7f-87884bbf5829","Type":"ContainerStarted","Data":"d0bfca9a92a62bb65b4554ddeec63056cd715601524681e39dfce0cc00c3807a"}
Sep 18 13:44:40.337464 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.337431    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8zn42" event={"ID":"9396c3f0-550f-44f2-b331-dd4cfab9db06","Type":"ContainerStarted","Data":"df17c768ec60e492e001bc13a69e1600c1acd0444295d1373db221c9ce6e10d6"}
Sep 18 13:44:40.342718 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.342692    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cxdkt" event={"ID":"fd112042-77f9-4d45-a8b6-6e83b91c2bb3","Type":"ContainerStarted","Data":"2fcab899ed545f82e0c8945e2d11a861003b78bca35504ced8f3d130ad20676a"}
Sep 18 13:44:40.351155 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.351112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9r7tb" event={"ID":"f1d5dbf1-48bc-48cb-ae34-c08c64df818e","Type":"ContainerStarted","Data":"b57c4847eb65ab25f26afe7c3337e84f003bfe4358d1722afd5513f407166870"}
Sep 18 13:44:40.360290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.360263    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcdls" event={"ID":"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929","Type":"ContainerStarted","Data":"f645534813cb20b90acebaf88c3e4cbab7dc46647be5cc03ad6ed05e8b48ab42"}
Sep 18 13:44:40.391706 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.390932    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v7hzv" event={"ID":"97a92fc9-26f8-4450-8f50-88330c550257","Type":"ContainerStarted","Data":"202d83187ef72f3c5c3ca6ad05d516a5653c660242fb650c3f1d08f1b8add864"}
Sep 18 13:44:40.394394 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.394366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2" event={"ID":"94bd071d-9824-45bf-b051-503e6b8d7743","Type":"ContainerStarted","Data":"905d0deab5a196b6679c0badeb3e70228e506b699403d8c06bc81af9b711dad0"}
Sep 18 13:44:40.405541 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.405514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-94xfb" event={"ID":"fcd2b632-1411-45f7-b108-13d885d68910","Type":"ContainerStarted","Data":"27bc1babdb027b0bcb29f1f04fb70a22803774215bf484d3bcf2b9a2b4648393"}
Sep 18 13:44:40.420228 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.420205    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bkvl8" event={"ID":"fc9e1723-2aa9-424d-a2e1-33af09eb8e32","Type":"ContainerStarted","Data":"77a2684db10e76819b1223ddde0a016c59c275bbc309915b5388417637dcba3b"}
Sep 18 13:44:40.426518 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.425566    2575 generic.go:356] "Generic (PLEG): container finished" podID="6e6902dcd87a37ad8d4a5d129ac419a5" containerID="9ec7b3f55d5f3b865dea7f0ce86b7e4820095d3544db5d0a700a07034d26648d" exitCode=0
Sep 18 13:44:40.426518 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.425645    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal" event={"ID":"6e6902dcd87a37ad8d4a5d129ac419a5","Type":"ContainerDied","Data":"9ec7b3f55d5f3b865dea7f0ce86b7e4820095d3544db5d0a700a07034d26648d"}
Sep 18 13:44:40.438645 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:40.438089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-76.ec2.internal" event={"ID":"9485666a2553da508936cccb36d7017e","Type":"ContainerStarted","Data":"6392513e63fd0053c0d1aefcdc533e25f7a92eb73fe6efd10b9a2f7567272459"}
Sep 18 13:44:41.287342 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:41.286779    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:41.287342 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:41.286914    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:44:41.481263 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:41.481219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal" event={"ID":"6e6902dcd87a37ad8d4a5d129ac419a5","Type":"ContainerStarted","Data":"4898e0cc17143be72678b61bf329f85762abdaf94fde43f6a2036982957c25e4"}
Sep 18 13:44:41.496126 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:41.496072    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-76.ec2.internal" podStartSLOduration=4.496052702 podStartE2EDuration="4.496052702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:40.486272698 +0000 UTC m=+6.322111413" watchObservedRunningTime="2026-09-18 13:44:41.496052702 +0000 UTC m=+7.331891410"
Sep 18 13:44:41.802528 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:41.801724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:41.802528 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:41.801812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:41.802528 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:41.801954    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:41.802528 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:41.802018    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs podName:f6ef7168-1b39-4e49-8a76-5367e8067cd9 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:45.801999575 +0000 UTC m=+11.637838281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs") pod "network-metrics-daemon-pp58f" (UID: "f6ef7168-1b39-4e49-8a76-5367e8067cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:41.802528 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:41.802424    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:41.802528 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:41.802473    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret podName:d1b6473d-cfa1-4894-a473-6d83bb810cab nodeName:}" failed. No retries permitted until 2026-09-18 13:44:45.802458919 +0000 UTC m=+11.638297612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret") pod "global-pull-secret-syncer-4jndn" (UID: "d1b6473d-cfa1-4894-a473-6d83bb810cab") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:41.902404 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:41.902357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwtv\" (UniqueName: \"kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv\") pod \"network-check-target-5tmw4\" (UID: \"bff89b94-742d-4151-92cd-3d7b83282fb7\") " pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:41.902587 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:41.902566    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:41.902654 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:41.902595    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:41.902654 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:41.902608    2575 projected.go:196] Error preparing data for projected volume kube-api-access-llwtv for pod openshift-network-diagnostics/network-check-target-5tmw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:41.902744 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:41.902681    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv podName:bff89b94-742d-4151-92cd-3d7b83282fb7 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:45.902659752 +0000 UTC m=+11.738498462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-llwtv" (UniqueName: "kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv") pod "network-check-target-5tmw4" (UID: "bff89b94-742d-4151-92cd-3d7b83282fb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:42.288001 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:42.287915    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:42.288441 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:42.288060    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:44:42.288555 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:42.288539    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:42.288768 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:42.288728    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:44:43.286802 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:43.286307    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:43.286802 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:43.286447    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:44:44.287164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:44.287117    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:44.287636 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:44.287287    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:44:44.287636 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:44.287122    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:44.287636 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:44.287541    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:44:45.287020 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:45.286986    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:45.287218 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:45.287155    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:44:45.834066 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:45.834030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:45.834238 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:45.834100    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:45.834238 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:45.834203    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:45.834331 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:45.834264    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret podName:d1b6473d-cfa1-4894-a473-6d83bb810cab nodeName:}" failed. No retries permitted until 2026-09-18 13:44:53.834246243 +0000 UTC m=+19.670084942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret") pod "global-pull-secret-syncer-4jndn" (UID: "d1b6473d-cfa1-4894-a473-6d83bb810cab") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:45.834331 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:45.834203    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:45.834331 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:45.834324    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs podName:f6ef7168-1b39-4e49-8a76-5367e8067cd9 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:53.834309764 +0000 UTC m=+19.670148470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs") pod "network-metrics-daemon-pp58f" (UID: "f6ef7168-1b39-4e49-8a76-5367e8067cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:45.935054 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:45.934989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwtv\" (UniqueName: \"kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv\") pod \"network-check-target-5tmw4\" (UID: \"bff89b94-742d-4151-92cd-3d7b83282fb7\") " pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:45.935241 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:45.935170    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:45.935241 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:45.935202    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:45.935241 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:45.935218    2575 projected.go:196] Error preparing data for projected volume kube-api-access-llwtv for pod openshift-network-diagnostics/network-check-target-5tmw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:45.935420 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:45.935284    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv podName:bff89b94-742d-4151-92cd-3d7b83282fb7 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:53.935264708 +0000 UTC m=+19.771103417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-llwtv" (UniqueName: "kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv") pod "network-check-target-5tmw4" (UID: "bff89b94-742d-4151-92cd-3d7b83282fb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:46.288594 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:46.287896    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:46.288594 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:46.288024    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:44:46.288594 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:46.288095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:46.288594 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:46.288181    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:44:47.286888 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:47.286854    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:47.287044 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:47.286978    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:44:48.286459 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:48.286423    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:48.286909 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:48.286556    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:44:48.286909 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:48.286617    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:48.286909 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:48.286742    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:44:49.286847 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:49.286816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:49.287293 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:49.286925    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:44:50.287178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:50.287121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:50.287611 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:50.287153    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:50.287611 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:50.287263    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:44:50.287611 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:50.287381    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:44:51.286625 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:51.286591    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:51.286797 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:51.286725    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:44:52.286387 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:52.286353    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:52.286868 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:52.286506    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:44:52.286868 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:52.286545    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:52.286868 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:52.286652    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:44:53.287095 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:53.287006    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:53.287573 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:53.287165    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:44:53.892727 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:53.892692    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:53.892900 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:53.892765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:53.892900 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:53.892859    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:53.892900 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:53.892874    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:53.893075 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:53.892934    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs podName:f6ef7168-1b39-4e49-8a76-5367e8067cd9 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:09.892914365 +0000 UTC m=+35.728753083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs") pod "network-metrics-daemon-pp58f" (UID: "f6ef7168-1b39-4e49-8a76-5367e8067cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:53.893075 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:53.892954    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret podName:d1b6473d-cfa1-4894-a473-6d83bb810cab nodeName:}" failed. No retries permitted until 2026-09-18 13:45:09.892944129 +0000 UTC m=+35.728782823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret") pod "global-pull-secret-syncer-4jndn" (UID: "d1b6473d-cfa1-4894-a473-6d83bb810cab") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:53.993405 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:53.993367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwtv\" (UniqueName: \"kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv\") pod \"network-check-target-5tmw4\" (UID: \"bff89b94-742d-4151-92cd-3d7b83282fb7\") " pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:53.993572 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:53.993485    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:53.993572 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:53.993503    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:53.993572 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:53.993515    2575 projected.go:196] Error preparing data for projected volume kube-api-access-llwtv for pod openshift-network-diagnostics/network-check-target-5tmw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:53.993572 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:53.993571    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv podName:bff89b94-742d-4151-92cd-3d7b83282fb7 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:09.993556892 +0000 UTC m=+35.829395582 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-llwtv" (UniqueName: "kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv") pod "network-check-target-5tmw4" (UID: "bff89b94-742d-4151-92cd-3d7b83282fb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:54.286360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:54.286216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:54.286360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:54.286217    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:54.286360 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:54.286341    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:44:54.286632 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:54.286418    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:44:55.286830 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:55.286785    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:55.287329 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:55.286920    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:44:56.287163 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:56.287114    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:56.287526 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:56.287196    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:56.287526 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:56.287218    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:44:56.287526 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:56.287282    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:44:57.287062 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.286899    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:57.287180 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:57.287161    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:44:57.515994 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.515967    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh" event={"ID":"904528e0-ab8e-449a-9c7f-87884bbf5829","Type":"ContainerStarted","Data":"5a1f63c6525a48115f6de14a756e2c26399478e673f9549a9d721946d8c1d9da"}
Sep 18 13:44:57.517457 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.517434    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8zn42" event={"ID":"9396c3f0-550f-44f2-b331-dd4cfab9db06","Type":"ContainerStarted","Data":"41670002f869256e6b01edf53fca26e50b08cc7db075c5ca5371ac4946860915"}
Sep 18 13:44:57.519236 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.519207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cxdkt" event={"ID":"fd112042-77f9-4d45-a8b6-6e83b91c2bb3","Type":"ContainerStarted","Data":"cffec42becc9fdca50c0d9de8354599d59484d8089c677501221a7d4ccebfde9"}
Sep 18 13:44:57.520833 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.520808    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9r7tb" event={"ID":"f1d5dbf1-48bc-48cb-ae34-c08c64df818e","Type":"ContainerStarted","Data":"cb354b2545161e4db6f8361b618f24deda5668f7ac6029a3d13c5dff017797d9"}
Sep 18 13:44:57.522512 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.522486    2575 generic.go:356] "Generic (PLEG): container finished" podID="82adfcd0-c5e4-4bfd-b693-04fa2b6b4929" containerID="e98f52586fd813625ef0f1cbb6f92e7ae8d13201aafa5a1e845eaaf8072379fe" exitCode=0
Sep 18 13:44:57.522587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.522556    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcdls" event={"ID":"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929","Type":"ContainerDied","Data":"e98f52586fd813625ef0f1cbb6f92e7ae8d13201aafa5a1e845eaaf8072379fe"}
Sep 18 13:44:57.525306 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.525291    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 13:44:57.525650 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.525625    2575 generic.go:356] "Generic (PLEG): container finished" podID="94bd071d-9824-45bf-b051-503e6b8d7743" containerID="4599b35a12de41c121896aff59ce182ed6d3bd0c83f81fd152ee57d0e8fc6cc9" exitCode=1
Sep 18 13:44:57.525742 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.525688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2" event={"ID":"94bd071d-9824-45bf-b051-503e6b8d7743","Type":"ContainerStarted","Data":"75260748dbb5bd2a3cd9dd001ad4fb85fc2fdef8b1c4d489fdcc690e2efe7766"}
Sep 18 13:44:57.525790 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.525745    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2" event={"ID":"94bd071d-9824-45bf-b051-503e6b8d7743","Type":"ContainerStarted","Data":"e8776ab4a419ab3a7ae422d7d8591d9a43cdb809dfdf17117b23143a592f75dd"}
Sep 18 13:44:57.525790 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.525777    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2" event={"ID":"94bd071d-9824-45bf-b051-503e6b8d7743","Type":"ContainerStarted","Data":"6d5166a88e32193516f47f53e6ca02f009a8ebfa7ead2cff8acdc8363e76aed7"}
Sep 18 13:44:57.525887 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.525807    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2" event={"ID":"94bd071d-9824-45bf-b051-503e6b8d7743","Type":"ContainerDied","Data":"4599b35a12de41c121896aff59ce182ed6d3bd0c83f81fd152ee57d0e8fc6cc9"}
Sep 18 13:44:57.525887 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.525838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2" event={"ID":"94bd071d-9824-45bf-b051-503e6b8d7743","Type":"ContainerStarted","Data":"a82a480ed6d807374be38a3bedcb0b70572bfc2be783fd6f21b4d764ae0ddfcf"}
Sep 18 13:44:57.527235 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.527214    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-94xfb" event={"ID":"fcd2b632-1411-45f7-b108-13d885d68910","Type":"ContainerStarted","Data":"0e6e59aed614bf58fc26c2b6aed8926eba477680116798d58450d93d9e1c3011"}
Sep 18 13:44:57.528642 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.528620    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bkvl8" event={"ID":"fc9e1723-2aa9-424d-a2e1-33af09eb8e32","Type":"ContainerStarted","Data":"533f8111d798921d9fe04497f72b7edbb347a994a6080ec55e9eb5aea5f786bd"}
Sep 18 13:44:57.534468 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.534435    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-76.ec2.internal" podStartSLOduration=20.534422797 podStartE2EDuration="20.534422797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:41.497298118 +0000 UTC m=+7.333136833" watchObservedRunningTime="2026-09-18 13:44:57.534422797 +0000 UTC m=+23.370261511"
Sep 18 13:44:57.534848 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.534827    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8zn42" podStartSLOduration=7.977096728 podStartE2EDuration="21.534821565s" totalImagesPullingTime="13.557724837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:57.534235004 +0000 UTC m=+23.370073716" watchObservedRunningTime="2026-09-18 13:44:57.534821565 +0000 UTC m=+23.370660278"
Sep 18 13:44:57.553203 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.553158    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9r7tb" podStartSLOduration=4.103173148 podStartE2EDuration="21.55311508s" totalImagesPullingTime="17.449941932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:57.552887988 +0000 UTC m=+23.388726714" watchObservedRunningTime="2026-09-18 13:44:57.55311508 +0000 UTC m=+23.388953793"
Sep 18 13:44:57.569963 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.569917    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-94xfb" podStartSLOduration=4.095088364 podStartE2EDuration="21.569904095s" totalImagesPullingTime="17.474815731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:57.569516651 +0000 UTC m=+23.405355363" watchObservedRunningTime="2026-09-18 13:44:57.569904095 +0000 UTC m=+23.405742807"
Sep 18 13:44:57.585662 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.585476    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cxdkt" podStartSLOduration=8.026656325 podStartE2EDuration="21.58545883s" totalImagesPullingTime="13.558802505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:57.584863809 +0000 UTC m=+23.420702525" watchObservedRunningTime="2026-09-18 13:44:57.58545883 +0000 UTC m=+23.421297543"
Sep 18 13:44:57.621678 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:57.621630    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bkvl8" podStartSLOduration=4.16962471 podStartE2EDuration="21.62161532s" totalImagesPullingTime="17.45199061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:57.62158147 +0000 UTC m=+23.457420179" watchObservedRunningTime="2026-09-18 13:44:57.62161532 +0000 UTC m=+23.457454041"
Sep 18 13:44:58.286976 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:58.286946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:44:58.287124 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:58.287087    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:44:58.287250 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:58.287223    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:44:58.287892 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:58.287366    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:44:58.414257 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:58.414231    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 13:44:58.532563 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:58.532524    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh" event={"ID":"904528e0-ab8e-449a-9c7f-87884bbf5829","Type":"ContainerStarted","Data":"ecc99ddd29aaf12b4a250af510c3ba29e2484e5c0bde15600b8b50ac33655d20"}
Sep 18 13:44:58.533881 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:58.533858    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v7hzv" event={"ID":"97a92fc9-26f8-4450-8f50-88330c550257","Type":"ContainerStarted","Data":"980c3a2d9a1e896571b7bd0cbffb7994339dd8c9b7025cc64b47c54448315f93"}
Sep 18 13:44:58.536668 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:58.536623    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 13:44:58.537069 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:58.537050    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2" event={"ID":"94bd071d-9824-45bf-b051-503e6b8d7743","Type":"ContainerStarted","Data":"7495a80076217a955b394ccf5961971b12f8b33b1defaf4330383cc37a3c2eb6"}
Sep 18 13:44:59.229271 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:59.229156    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T13:44:58.414251078Z","UUID":"81a3762c-7960-4e28-b861-7d1fd1aeb305","Handler":null,"Name":"","Endpoint":""}
Sep 18 13:44:59.230880 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:59.230856    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 13:44:59.230994 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:59.230895    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 13:44:59.286932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:44:59.286905    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:44:59.287112 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:44:59.287020    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:45:00.286301 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:00.286269    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:45:00.286740 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:00.286269    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:45:00.286740 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:00.286407    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:45:00.286740 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:00.286485    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:45:00.547753 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:00.547684    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 13:45:00.548204 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:00.548121    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2" event={"ID":"94bd071d-9824-45bf-b051-503e6b8d7743","Type":"ContainerStarted","Data":"76248cafd01b5481c4c7f9d2ac318ba90b1dd1dc40805f39891ca6d5f7d5cc7d"}
Sep 18 13:45:00.550519 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:00.550495    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh" event={"ID":"904528e0-ab8e-449a-9c7f-87884bbf5829","Type":"ContainerStarted","Data":"7c7d7b19d8d0c2ecb24cc69e33710889424e379e4010e1f1df95b8313e43242e"}
Sep 18 13:45:00.572956 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:00.572907    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7dh" podStartSLOduration=4.903235042 podStartE2EDuration="24.572891856s" totalImagesPullingTime="19.669656814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:00.572770363 +0000 UTC m=+26.408609075" watchObservedRunningTime="2026-09-18 13:45:00.572891856 +0000 UTC m=+26.408730569"
Sep 18 13:45:00.573564 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:00.573517    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v7hzv" podStartSLOduration=7.149955545 podStartE2EDuration="24.573502685s" totalImagesPullingTime="17.42354714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:58.550643852 +0000 UTC m=+24.386482567" watchObservedRunningTime="2026-09-18 13:45:00.573502685 +0000 UTC m=+26.409341398"
Sep 18 13:45:01.252299 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:01.252264    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:45:01.252933 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:01.252907    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:45:01.287035 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:01.286995    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:45:01.287470 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:01.287154    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:45:01.553698 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:01.553565    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:45:01.553985 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:01.553947    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8zn42"
Sep 18 13:45:02.286351 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:02.286193    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:45:02.286486 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:02.286247    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:45:02.286486 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:02.286449    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:45:02.286600 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:02.286548    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:45:02.559239 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:02.559221    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 13:45:02.559912 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:02.559630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2" event={"ID":"94bd071d-9824-45bf-b051-503e6b8d7743","Type":"ContainerStarted","Data":"624956bfe0d9867dc1e2e43267e60d0b6427d1d3e02c6125f49aa8b6e4065cd4"}
Sep 18 13:45:02.560151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:02.560118    2575 scope.go:117] "RemoveContainer" containerID="4599b35a12de41c121896aff59ce182ed6d3bd0c83f81fd152ee57d0e8fc6cc9"
Sep 18 13:45:03.286735 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:03.286700    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:45:03.286880 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:03.286823    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:45:03.565208 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:03.564775    2575 generic.go:356] "Generic (PLEG): container finished" podID="82adfcd0-c5e4-4bfd-b693-04fa2b6b4929" containerID="ca50313826828230d59fecf72689808a1a6e1cae085c19aefbfca19c1eaf2c26" exitCode=0
Sep 18 13:45:03.565208 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:03.564874    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcdls" event={"ID":"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929","Type":"ContainerDied","Data":"ca50313826828230d59fecf72689808a1a6e1cae085c19aefbfca19c1eaf2c26"}
Sep 18 13:45:03.570607 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:03.570579    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 13:45:03.571101 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:03.571060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2" event={"ID":"94bd071d-9824-45bf-b051-503e6b8d7743","Type":"ContainerStarted","Data":"0133b4cd504dad781fc9b88a13c6331744ca1ab0cce0685697a911eecee7db92"}
Sep 18 13:45:03.571525 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:03.571491    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:45:03.571625 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:03.571563    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:45:03.571625 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:03.571610    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:45:03.590232 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:03.590201    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:45:03.590668 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:03.590642    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:45:03.618344 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:03.617872    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2" podStartSLOduration=10.150330363 podStartE2EDuration="27.617849226s" totalImagesPullingTime="17.467518863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:03.615482058 +0000 UTC m=+29.451320772" watchObservedRunningTime="2026-09-18 13:45:03.617849226 +0000 UTC m=+29.453687941"
Sep 18 13:45:04.287199 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:04.287016    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:45:04.287396 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:04.287021    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:45:04.287396 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:04.287303    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:45:04.287396 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:04.287372    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:45:04.364605 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:04.364553    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5tmw4"]
Sep 18 13:45:04.364776 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:04.364729    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:45:04.364895 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:04.364863    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:45:04.365321 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:04.365240    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pp58f"]
Sep 18 13:45:04.365966 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:04.365941    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4jndn"]
Sep 18 13:45:04.573614 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:04.573586    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:45:04.574039 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:04.573586    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:45:04.574039 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:04.573691    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:45:04.574039 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:04.573764    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:45:05.577475 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:05.577438    2575 generic.go:356] "Generic (PLEG): container finished" podID="82adfcd0-c5e4-4bfd-b693-04fa2b6b4929" containerID="6c025884bdf221dd8af33daff3672c1c980f6d8b62a2d8717e6f4df64457f394" exitCode=0
Sep 18 13:45:05.577926 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:05.577528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcdls" event={"ID":"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929","Type":"ContainerDied","Data":"6c025884bdf221dd8af33daff3672c1c980f6d8b62a2d8717e6f4df64457f394"}
Sep 18 13:45:06.286916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:06.286853    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:45:06.287047 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:06.286857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:45:06.287047 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:06.286945    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:45:06.287047 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:06.286857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:45:06.287047 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:06.287024    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:45:06.287197 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:06.287094    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:45:06.621878 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:06.621850    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cxdkt_fd112042-77f9-4d45-a8b6-6e83b91c2bb3/dns-node-resolver/0.log"
Sep 18 13:45:07.583935 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:07.583898    2575 generic.go:356] "Generic (PLEG): container finished" podID="82adfcd0-c5e4-4bfd-b693-04fa2b6b4929" containerID="20ffe5586a0fcd314f41379c872e4da57405ad4769537dc3031ce5150e0f28ec" exitCode=0
Sep 18 13:45:07.584092 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:07.583942    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcdls" event={"ID":"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929","Type":"ContainerDied","Data":"20ffe5586a0fcd314f41379c872e4da57405ad4769537dc3031ce5150e0f28ec"}
Sep 18 13:45:07.805359 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:07.805330    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bkvl8_fc9e1723-2aa9-424d-a2e1-33af09eb8e32/node-ca/0.log"
Sep 18 13:45:08.286143 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:08.286092    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:45:08.286292 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:08.286092    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:45:08.286292 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:08.286237    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp58f" podUID="f6ef7168-1b39-4e49-8a76-5367e8067cd9"
Sep 18 13:45:08.286292 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:08.286093    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:45:08.286292 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:08.286279    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jndn" podUID="d1b6473d-cfa1-4894-a473-6d83bb810cab"
Sep 18 13:45:08.286441 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:08.286342    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tmw4" podUID="bff89b94-742d-4151-92cd-3d7b83282fb7"
Sep 18 13:45:09.529247 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:09.529070    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-76.ec2.internal" event="NodeReady"
Sep 18 13:45:09.529589 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:09.529353    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 13:45:09.898259 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:09.898220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:45:09.898452 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:09.898386    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:45:09.898452 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:09.898402    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:45:09.898565 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:09.898459    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret podName:d1b6473d-cfa1-4894-a473-6d83bb810cab nodeName:}" failed. No retries permitted until 2026-09-18 13:45:41.898438995 +0000 UTC m=+67.734277691 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret") pod "global-pull-secret-syncer-4jndn" (UID: "d1b6473d-cfa1-4894-a473-6d83bb810cab") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:45:09.898565 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:09.898504    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:45:09.898565 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:09.898553    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs podName:f6ef7168-1b39-4e49-8a76-5367e8067cd9 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:41.898538608 +0000 UTC m=+67.734377304 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs") pod "network-metrics-daemon-pp58f" (UID: "f6ef7168-1b39-4e49-8a76-5367e8067cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:45:09.999046 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:09.998999    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwtv\" (UniqueName: \"kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv\") pod \"network-check-target-5tmw4\" (UID: \"bff89b94-742d-4151-92cd-3d7b83282fb7\") " pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:45:09.999253 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:09.999175    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:45:09.999253 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:09.999194    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:45:09.999253 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:09.999206    2575 projected.go:196] Error preparing data for projected volume kube-api-access-llwtv for pod openshift-network-diagnostics/network-check-target-5tmw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:45:09.999380 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:09.999282    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv podName:bff89b94-742d-4151-92cd-3d7b83282fb7 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:41.999262951 +0000 UTC m=+67.835101651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-llwtv" (UniqueName: "kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv") pod "network-check-target-5tmw4" (UID: "bff89b94-742d-4151-92cd-3d7b83282fb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:45:10.286238 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:10.286153    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:45:10.286495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:10.286153    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:45:10.286495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:10.286160    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:45:10.290740 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:10.290567    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 13:45:10.290740 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:10.290588    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqxkk\""
Sep 18 13:45:10.290740 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:10.290639    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 13:45:10.290740 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:10.290569    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 13:45:10.291056 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:10.290933    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 13:45:10.291189 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:10.291164    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8ktpw\""
Sep 18 13:45:13.601323 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:13.601283    2575 generic.go:356] "Generic (PLEG): container finished" podID="82adfcd0-c5e4-4bfd-b693-04fa2b6b4929" containerID="c3afe14db64f8a4db7ab664ae2ee2d803dac04967f67a034a80fdc4ed7115b89" exitCode=0
Sep 18 13:45:13.601829 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:13.601345    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcdls" event={"ID":"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929","Type":"ContainerDied","Data":"c3afe14db64f8a4db7ab664ae2ee2d803dac04967f67a034a80fdc4ed7115b89"}
Sep 18 13:45:14.607235 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:14.607195    2575 generic.go:356] "Generic (PLEG): container finished" podID="82adfcd0-c5e4-4bfd-b693-04fa2b6b4929" containerID="f25bafea698bb68dce86d2d8b058bb86f491e99d9d09d2f5be2715c181b184cb" exitCode=0
Sep 18 13:45:14.607604 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:14.607260    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcdls" event={"ID":"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929","Type":"ContainerDied","Data":"f25bafea698bb68dce86d2d8b058bb86f491e99d9d09d2f5be2715c181b184cb"}
Sep 18 13:45:15.612830 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:15.612795    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcdls" event={"ID":"82adfcd0-c5e4-4bfd-b693-04fa2b6b4929","Type":"ContainerStarted","Data":"a3327f96cbb2eb37df8d708541e5bbe8d8510b87c0205e74aa8ffdd22142a147"}
Sep 18 13:45:15.634814 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:15.634778    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fcdls" podStartSLOduration=9.927300462 podStartE2EDuration="39.63476392s" totalImagesPullingTime="29.707463458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:15.633558861 +0000 UTC m=+41.469397576" watchObservedRunningTime="2026-09-18 13:45:15.63476392 +0000 UTC m=+41.470602633"
Sep 18 13:45:29.731215 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.731182    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4b2sz"]
Sep 18 13:45:29.775880 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.775847    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s2ntp"]
Sep 18 13:45:29.776044 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.775975    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:29.779455 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.779428    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 13:45:29.780646 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.780609    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gfxkd\""
Sep 18 13:45:29.780646 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.780623    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 13:45:29.780646 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.780640    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 13:45:29.780873 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.780614    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 13:45:29.789293 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.789274    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4b2sz"]
Sep 18 13:45:29.789379 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.789310    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s2ntp"]
Sep 18 13:45:29.789426 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.789384    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:29.792502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.792484    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5gmms\""
Sep 18 13:45:29.792604 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.792530    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 13:45:29.792604 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.792560    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 13:45:29.828770 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.828741    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x4p9j"]
Sep 18 13:45:29.851495 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.851470    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x4p9j"]
Sep 18 13:45:29.851655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.851575    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x4p9j"
Sep 18 13:45:29.854929 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.854898    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 13:45:29.855100 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.855022    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 13:45:29.855222 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.855203    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4kzqf\""
Sep 18 13:45:29.855641 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.855623    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 13:45:29.935695 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.935660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f4deaf7-ae6b-4714-991c-270303038728-cert\") pod \"ingress-canary-x4p9j\" (UID: \"0f4deaf7-ae6b-4714-991c-270303038728\") " pod="openshift-ingress-canary/ingress-canary-x4p9j"
Sep 18 13:45:29.935899 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.935705    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38ceb72e-d2ba-44fc-9ab4-f18e59951595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:29.935899 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.935738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c8053d9-4da3-43dd-9e80-291986e34a82-tmp-dir\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:29.935899 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.935755    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c8053d9-4da3-43dd-9e80-291986e34a82-config-volume\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:29.935899 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.935848    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38ceb72e-d2ba-44fc-9ab4-f18e59951595-crio-socket\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:29.935899 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.935879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38ceb72e-d2ba-44fc-9ab4-f18e59951595-data-volume\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:29.936096 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.935908    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnzks\" (UniqueName: \"kubernetes.io/projected/0f4deaf7-ae6b-4714-991c-270303038728-kube-api-access-nnzks\") pod \"ingress-canary-x4p9j\" (UID: \"0f4deaf7-ae6b-4714-991c-270303038728\") " pod="openshift-ingress-canary/ingress-canary-x4p9j"
Sep 18 13:45:29.936096 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.935941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c8053d9-4da3-43dd-9e80-291986e34a82-metrics-tls\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:29.936096 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.935959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqz4g\" (UniqueName: \"kubernetes.io/projected/38ceb72e-d2ba-44fc-9ab4-f18e59951595-kube-api-access-dqz4g\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:29.936096 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.935976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8htb\" (UniqueName: \"kubernetes.io/projected/9c8053d9-4da3-43dd-9e80-291986e34a82-kube-api-access-p8htb\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:29.936096 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:29.936017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38ceb72e-d2ba-44fc-9ab4-f18e59951595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.036934 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.036842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38ceb72e-d2ba-44fc-9ab4-f18e59951595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.036934 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.036886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f4deaf7-ae6b-4714-991c-270303038728-cert\") pod \"ingress-canary-x4p9j\" (UID: \"0f4deaf7-ae6b-4714-991c-270303038728\") " pod="openshift-ingress-canary/ingress-canary-x4p9j"
Sep 18 13:45:30.036934 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.036908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38ceb72e-d2ba-44fc-9ab4-f18e59951595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.037191 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c8053d9-4da3-43dd-9e80-291986e34a82-tmp-dir\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:30.037191 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c8053d9-4da3-43dd-9e80-291986e34a82-config-volume\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:30.037276 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38ceb72e-d2ba-44fc-9ab4-f18e59951595-crio-socket\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.037276 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037254    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38ceb72e-d2ba-44fc-9ab4-f18e59951595-data-volume\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.037366 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnzks\" (UniqueName: \"kubernetes.io/projected/0f4deaf7-ae6b-4714-991c-270303038728-kube-api-access-nnzks\") pod \"ingress-canary-x4p9j\" (UID: \"0f4deaf7-ae6b-4714-991c-270303038728\") " pod="openshift-ingress-canary/ingress-canary-x4p9j"
Sep 18 13:45:30.037366 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c8053d9-4da3-43dd-9e80-291986e34a82-metrics-tls\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:30.037366 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqz4g\" (UniqueName: \"kubernetes.io/projected/38ceb72e-d2ba-44fc-9ab4-f18e59951595-kube-api-access-dqz4g\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.037502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037365    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8htb\" (UniqueName: \"kubernetes.io/projected/9c8053d9-4da3-43dd-9e80-291986e34a82-kube-api-access-p8htb\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:30.037502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037399    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c8053d9-4da3-43dd-9e80-291986e34a82-tmp-dir\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:30.037502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037451    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38ceb72e-d2ba-44fc-9ab4-f18e59951595-crio-socket\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.037645 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037573    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38ceb72e-d2ba-44fc-9ab4-f18e59951595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.037716 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037694    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c8053d9-4da3-43dd-9e80-291986e34a82-config-volume\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:30.037772 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.037736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38ceb72e-d2ba-44fc-9ab4-f18e59951595-data-volume\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.040930 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.040908    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c8053d9-4da3-43dd-9e80-291986e34a82-metrics-tls\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:30.041040 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.040952    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38ceb72e-d2ba-44fc-9ab4-f18e59951595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.041040 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.040963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f4deaf7-ae6b-4714-991c-270303038728-cert\") pod \"ingress-canary-x4p9j\" (UID: \"0f4deaf7-ae6b-4714-991c-270303038728\") " pod="openshift-ingress-canary/ingress-canary-x4p9j"
Sep 18 13:45:30.046275 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.046254    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnzks\" (UniqueName: \"kubernetes.io/projected/0f4deaf7-ae6b-4714-991c-270303038728-kube-api-access-nnzks\") pod \"ingress-canary-x4p9j\" (UID: \"0f4deaf7-ae6b-4714-991c-270303038728\") " pod="openshift-ingress-canary/ingress-canary-x4p9j"
Sep 18 13:45:30.048355 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.048294    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8htb\" (UniqueName: \"kubernetes.io/projected/9c8053d9-4da3-43dd-9e80-291986e34a82-kube-api-access-p8htb\") pod \"dns-default-s2ntp\" (UID: \"9c8053d9-4da3-43dd-9e80-291986e34a82\") " pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:30.050372 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.050350    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqz4g\" (UniqueName: \"kubernetes.io/projected/38ceb72e-d2ba-44fc-9ab4-f18e59951595-kube-api-access-dqz4g\") pod \"insights-runtime-extractor-4b2sz\" (UID: \"38ceb72e-d2ba-44fc-9ab4-f18e59951595\") " pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.085063 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.085033    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4b2sz"
Sep 18 13:45:30.097202 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.097168    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:30.160926 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.160898    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x4p9j"
Sep 18 13:45:30.436891 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.436858    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s2ntp"]
Sep 18 13:45:30.437569 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.437542    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4b2sz"]
Sep 18 13:45:30.442920 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:30.442877    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8053d9_4da3_43dd_9e80_291986e34a82.slice/crio-4487eb3d4ec63f397bf496f7ca7c97d83467bf398bec6705ac3a38149a46ea83 WatchSource:0}: Error finding container 4487eb3d4ec63f397bf496f7ca7c97d83467bf398bec6705ac3a38149a46ea83: Status 404 returned error can't find the container with id 4487eb3d4ec63f397bf496f7ca7c97d83467bf398bec6705ac3a38149a46ea83
Sep 18 13:45:30.443142 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:30.443113    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ceb72e_d2ba_44fc_9ab4_f18e59951595.slice/crio-e5dc6a74e73b4a64cc1843337abc5ad2f4020766323a91b99ad7e3ef087c119c WatchSource:0}: Error finding container e5dc6a74e73b4a64cc1843337abc5ad2f4020766323a91b99ad7e3ef087c119c: Status 404 returned error can't find the container with id e5dc6a74e73b4a64cc1843337abc5ad2f4020766323a91b99ad7e3ef087c119c
Sep 18 13:45:30.462874 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.462840    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x4p9j"]
Sep 18 13:45:30.466551 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:30.466528    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f4deaf7_ae6b_4714_991c_270303038728.slice/crio-870ecd2a44f301de77cfc16ef3dd09237c59104bd24375fa66487d3ff7b4e2b6 WatchSource:0}: Error finding container 870ecd2a44f301de77cfc16ef3dd09237c59104bd24375fa66487d3ff7b4e2b6: Status 404 returned error can't find the container with id 870ecd2a44f301de77cfc16ef3dd09237c59104bd24375fa66487d3ff7b4e2b6
Sep 18 13:45:30.651982 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.651932    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x4p9j" event={"ID":"0f4deaf7-ae6b-4714-991c-270303038728","Type":"ContainerStarted","Data":"870ecd2a44f301de77cfc16ef3dd09237c59104bd24375fa66487d3ff7b4e2b6"}
Sep 18 13:45:30.653203 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.653177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2ntp" event={"ID":"9c8053d9-4da3-43dd-9e80-291986e34a82","Type":"ContainerStarted","Data":"4487eb3d4ec63f397bf496f7ca7c97d83467bf398bec6705ac3a38149a46ea83"}
Sep 18 13:45:30.654653 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.654630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4b2sz" event={"ID":"38ceb72e-d2ba-44fc-9ab4-f18e59951595","Type":"ContainerStarted","Data":"6fdd371b8880f4d1f2e5ac7ed50d491e3553da1524385eda53462a753c3e3e2f"}
Sep 18 13:45:30.654747 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:30.654670    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4b2sz" event={"ID":"38ceb72e-d2ba-44fc-9ab4-f18e59951595","Type":"ContainerStarted","Data":"e5dc6a74e73b4a64cc1843337abc5ad2f4020766323a91b99ad7e3ef087c119c"}
Sep 18 13:45:32.661692 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:32.661647    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4b2sz" event={"ID":"38ceb72e-d2ba-44fc-9ab4-f18e59951595","Type":"ContainerStarted","Data":"9fe420d56da0c2e15ab815b8df63910281db7d94e60d084fe0ce56fec3dcb248"}
Sep 18 13:45:34.668496 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:34.668404    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x4p9j" event={"ID":"0f4deaf7-ae6b-4714-991c-270303038728","Type":"ContainerStarted","Data":"33ea3890f6b404c250a698070fb839d81d782644ff7b8a620954a02400a29e61"}
Sep 18 13:45:34.670175 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:34.670152    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2ntp" event={"ID":"9c8053d9-4da3-43dd-9e80-291986e34a82","Type":"ContainerStarted","Data":"19b7266b58623f33de24826ec6145a990b98f519119e046c443b333a0b021626"}
Sep 18 13:45:34.670309 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:34.670196    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2ntp" event={"ID":"9c8053d9-4da3-43dd-9e80-291986e34a82","Type":"ContainerStarted","Data":"683a6bc2f5be4060dd1216c6f412b42b548ac0dd55249a179e117e2ffcc3fd33"}
Sep 18 13:45:34.670309 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:34.670227    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:34.672232 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:34.672210    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4b2sz" event={"ID":"38ceb72e-d2ba-44fc-9ab4-f18e59951595","Type":"ContainerStarted","Data":"da32186f1180a8f452154caa1c1162c931af100bba66543b1e4cf0364a583481"}
Sep 18 13:45:34.685638 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:34.685602    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x4p9j" podStartSLOduration=2.138267158 podStartE2EDuration="5.685588926s" totalImagesPullingTime="3.547321768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:34.684903933 +0000 UTC m=+60.520742647" watchObservedRunningTime="2026-09-18 13:45:34.685588926 +0000 UTC m=+60.521427665"
Sep 18 13:45:34.702159 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:34.702100    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4b2sz" podStartSLOduration=2.085022585 podStartE2EDuration="5.702086152s" totalImagesPullingTime="3.617063567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:45:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:34.701261524 +0000 UTC m=+60.537100232" watchObservedRunningTime="2026-09-18 13:45:34.702086152 +0000 UTC m=+60.537924864"
Sep 18 13:45:34.723837 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:34.723766    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s2ntp" podStartSLOduration=2.154271842 podStartE2EDuration="5.723742359s" totalImagesPullingTime="3.569470517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:34.723294294 +0000 UTC m=+60.559133008" watchObservedRunningTime="2026-09-18 13:45:34.723742359 +0000 UTC m=+60.559581075"
Sep 18 13:45:35.588290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:35.588263    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qssl2"
Sep 18 13:45:36.449800 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:36.449760    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr"]
Sep 18 13:45:36.452176 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:36.452159    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr"
Sep 18 13:45:36.454705 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:36.454685    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 18 13:45:36.454817 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:36.454719    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-t6s6g\""
Sep 18 13:45:36.464097 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:36.464075    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr"]
Sep 18 13:45:36.586585 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:36.586532    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/568858ef-c897-458b-88da-2c932b5f0aa2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-vsksr\" (UID: \"568858ef-c897-458b-88da-2c932b5f0aa2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr"
Sep 18 13:45:36.687879 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:36.687847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/568858ef-c897-458b-88da-2c932b5f0aa2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-vsksr\" (UID: \"568858ef-c897-458b-88da-2c932b5f0aa2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr"
Sep 18 13:45:36.690363 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:36.690342    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/568858ef-c897-458b-88da-2c932b5f0aa2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-vsksr\" (UID: \"568858ef-c897-458b-88da-2c932b5f0aa2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr"
Sep 18 13:45:36.761055 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:36.760973    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr"
Sep 18 13:45:37.031710 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:37.031630    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr"]
Sep 18 13:45:37.034802 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:37.034772    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568858ef_c897_458b_88da_2c932b5f0aa2.slice/crio-0234aae788777c0a9d29d6d0e4254b34413d22ee2bdcb41680a390634d1aa993 WatchSource:0}: Error finding container 0234aae788777c0a9d29d6d0e4254b34413d22ee2bdcb41680a390634d1aa993: Status 404 returned error can't find the container with id 0234aae788777c0a9d29d6d0e4254b34413d22ee2bdcb41680a390634d1aa993
Sep 18 13:45:37.682771 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:37.682736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr" event={"ID":"568858ef-c897-458b-88da-2c932b5f0aa2","Type":"ContainerStarted","Data":"0234aae788777c0a9d29d6d0e4254b34413d22ee2bdcb41680a390634d1aa993"}
Sep 18 13:45:38.668173 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.668120    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b7fdc8c47-stnb7"]
Sep 18 13:45:38.670110 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.670090    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.672873 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.672852    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 13:45:38.672963 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.672882    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 13:45:38.674315 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.674222    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 13:45:38.674315 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.674239    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 13:45:38.674315 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.674244    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 13:45:38.674315 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.674258    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 13:45:38.674315 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.674294    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 13:45:38.674538 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.674222    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wkjzx\""
Sep 18 13:45:38.682725 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.682706    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7fdc8c47-stnb7"]
Sep 18 13:45:38.688016 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.687990    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr" event={"ID":"568858ef-c897-458b-88da-2c932b5f0aa2","Type":"ContainerStarted","Data":"956e35835a8d32fab71e07446f2a9af13c232fcc22df4d709c73ed44589ea4de"}
Sep 18 13:45:38.688326 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.688203    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr"
Sep 18 13:45:38.692871 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.692853    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr"
Sep 18 13:45:38.717360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.717317    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vsksr" podStartSLOduration=1.579198348 podStartE2EDuration="2.717301367s" totalImagesPullingTime="1.138103019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:38.716549053 +0000 UTC m=+64.552387770" watchObservedRunningTime="2026-09-18 13:45:38.717301367 +0000 UTC m=+64.553140079"
Sep 18 13:45:38.805431 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.804960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-config\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.805590 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.805444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-serving-cert\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.805590 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.805475    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-oauth-config\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.805590 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.805496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzd26\" (UniqueName: \"kubernetes.io/projected/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-kube-api-access-pzd26\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.805590 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.805544    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-service-ca\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.805590 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.805558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-oauth-serving-cert\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.906477 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.906423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-oauth-config\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.906477 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.906484    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd26\" (UniqueName: \"kubernetes.io/projected/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-kube-api-access-pzd26\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.906718 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.906532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-service-ca\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.906718 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.906548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-oauth-serving-cert\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.906718 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.906590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-config\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.906718 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.906618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-serving-cert\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.907321 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.907300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-config\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.907426 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.907353    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-oauth-serving-cert\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.907426 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.907411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-service-ca\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.908872 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.908848    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-serving-cert\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.908872 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.908869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-oauth-config\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.917341 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.917316    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzd26\" (UniqueName: \"kubernetes.io/projected/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-kube-api-access-pzd26\") pod \"console-6b7fdc8c47-stnb7\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") " pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:38.979291 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:38.979206    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:39.248973 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.248890    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7fdc8c47-stnb7"]
Sep 18 13:45:39.251840 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:39.251817    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e5a544_ddea_4622_a338_ed05a2e5ec7c.slice/crio-3d25a003d187475db8a4d62fc14b40c280ead800bd927f47b497427feb8886c5 WatchSource:0}: Error finding container 3d25a003d187475db8a4d62fc14b40c280ead800bd927f47b497427feb8886c5: Status 404 returned error can't find the container with id 3d25a003d187475db8a4d62fc14b40c280ead800bd927f47b497427feb8886c5
Sep 18 13:45:39.535304 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.535235    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"]
Sep 18 13:45:39.537737 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.537720    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.542733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.542709    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 18 13:45:39.542866 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.542710    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 13:45:39.542866 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.542714    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 18 13:45:39.543105 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.543088    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 13:45:39.543176 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.543109    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 13:45:39.543225 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.543189    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rlzc9\""
Sep 18 13:45:39.550564 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.550544    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"]
Sep 18 13:45:39.694187 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.694152    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7fdc8c47-stnb7" event={"ID":"d7e5a544-ddea-4622-a338-ed05a2e5ec7c","Type":"ContainerStarted","Data":"3d25a003d187475db8a4d62fc14b40c280ead800bd927f47b497427feb8886c5"}
Sep 18 13:45:39.714354 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.714318    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb59ab9-f6ee-4478-8542-f26308473d65-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.714524 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.714452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cb59ab9-f6ee-4478-8542-f26308473d65-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.714524 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.714512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cb59ab9-f6ee-4478-8542-f26308473d65-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.714649 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.714562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lw8f\" (UniqueName: \"kubernetes.io/projected/3cb59ab9-f6ee-4478-8542-f26308473d65-kube-api-access-5lw8f\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.815272 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.815233    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lw8f\" (UniqueName: \"kubernetes.io/projected/3cb59ab9-f6ee-4478-8542-f26308473d65-kube-api-access-5lw8f\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.815272 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.815277    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb59ab9-f6ee-4478-8542-f26308473d65-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.815518 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.815319    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cb59ab9-f6ee-4478-8542-f26308473d65-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.815518 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.815363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cb59ab9-f6ee-4478-8542-f26308473d65-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.816679 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.816606    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb59ab9-f6ee-4478-8542-f26308473d65-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.819864 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.819834    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cb59ab9-f6ee-4478-8542-f26308473d65-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.821694 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.821549    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cb59ab9-f6ee-4478-8542-f26308473d65-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.835110 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.835083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lw8f\" (UniqueName: \"kubernetes.io/projected/3cb59ab9-f6ee-4478-8542-f26308473d65-kube-api-access-5lw8f\") pod \"prometheus-operator-7bd5d56d6-scdbf\" (UID: \"3cb59ab9-f6ee-4478-8542-f26308473d65\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:39.846756 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:39.846728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"
Sep 18 13:45:40.132218 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:40.132124    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf"]
Sep 18 13:45:40.137468 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:40.137437    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb59ab9_f6ee_4478_8542_f26308473d65.slice/crio-71a0fac880f6a39c89034af7e4d1c91a2ea8bd6c44655299d26a3e6925db7af4 WatchSource:0}: Error finding container 71a0fac880f6a39c89034af7e4d1c91a2ea8bd6c44655299d26a3e6925db7af4: Status 404 returned error can't find the container with id 71a0fac880f6a39c89034af7e4d1c91a2ea8bd6c44655299d26a3e6925db7af4
Sep 18 13:45:40.699192 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:40.699149    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf" event={"ID":"3cb59ab9-f6ee-4478-8542-f26308473d65","Type":"ContainerStarted","Data":"71a0fac880f6a39c89034af7e4d1c91a2ea8bd6c44655299d26a3e6925db7af4"}
Sep 18 13:45:41.935703 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:41.935662    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:45:41.936176 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:41.935738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:45:41.938714 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:41.938684    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 13:45:41.938839 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:41.938701    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 13:45:41.948560 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:41.948531    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6ef7168-1b39-4e49-8a76-5367e8067cd9-metrics-certs\") pod \"network-metrics-daemon-pp58f\" (UID: \"f6ef7168-1b39-4e49-8a76-5367e8067cd9\") " pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:45:41.948690 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:41.948543    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1b6473d-cfa1-4894-a473-6d83bb810cab-original-pull-secret\") pod \"global-pull-secret-syncer-4jndn\" (UID: \"d1b6473d-cfa1-4894-a473-6d83bb810cab\") " pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:45:42.036387 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:42.036354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwtv\" (UniqueName: \"kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv\") pod \"network-check-target-5tmw4\" (UID: \"bff89b94-742d-4151-92cd-3d7b83282fb7\") " pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:45:42.039605 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:42.039583    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 13:45:42.049899 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:42.049873    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 13:45:42.059984 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:42.059954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llwtv\" (UniqueName: \"kubernetes.io/projected/bff89b94-742d-4151-92cd-3d7b83282fb7-kube-api-access-llwtv\") pod \"network-check-target-5tmw4\" (UID: \"bff89b94-742d-4151-92cd-3d7b83282fb7\") " pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:45:42.100543 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:42.100500    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8ktpw\""
Sep 18 13:45:42.104804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:42.104780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jndn"
Sep 18 13:45:42.108552 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:42.108529    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:45:42.114031 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:42.114006    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqxkk\""
Sep 18 13:45:42.121326 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:42.121301    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp58f"
Sep 18 13:45:43.314424 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.314390    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5tmw4"]
Sep 18 13:45:43.317319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.317257    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4jndn"]
Sep 18 13:45:43.381183 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:43.381147    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b6473d_cfa1_4894_a473_6d83bb810cab.slice/crio-ca9d77e20b2b995f746a46a33c766c0130bafe10dfe87a2be2612c5d202dbcde WatchSource:0}: Error finding container ca9d77e20b2b995f746a46a33c766c0130bafe10dfe87a2be2612c5d202dbcde: Status 404 returned error can't find the container with id ca9d77e20b2b995f746a46a33c766c0130bafe10dfe87a2be2612c5d202dbcde
Sep 18 13:45:43.381682 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:43.381660    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff89b94_742d_4151_92cd_3d7b83282fb7.slice/crio-89fe3568a44a67da742422c25f8b808470e0b113a93556ef53356dfd84581c78 WatchSource:0}: Error finding container 89fe3568a44a67da742422c25f8b808470e0b113a93556ef53356dfd84581c78: Status 404 returned error can't find the container with id 89fe3568a44a67da742422c25f8b808470e0b113a93556ef53356dfd84581c78
Sep 18 13:45:43.653335 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.653252    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pp58f"]
Sep 18 13:45:43.658473 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:43.658429    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ef7168_1b39_4e49_8a76_5367e8067cd9.slice/crio-028a8cc16c534d106edf469e50d5e54c3542542699c92fffe1854edd4e28c0a3 WatchSource:0}: Error finding container 028a8cc16c534d106edf469e50d5e54c3542542699c92fffe1854edd4e28c0a3: Status 404 returned error can't find the container with id 028a8cc16c534d106edf469e50d5e54c3542542699c92fffe1854edd4e28c0a3
Sep 18 13:45:43.711409 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.711371    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pp58f" event={"ID":"f6ef7168-1b39-4e49-8a76-5367e8067cd9","Type":"ContainerStarted","Data":"028a8cc16c534d106edf469e50d5e54c3542542699c92fffe1854edd4e28c0a3"}
Sep 18 13:45:43.712519 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.712499    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5tmw4" event={"ID":"bff89b94-742d-4151-92cd-3d7b83282fb7","Type":"ContainerStarted","Data":"89fe3568a44a67da742422c25f8b808470e0b113a93556ef53356dfd84581c78"}
Sep 18 13:45:43.714023 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.714000    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7fdc8c47-stnb7" event={"ID":"d7e5a544-ddea-4622-a338-ed05a2e5ec7c","Type":"ContainerStarted","Data":"e29753f1550546ece0072306a154ddb6cf728ba0fb49cefd0d09f627c5ed95f5"}
Sep 18 13:45:43.715947 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.715920    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf" event={"ID":"3cb59ab9-f6ee-4478-8542-f26308473d65","Type":"ContainerStarted","Data":"e16da6fa42b67ea26438a474c9757cfaf7b2fa84a36cbc0c0645b54076247924"}
Sep 18 13:45:43.716033 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.715960    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf" event={"ID":"3cb59ab9-f6ee-4478-8542-f26308473d65","Type":"ContainerStarted","Data":"bf7d2201fa45d8fb21beeeb406adc891f9ac6be05cfbbf7114e2bdd3b2fd4a74"}
Sep 18 13:45:43.717121 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.717101    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4jndn" event={"ID":"d1b6473d-cfa1-4894-a473-6d83bb810cab","Type":"ContainerStarted","Data":"ca9d77e20b2b995f746a46a33c766c0130bafe10dfe87a2be2612c5d202dbcde"}
Sep 18 13:45:43.730950 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.730925    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b47cf6fd9-g5g4g"]
Sep 18 13:45:43.733047 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.733024    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.747067 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.747046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xtp5\" (UniqueName: \"kubernetes.io/projected/d7b32355-9321-4e8f-b827-c045966c21c8-kube-api-access-5xtp5\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.747339 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.747308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-service-ca\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.747500 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.747479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-serving-cert\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.747602 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.747541    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-trusted-ca-bundle\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.747602 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.747588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-oauth-config\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.747691 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.747632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-console-config\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.747795 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.747778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-oauth-serving-cert\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.754948 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.754926    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 13:45:43.755561 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.755525    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b7fdc8c47-stnb7" podStartSLOduration=1.595506018 podStartE2EDuration="5.755511124s" totalImagesPullingTime="4.160005106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:43.754836821 +0000 UTC m=+69.590675535" watchObservedRunningTime="2026-09-18 13:45:43.755511124 +0000 UTC m=+69.591349837"
Sep 18 13:45:43.755652 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.755641    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b47cf6fd9-g5g4g"]
Sep 18 13:45:43.816266 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.816204    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-scdbf" podStartSLOduration=1.5537179220000001 podStartE2EDuration="4.816182952s" totalImagesPullingTime="3.26246503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:43.815229109 +0000 UTC m=+69.651067825" watchObservedRunningTime="2026-09-18 13:45:43.816182952 +0000 UTC m=+69.652021666"
Sep 18 13:45:43.849166 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.849116    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xtp5\" (UniqueName: \"kubernetes.io/projected/d7b32355-9321-4e8f-b827-c045966c21c8-kube-api-access-5xtp5\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.849338 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.849213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-service-ca\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.849338 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.849248    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-serving-cert\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.849338 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.849279    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-trusted-ca-bundle\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.849338 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.849314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-oauth-config\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.849549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.849343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-console-config\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.849549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.849378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-oauth-serving-cert\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.850050 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.850011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-service-ca\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.850195 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.850056    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-oauth-serving-cert\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.850195 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.850089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-console-config\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.850676 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.850647    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-trusted-ca-bundle\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.852264 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.852232    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-serving-cert\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.852473 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.852453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-oauth-config\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:43.857387 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:43.857366    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xtp5\" (UniqueName: \"kubernetes.io/projected/d7b32355-9321-4e8f-b827-c045966c21c8-kube-api-access-5xtp5\") pod \"console-b47cf6fd9-g5g4g\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") " pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:44.041343 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:44.041259    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:44.333634 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:44.333562    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b47cf6fd9-g5g4g"]
Sep 18 13:45:44.337701 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:44.337668    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b32355_9321_4e8f_b827_c045966c21c8.slice/crio-4b9664d32abadafb0c659383d80df0d34ec826b76fe926358bf2975d1d7c654d WatchSource:0}: Error finding container 4b9664d32abadafb0c659383d80df0d34ec826b76fe926358bf2975d1d7c654d: Status 404 returned error can't find the container with id 4b9664d32abadafb0c659383d80df0d34ec826b76fe926358bf2975d1d7c654d
Sep 18 13:45:44.678197 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:44.678104    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s2ntp"
Sep 18 13:45:44.726332 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:44.725637    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b47cf6fd9-g5g4g" event={"ID":"d7b32355-9321-4e8f-b827-c045966c21c8","Type":"ContainerStarted","Data":"55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4"}
Sep 18 13:45:44.726332 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:44.725691    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b47cf6fd9-g5g4g" event={"ID":"d7b32355-9321-4e8f-b827-c045966c21c8","Type":"ContainerStarted","Data":"4b9664d32abadafb0c659383d80df0d34ec826b76fe926358bf2975d1d7c654d"}
Sep 18 13:45:44.761637 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:44.761360    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b47cf6fd9-g5g4g" podStartSLOduration=1.753539978 podStartE2EDuration="1.753539978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:44.752965592 +0000 UTC m=+70.588804308" watchObservedRunningTime="2026-09-18 13:45:44.753539978 +0000 UTC m=+70.589378688"
Sep 18 13:45:45.735962 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:45.735880    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pp58f" event={"ID":"f6ef7168-1b39-4e49-8a76-5367e8067cd9","Type":"ContainerStarted","Data":"1d44d981c586e219b920f55ff4edfbda661187d24fdcd8adbdcac813b9ea014d"}
Sep 18 13:45:45.736579 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:45.735982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pp58f" event={"ID":"f6ef7168-1b39-4e49-8a76-5367e8067cd9","Type":"ContainerStarted","Data":"f85e7a92ec1f11c92f60a8df179ee84d8b02f790fe0cdf24df582f8c49f8d56f"}
Sep 18 13:45:45.766733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:45.766605    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pp58f" podStartSLOduration=68.710361902 podStartE2EDuration="1m9.76658965s" totalImagesPullingTime="1.056227748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:45.76472609 +0000 UTC m=+71.600564807" watchObservedRunningTime="2026-09-18 13:45:45.76658965 +0000 UTC m=+71.602428363"
Sep 18 13:45:46.019146 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.019039    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"]
Sep 18 13:45:46.023452 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.023428    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.027287 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.027059    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l489c\""
Sep 18 13:45:46.027490 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.027462    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 18 13:45:46.028845 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.028676    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 18 13:45:46.047376 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.047347    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"]
Sep 18 13:45:46.048777 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.048651    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"]
Sep 18 13:45:46.051630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.051607    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.054758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.054632    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 18 13:45:46.054758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.054646    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ppchb\""
Sep 18 13:45:46.054923 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.054790    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 18 13:45:46.054923 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.054834    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 18 13:45:46.063349 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.062614    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pjvd2"]
Sep 18 13:45:46.065470 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.065447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.068319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.068294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84fe0d15-4629-45c2-985b-dc6b34898876-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.068425 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.068353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.068425 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.068382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj4hg\" (UniqueName: \"kubernetes.io/projected/84fe0d15-4629-45c2-985b-dc6b34898876-kube-api-access-gj4hg\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.068425 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.068411    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.068571 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.068439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59ncl\" (UniqueName: \"kubernetes.io/projected/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-kube-api-access-59ncl\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.068571 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.068454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/84fe0d15-4629-45c2-985b-dc6b34898876-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.068571 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.068473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.068571 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.068491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.068571 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.068511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.068571 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.068531    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.072702 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.072674    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 13:45:46.073294 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.073050    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vn8xp\""
Sep 18 13:45:46.073294 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.073082    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 13:45:46.073294 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.073274    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 13:45:46.074670 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.074607    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"]
Sep 18 13:45:46.169559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.169521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.169559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.169554    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.169785 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.169577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d9456b5-d539-4c30-ae70-68a116eefa1f-sys\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.169785 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.169608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.169785 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.169634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-textfile\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.169785 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.169683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.169785 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:46.169701    2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 18 13:45:46.169785 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.169709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d9456b5-d539-4c30-ae70-68a116eefa1f-metrics-client-ca\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.169785 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:46.169784    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-tls podName:84fe0d15-4629-45c2-985b-dc6b34898876 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:46.669760737 +0000 UTC m=+72.505599431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-b9wsj" (UID: "84fe0d15-4629-45c2-985b-dc6b34898876") : secret "kube-state-metrics-tls" not found
Sep 18 13:45:46.170097 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.169841    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-wtmp\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.170097 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.169875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-tls\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.170097 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.169910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84fe0d15-4629-45c2-985b-dc6b34898876-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.170097 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.169962    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.170097 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170000    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdn8w\" (UniqueName: \"kubernetes.io/projected/6d9456b5-d539-4c30-ae70-68a116eefa1f-kube-api-access-rdn8w\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.170358 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.170358 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170249    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.170358 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj4hg\" (UniqueName: \"kubernetes.io/projected/84fe0d15-4629-45c2-985b-dc6b34898876-kube-api-access-gj4hg\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.170358 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.170546 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170365    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59ncl\" (UniqueName: \"kubernetes.io/projected/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-kube-api-access-59ncl\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.170546 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170390    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/84fe0d15-4629-45c2-985b-dc6b34898876-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.170546 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170414    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d9456b5-d539-4c30-ae70-68a116eefa1f-root\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.170842 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170785    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84fe0d15-4629-45c2-985b-dc6b34898876-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.170959 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170904    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/84fe0d15-4629-45c2-985b-dc6b34898876-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.170959 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170949    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.171091 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.170952    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.172789 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.172766    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.172978 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.172953    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.173099 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.173078    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.182677 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.182651    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj4hg\" (UniqueName: \"kubernetes.io/projected/84fe0d15-4629-45c2-985b-dc6b34898876-kube-api-access-gj4hg\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.182811 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.182748    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59ncl\" (UniqueName: \"kubernetes.io/projected/f5b1b1c6-1179-4b72-a9ac-02f8a52a3710-kube-api-access-59ncl\") pod \"openshift-state-metrics-86c5bc79d6-5b8xc\" (UID: \"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.271438 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-textfile\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.271438 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d9456b5-d539-4c30-ae70-68a116eefa1f-metrics-client-ca\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.271438 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-wtmp\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.271687 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-tls\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.271687 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.271687 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdn8w\" (UniqueName: \"kubernetes.io/projected/6d9456b5-d539-4c30-ae70-68a116eefa1f-kube-api-access-rdn8w\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.271687 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271554    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.271687 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:46.271600    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 18 13:45:46.271687 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:46.271673    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-tls podName:6d9456b5-d539-4c30-ae70-68a116eefa1f nodeName:}" failed. No retries permitted until 2026-09-18 13:45:46.771652426 +0000 UTC m=+72.607491136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-tls") pod "node-exporter-pjvd2" (UID: "6d9456b5-d539-4c30-ae70-68a116eefa1f") : secret "node-exporter-tls" not found
Sep 18 13:45:46.271687 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271674    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-wtmp\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.272018 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271753    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-textfile\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.272018 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d9456b5-d539-4c30-ae70-68a116eefa1f-root\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.272018 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d9456b5-d539-4c30-ae70-68a116eefa1f-sys\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.272018 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271873    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d9456b5-d539-4c30-ae70-68a116eefa1f-root\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.272018 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.271932    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d9456b5-d539-4c30-ae70-68a116eefa1f-sys\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.272309 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.272287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.272596 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.272577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d9456b5-d539-4c30-ae70-68a116eefa1f-metrics-client-ca\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.274083 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.274057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.282099 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.282077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdn8w\" (UniqueName: \"kubernetes.io/projected/6d9456b5-d539-4c30-ae70-68a116eefa1f-kube-api-access-rdn8w\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.338150 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.338094    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"
Sep 18 13:45:46.675448 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.675405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.678207 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.678177    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/84fe0d15-4629-45c2-985b-dc6b34898876-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-b9wsj\" (UID: \"84fe0d15-4629-45c2-985b-dc6b34898876\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.776378 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.776341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-tls\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.778986 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.778964    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d9456b5-d539-4c30-ae70-68a116eefa1f-node-exporter-tls\") pod \"node-exporter-pjvd2\" (UID: \"6d9456b5-d539-4c30-ae70-68a116eefa1f\") " pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:46.963953 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.963862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"
Sep 18 13:45:46.977348 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:46.977314    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pjvd2"
Sep 18 13:45:47.019884 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.019856    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:45:47.022805 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.022784    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.027247 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.027214    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 18 13:45:47.027371 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.027301    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 18 13:45:47.027371 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.027215    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 18 13:45:47.027564 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.027551    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 18 13:45:47.027884 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.027845    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 18 13:45:47.027884 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.027847    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 18 13:45:47.028034 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.027914    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dzvjw\""
Sep 18 13:45:47.028085 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.028033    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 18 13:45:47.028182 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.028166    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 18 13:45:47.028733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.028713    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 18 13:45:47.058892 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.058862    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:45:47.079468 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-config-volume\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.079634 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079474    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.079634 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079517    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.079634 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079569    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.079634 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.079634 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.079874 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.079874 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.079874 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-web-config\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.079874 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079819    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-config-out\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.079874 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079840    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.080096 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079882    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxsk9\" (UniqueName: \"kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-kube-api-access-jxsk9\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.080096 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.079922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180311 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180276    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180460 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180460 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180460 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180460 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180455    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180683 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180485    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180683 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180520    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180683 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-web-config\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180683 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-config-out\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180683 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180683 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxsk9\" (UniqueName: \"kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-kube-api-access-jxsk9\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180960 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.180960 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.180756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-config-volume\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.181262 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.181240    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.181326 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.181298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.181326 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.181316    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.183851 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.183806    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-config-volume\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.184873 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.184675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-config-out\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.185031 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.184961    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.185031 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.185006    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.185167 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.185067    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-web-config\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.185167 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.185069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.185807 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.185787    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.186447 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.186429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.186702 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.186681    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.192655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.192636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxsk9\" (UniqueName: \"kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-kube-api-access-jxsk9\") pod \"alertmanager-main-0\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.336202 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:47.336164    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:47.987495 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:47.987462    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d9456b5_d539_4c30_ae70_68a116eefa1f.slice/crio-a147fa7a86eddf13bafd9991ecdeb97d62177ea0dffe4410fcca1449f34298ce WatchSource:0}: Error finding container a147fa7a86eddf13bafd9991ecdeb97d62177ea0dffe4410fcca1449f34298ce: Status 404 returned error can't find the container with id a147fa7a86eddf13bafd9991ecdeb97d62177ea0dffe4410fcca1449f34298ce
Sep 18 13:45:48.267687 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.267616    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc"]
Sep 18 13:45:48.271529 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:48.271489    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b1b1c6_1179_4b72_a9ac_02f8a52a3710.slice/crio-a6e946c7d1f1784f2c4ec1aedc5677ee1e9601dfcb306e67e1ab36d70c8c788c WatchSource:0}: Error finding container a6e946c7d1f1784f2c4ec1aedc5677ee1e9601dfcb306e67e1ab36d70c8c788c: Status 404 returned error can't find the container with id a6e946c7d1f1784f2c4ec1aedc5677ee1e9601dfcb306e67e1ab36d70c8c788c
Sep 18 13:45:48.272606 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.272580    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:45:48.291311 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.291286    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-b9wsj"]
Sep 18 13:45:48.291698 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:48.291657    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84fe0d15_4629_45c2_985b_dc6b34898876.slice/crio-22b8815aa8fbc7f2b0029b05054940edfde66a53cf7d27657d71093b0036f157 WatchSource:0}: Error finding container 22b8815aa8fbc7f2b0029b05054940edfde66a53cf7d27657d71093b0036f157: Status 404 returned error can't find the container with id 22b8815aa8fbc7f2b0029b05054940edfde66a53cf7d27657d71093b0036f157
Sep 18 13:45:48.750335 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.750292    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5tmw4" event={"ID":"bff89b94-742d-4151-92cd-3d7b83282fb7","Type":"ContainerStarted","Data":"f9f301a4bc81a70adbcf3dfac43fd43b281100ee02768a808f04e46a57d6d080"}
Sep 18 13:45:48.750525 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.750457    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:45:48.751756 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.751726    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerStarted","Data":"eb9dab43fbf1021713a7e097a82977af67cbeccb915f10177a5746006b93bfaf"}
Sep 18 13:45:48.753802 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.753772    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc" event={"ID":"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710","Type":"ContainerStarted","Data":"56f2133dd5601b0bd5296a0a1f33c5307f841660bf1e205cbd55f2ff4af5ef18"}
Sep 18 13:45:48.753880 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.753833    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc" event={"ID":"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710","Type":"ContainerStarted","Data":"0f6d4cbefc35d458423a47872d1b4b617dd0801453f187507b1de6d059119153"}
Sep 18 13:45:48.753880 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.753866    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc" event={"ID":"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710","Type":"ContainerStarted","Data":"a6e946c7d1f1784f2c4ec1aedc5677ee1e9601dfcb306e67e1ab36d70c8c788c"}
Sep 18 13:45:48.755588 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.755560    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4jndn" event={"ID":"d1b6473d-cfa1-4894-a473-6d83bb810cab","Type":"ContainerStarted","Data":"049ee5428eb43ea0703c8c98dea27410c6c64d2f9d0470a584bfc226cde25276"}
Sep 18 13:45:48.756965 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.756941    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjvd2" event={"ID":"6d9456b5-d539-4c30-ae70-68a116eefa1f","Type":"ContainerStarted","Data":"a147fa7a86eddf13bafd9991ecdeb97d62177ea0dffe4410fcca1449f34298ce"}
Sep 18 13:45:48.758303 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.758285    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj" event={"ID":"84fe0d15-4629-45c2-985b-dc6b34898876","Type":"ContainerStarted","Data":"22b8815aa8fbc7f2b0029b05054940edfde66a53cf7d27657d71093b0036f157"}
Sep 18 13:45:48.767657 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.767610    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5tmw4" podStartSLOduration=68.183068493 podStartE2EDuration="1m12.767594735s" totalImagesPullingTime="4.584526242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:48.767064379 +0000 UTC m=+74.602903092" watchObservedRunningTime="2026-09-18 13:45:48.767594735 +0000 UTC m=+74.603433448"
Sep 18 13:45:48.786184 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.786116    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4jndn" podStartSLOduration=68.185834813 podStartE2EDuration="1m12.786102616s" totalImagesPullingTime="4.600267803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:48.784746595 +0000 UTC m=+74.620585309" watchObservedRunningTime="2026-09-18 13:45:48.786102616 +0000 UTC m=+74.621941330"
Sep 18 13:45:48.980099 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.980056    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:48.980290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.980144    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:48.989019 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:48.988994    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:49.057058 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.056996    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-645d58d866-6jw8s"]
Sep 18 13:45:49.063345 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.063322    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.067345 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.066541    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 18 13:45:49.067345 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.066850    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 18 13:45:49.067345 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.067037    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 18 13:45:49.067588 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.067396    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 18 13:45:49.067647 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.067631    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 18 13:45:49.070426 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.068644    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2kagvd8bvjcje\""
Sep 18 13:45:49.071100 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.070873    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ghbl8\""
Sep 18 13:45:49.087480 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.087455    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-645d58d866-6jw8s"]
Sep 18 13:45:49.098481 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.098450    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.098613 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.098501    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n4jw\" (UniqueName: \"kubernetes.io/projected/07876426-7422-4f9e-bd6d-fc2a967580cb-kube-api-access-8n4jw\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.098613 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.098591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-grpc-tls\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.098724 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.098622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-tls\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.098724 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.098652    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.098828 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.098734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.098828 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.098773    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07876426-7422-4f9e-bd6d-fc2a967580cb-metrics-client-ca\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.099293 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.099269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.200211 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.200152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-grpc-tls\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.200211 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.200205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-tls\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.200436 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.200231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.200436 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.200273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.200436 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.200297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07876426-7422-4f9e-bd6d-fc2a967580cb-metrics-client-ca\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.200436 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.200336    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.200436 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.200397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.200436 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.200426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n4jw\" (UniqueName: \"kubernetes.io/projected/07876426-7422-4f9e-bd6d-fc2a967580cb-kube-api-access-8n4jw\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.201530 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.201499    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07876426-7422-4f9e-bd6d-fc2a967580cb-metrics-client-ca\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.204165 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.203967    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.205514 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.205478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.206015 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.205994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-tls\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.206516 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.206479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-grpc-tls\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.207025 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.206984    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.209061 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.209020    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07876426-7422-4f9e-bd6d-fc2a967580cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.221804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.221772    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n4jw\" (UniqueName: \"kubernetes.io/projected/07876426-7422-4f9e-bd6d-fc2a967580cb-kube-api-access-8n4jw\") pod \"thanos-querier-645d58d866-6jw8s\" (UID: \"07876426-7422-4f9e-bd6d-fc2a967580cb\") " pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.378587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.378492    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:49.764962 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.764867    2575 generic.go:356] "Generic (PLEG): container finished" podID="6d9456b5-d539-4c30-ae70-68a116eefa1f" containerID="eca1bcee2f4d3c46c87a156800fe2160dcdc6d92c37c3a85e8a51096397a1009" exitCode=0
Sep 18 13:45:49.765144 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.764973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjvd2" event={"ID":"6d9456b5-d539-4c30-ae70-68a116eefa1f","Type":"ContainerDied","Data":"eca1bcee2f4d3c46c87a156800fe2160dcdc6d92c37c3a85e8a51096397a1009"}
Sep 18 13:45:49.773566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:49.770415    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:45:50.321186 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.321104    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-645d58d866-6jw8s"]
Sep 18 13:45:50.323716 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:50.323688    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07876426_7422_4f9e_bd6d_fc2a967580cb.slice/crio-364beb149a76f9162fa22b1ba59c8d2b7c3380cb1d8815510e25f26a84c94f18 WatchSource:0}: Error finding container 364beb149a76f9162fa22b1ba59c8d2b7c3380cb1d8815510e25f26a84c94f18: Status 404 returned error can't find the container with id 364beb149a76f9162fa22b1ba59c8d2b7c3380cb1d8815510e25f26a84c94f18
Sep 18 13:45:50.583345 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.583303    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5dfd679d6-dl2r8"]
Sep 18 13:45:50.585549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.585533    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.588629 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.588582    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 18 13:45:50.588779 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.588759    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 18 13:45:50.588841 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.588806    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 18 13:45:50.588884 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.588839    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-frh47\""
Sep 18 13:45:50.590068 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.590047    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7m5qbk2t3omv8\""
Sep 18 13:45:50.590068 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.590059    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 18 13:45:50.603193 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.603174    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dfd679d6-dl2r8"]
Sep 18 13:45:50.614393 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.614370    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.614521 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.614424    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-secret-metrics-server-tls\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.614521 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.614448    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-audit-log\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.614648 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.614522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-secret-metrics-server-client-certs\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.614648 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.614572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-client-ca-bundle\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.614648 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.614598    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-875x2\" (UniqueName: \"kubernetes.io/projected/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-kube-api-access-875x2\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.614747 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.614681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-metrics-server-audit-profiles\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.715901 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.715869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-client-ca-bundle\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.715901 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.715907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-875x2\" (UniqueName: \"kubernetes.io/projected/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-kube-api-access-875x2\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.716177 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.715938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-metrics-server-audit-profiles\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.716177 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.715993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.716177 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.716037    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-secret-metrics-server-tls\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.716177 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.716057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-audit-log\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.716177 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.716095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-secret-metrics-server-client-certs\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.716579 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.716552    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-audit-log\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.717320 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.717295    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.717443 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.717420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-metrics-server-audit-profiles\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.718590 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.718568    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-secret-metrics-server-client-certs\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.718675 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.718633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-secret-metrics-server-tls\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.718715 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.718678    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-client-ca-bundle\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.734068 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.734043    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-875x2\" (UniqueName: \"kubernetes.io/projected/b7adb34c-92db-4b15-b1c3-2e1e5a544af9-kube-api-access-875x2\") pod \"metrics-server-5dfd679d6-dl2r8\" (UID: \"b7adb34c-92db-4b15-b1c3-2e1e5a544af9\") " pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.756259 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.756234    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"]
Sep 18 13:45:50.760163 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.760126    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"
Sep 18 13:45:50.765596 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.765575    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 18 13:45:50.765695 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.765608    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pcvl6\""
Sep 18 13:45:50.774008 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.773986    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"]
Sep 18 13:45:50.774358 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.774325    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjvd2" event={"ID":"6d9456b5-d539-4c30-ae70-68a116eefa1f","Type":"ContainerStarted","Data":"a6be3f146bfe858af9ce7944a5438a2bfabc43ab5bc497b140fdf91c208c3f1b"}
Sep 18 13:45:50.774470 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.774371    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjvd2" event={"ID":"6d9456b5-d539-4c30-ae70-68a116eefa1f","Type":"ContainerStarted","Data":"db02480374f0eeaf9807da84b8c34062dbc9680553147a2ba1361bb876705c67"}
Sep 18 13:45:50.777276 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.777250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj" event={"ID":"84fe0d15-4629-45c2-985b-dc6b34898876","Type":"ContainerStarted","Data":"95e9bd22fbdaa25129eede43869ac56137ea69b2f1bd33f85beb593702dad469"}
Sep 18 13:45:50.777367 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.777304    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj" event={"ID":"84fe0d15-4629-45c2-985b-dc6b34898876","Type":"ContainerStarted","Data":"5c65075eb399111f43b715d751b1df526d7ae49a6c4e3a8d8bfd60da459d3615"}
Sep 18 13:45:50.777367 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.777344    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj" event={"ID":"84fe0d15-4629-45c2-985b-dc6b34898876","Type":"ContainerStarted","Data":"ca19a2037b44e7a94da975b8586bd5e52e342d27ea9a615662b2d83adff2e5a5"}
Sep 18 13:45:50.779288 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.779250    2575 generic.go:356] "Generic (PLEG): container finished" podID="45a089bd-9447-47ad-80ef-371e10c5b672" containerID="09b4a7615a6115f3c100b7da45023b3df62a75cd5168e8c0fe8d98b789fc736a" exitCode=0
Sep 18 13:45:50.779397 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.779329    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerDied","Data":"09b4a7615a6115f3c100b7da45023b3df62a75cd5168e8c0fe8d98b789fc736a"}
Sep 18 13:45:50.782420 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.782395    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc" event={"ID":"f5b1b1c6-1179-4b72-a9ac-02f8a52a3710","Type":"ContainerStarted","Data":"ff5b262c03f434726f781b3a659e834141235e06efa8a581fd7ba4f096bf41d0"}
Sep 18 13:45:50.784185 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.784161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s" event={"ID":"07876426-7422-4f9e-bd6d-fc2a967580cb","Type":"ContainerStarted","Data":"364beb149a76f9162fa22b1ba59c8d2b7c3380cb1d8815510e25f26a84c94f18"}
Sep 18 13:45:50.807800 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.807747    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5b8xc" podStartSLOduration=4.168530541 podStartE2EDuration="5.807728779s" totalImagesPullingTime="1.639198238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:50.806559025 +0000 UTC m=+76.642397739" watchObservedRunningTime="2026-09-18 13:45:50.807728779 +0000 UTC m=+76.643567493"
Sep 18 13:45:50.818098 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.818068    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e67a49b-b4d2-4850-9aa0-de7870b187b4-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-pmdsc\" (UID: \"9e67a49b-b4d2-4850-9aa0-de7870b187b4\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"
Sep 18 13:45:50.818441 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.818414    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdhm5\" (UniqueName: \"kubernetes.io/projected/9e67a49b-b4d2-4850-9aa0-de7870b187b4-kube-api-access-xdhm5\") pod \"monitoring-plugin-5984459ff8-pmdsc\" (UID: \"9e67a49b-b4d2-4850-9aa0-de7870b187b4\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"
Sep 18 13:45:50.838442 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.838359    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pjvd2" podStartSLOduration=3.948583649 podStartE2EDuration="4.838339082s" totalImagesPullingTime="812.789297ms" totalInitContainerRuntime="76.966136ms" isStatefulPod=true podCreationTimestamp="2026-09-18 13:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:50.836901612 +0000 UTC m=+76.672740365" watchObservedRunningTime="2026-09-18 13:45:50.838339082 +0000 UTC m=+76.674177797"
Sep 18 13:45:50.895945 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.895897    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:45:50.920006 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.919820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e67a49b-b4d2-4850-9aa0-de7870b187b4-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-pmdsc\" (UID: \"9e67a49b-b4d2-4850-9aa0-de7870b187b4\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"
Sep 18 13:45:50.920006 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.919889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdhm5\" (UniqueName: \"kubernetes.io/projected/9e67a49b-b4d2-4850-9aa0-de7870b187b4-kube-api-access-xdhm5\") pod \"monitoring-plugin-5984459ff8-pmdsc\" (UID: \"9e67a49b-b4d2-4850-9aa0-de7870b187b4\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"
Sep 18 13:45:50.920006 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:50.919948    2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 18 13:45:50.920295 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:45:50.920028    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e67a49b-b4d2-4850-9aa0-de7870b187b4-monitoring-plugin-cert podName:9e67a49b-b4d2-4850-9aa0-de7870b187b4 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:51.420008036 +0000 UTC m=+77.255846747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9e67a49b-b4d2-4850-9aa0-de7870b187b4-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-pmdsc" (UID: "9e67a49b-b4d2-4850-9aa0-de7870b187b4") : secret "monitoring-plugin-cert" not found
Sep 18 13:45:50.941164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.940860    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-b9wsj" podStartSLOduration=3.191275677 podStartE2EDuration="4.940842726s" totalImagesPullingTime="1.749567049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:50.880996697 +0000 UTC m=+76.716835413" watchObservedRunningTime="2026-09-18 13:45:50.940842726 +0000 UTC m=+76.776681439"
Sep 18 13:45:50.943529 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:50.943501    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdhm5\" (UniqueName: \"kubernetes.io/projected/9e67a49b-b4d2-4850-9aa0-de7870b187b4-kube-api-access-xdhm5\") pod \"monitoring-plugin-5984459ff8-pmdsc\" (UID: \"9e67a49b-b4d2-4850-9aa0-de7870b187b4\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"
Sep 18 13:45:51.189506 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.189468    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dfd679d6-dl2r8"]
Sep 18 13:45:51.192632 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:51.192602    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7adb34c_92db_4b15_b1c3_2e1e5a544af9.slice/crio-7bf2b3b70d1a1c68ebdb1d8033542fbcbc12fd580310da030bb264978852e603 WatchSource:0}: Error finding container 7bf2b3b70d1a1c68ebdb1d8033542fbcbc12fd580310da030bb264978852e603: Status 404 returned error can't find the container with id 7bf2b3b70d1a1c68ebdb1d8033542fbcbc12fd580310da030bb264978852e603
Sep 18 13:45:51.292438 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.292402    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"]
Sep 18 13:45:51.296015 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.295991    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.300381 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.300362    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 18 13:45:51.300681 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.300636    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 18 13:45:51.300798 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.300708    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 18 13:45:51.300798 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.300708    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 18 13:45:51.300901 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.300804    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ldhcw\""
Sep 18 13:45:51.300974 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.300956    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 18 13:45:51.307429 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.307412    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 18 13:45:51.315241 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.315218    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"]
Sep 18 13:45:51.424706 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.424638    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-telemeter-client-tls\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.425160 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.424746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-secret-telemeter-client\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.425160 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.424807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-federate-client-tls\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.425160 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.424892    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e67a49b-b4d2-4850-9aa0-de7870b187b4-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-pmdsc\" (UID: \"9e67a49b-b4d2-4850-9aa0-de7870b187b4\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"
Sep 18 13:45:51.425160 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.424966    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.425160 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.425008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45b8df18-47ac-48d3-9761-30b717efa8c8-serving-certs-ca-bundle\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.425160 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.425041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5czj\" (UniqueName: \"kubernetes.io/projected/45b8df18-47ac-48d3-9761-30b717efa8c8-kube-api-access-m5czj\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.425160 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.425086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45b8df18-47ac-48d3-9761-30b717efa8c8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.425486 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.425206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45b8df18-47ac-48d3-9761-30b717efa8c8-metrics-client-ca\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.427947 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.427923    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e67a49b-b4d2-4850-9aa0-de7870b187b4-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-pmdsc\" (UID: \"9e67a49b-b4d2-4850-9aa0-de7870b187b4\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"
Sep 18 13:45:51.526195 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.526087    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-secret-telemeter-client\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.526195 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.526160    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-federate-client-tls\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.526418 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.526208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.526418 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.526241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45b8df18-47ac-48d3-9761-30b717efa8c8-serving-certs-ca-bundle\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.526418 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.526264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5czj\" (UniqueName: \"kubernetes.io/projected/45b8df18-47ac-48d3-9761-30b717efa8c8-kube-api-access-m5czj\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.526418 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.526290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45b8df18-47ac-48d3-9761-30b717efa8c8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.526418 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.526323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45b8df18-47ac-48d3-9761-30b717efa8c8-metrics-client-ca\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.526418 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.526343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-telemeter-client-tls\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.527387 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.527333    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45b8df18-47ac-48d3-9761-30b717efa8c8-serving-certs-ca-bundle\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.527517 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.527487    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45b8df18-47ac-48d3-9761-30b717efa8c8-metrics-client-ca\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.528315 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.528016    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45b8df18-47ac-48d3-9761-30b717efa8c8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.529492 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.529450    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.529625 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.529599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-secret-telemeter-client\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.530076 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.530047    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-telemeter-client-tls\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.530451 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.530427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45b8df18-47ac-48d3-9761-30b717efa8c8-federate-client-tls\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.537670 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.537648    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5czj\" (UniqueName: \"kubernetes.io/projected/45b8df18-47ac-48d3-9761-30b717efa8c8-kube-api-access-m5czj\") pod \"telemeter-client-6c9556f9bc-tltk6\" (UID: \"45b8df18-47ac-48d3-9761-30b717efa8c8\") " pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.605640 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.605601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"
Sep 18 13:45:51.672756 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.671457    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"
Sep 18 13:45:51.791486 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.791389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8" event={"ID":"b7adb34c-92db-4b15-b1c3-2e1e5a544af9","Type":"ContainerStarted","Data":"7bf2b3b70d1a1c68ebdb1d8033542fbcbc12fd580310da030bb264978852e603"}
Sep 18 13:45:51.897993 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:51.897647    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c9556f9bc-tltk6"]
Sep 18 13:45:52.142380 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.142252    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b47cf6fd9-g5g4g"]
Sep 18 13:45:52.178201 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.176407    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75fbb8fbf8-nn99s"]
Sep 18 13:45:52.181611 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.181584    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.190864 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.190837    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75fbb8fbf8-nn99s"]
Sep 18 13:45:52.233056 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.233010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-serving-cert\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.233292 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.233072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-oauth-serving-cert\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.233292 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.233102    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-trusted-ca-bundle\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.233292 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.233162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29txk\" (UniqueName: \"kubernetes.io/projected/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-kube-api-access-29txk\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.233292 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.233204    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-oauth-config\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.233292 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.233230    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-service-ca\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.233570 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.233305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-config\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.305853 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.305704    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:45:52.309648 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.309625    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.313046 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.313016    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 18 13:45:52.315450 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.315424    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 18 13:45:52.315450 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.315455    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 18 13:45:52.315632 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.315477    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 18 13:45:52.315632 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.315486    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 18 13:45:52.315632 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.315508    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 18 13:45:52.315632 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.315600    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 18 13:45:52.315632 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.315631    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 18 13:45:52.315951 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.315932    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 18 13:45:52.316026 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.315979    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 18 13:45:52.316110 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.316092    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 18 13:45:52.316300 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.316283    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rngj4\""
Sep 18 13:45:52.316436 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.316355    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3k39dho4qmosk\""
Sep 18 13:45:52.316436 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.316355    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 18 13:45:52.316820 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.316791    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 18 13:45:52.320681 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.320655    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 18 13:45:52.332568 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.332537    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:45:52.334694 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.334666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-config\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.334834 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.334741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-serving-cert\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.334834 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.334776    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-oauth-serving-cert\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.334834 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.334807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-trusted-ca-bundle\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.334978 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.334844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29txk\" (UniqueName: \"kubernetes.io/projected/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-kube-api-access-29txk\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.334978 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.334884    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-oauth-config\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.334978 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.334907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-service-ca\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.335762 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.335732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-service-ca\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.335954 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.335911    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-oauth-serving-cert\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.336120 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.336097    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-config\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.336643 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.336619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-trusted-ca-bundle\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.338375 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.338349    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-serving-cert\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.338579 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.338547    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-oauth-config\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.353356 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.353311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29txk\" (UniqueName: \"kubernetes.io/projected/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-kube-api-access-29txk\") pod \"console-75fbb8fbf8-nn99s\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") " pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.387149 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:52.387097    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b8df18_47ac_48d3_9761_30b717efa8c8.slice/crio-3e1375e74a1e9bc7722668beba58ac31377e817e95c182b78fb61c2a873fc77c WatchSource:0}: Error finding container 3e1375e74a1e9bc7722668beba58ac31377e817e95c182b78fb61c2a873fc77c: Status 404 returned error can't find the container with id 3e1375e74a1e9bc7722668beba58ac31377e817e95c182b78fb61c2a873fc77c
Sep 18 13:45:52.435737 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.435706    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.435737 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.435748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.435767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.435788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.435825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.435845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.435865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.435883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.435954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.435990    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9v6\" (UniqueName: \"kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-kube-api-access-4q9v6\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.436024    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.436079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.436151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.436172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.436192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.436209    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.436231    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.436270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.436258    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.437087 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.436289    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.437087 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.436331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.496719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.496684    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:45:52.537782 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.537734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.537782 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.537785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9v6\" (UniqueName: \"kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-kube-api-access-4q9v6\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538014 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.537829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538014 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.537857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538014 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.537899    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538014 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.537924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538014 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.537959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538014 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.537985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538014 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538010    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538167    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538209    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538254    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538345    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538383 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538919 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538701    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.538919 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538797    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.539019 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.538944    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.539440 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.539301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.539961 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.539930    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.542025 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.541577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.542025 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.541970    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.545587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.545530    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.547501 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.545937    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.547501 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.546612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.547501 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.546883    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.547501 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.546965    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.547501 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.547413    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.547501 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.547431    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.547501 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.547457    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.547924 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.547831    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.548504 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.548402    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.548504 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.548455    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.548633 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.548560    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.549001 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.548982    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9v6\" (UniqueName: \"kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-kube-api-access-4q9v6\") pod \"prometheus-k8s-0\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.625054 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.625010    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:45:52.799424 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:52.799389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6" event={"ID":"45b8df18-47ac-48d3-9761-30b717efa8c8","Type":"ContainerStarted","Data":"3e1375e74a1e9bc7722668beba58ac31377e817e95c182b78fb61c2a873fc77c"}
Sep 18 13:45:53.506699 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.506468    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75fbb8fbf8-nn99s"]
Sep 18 13:45:53.510892 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:53.510681    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e51afc9_6c40_4b89_9e9e_47081dd2d0b0.slice/crio-c2ad91424c7f7d82b3e63c866c7e27cd06e0b9ccfe2f39bb162f5c8d055da9d3 WatchSource:0}: Error finding container c2ad91424c7f7d82b3e63c866c7e27cd06e0b9ccfe2f39bb162f5c8d055da9d3: Status 404 returned error can't find the container with id c2ad91424c7f7d82b3e63c866c7e27cd06e0b9ccfe2f39bb162f5c8d055da9d3
Sep 18 13:45:53.519852 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.519826    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"]
Sep 18 13:45:53.525827 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:53.525793    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e67a49b_b4d2_4850_9aa0_de7870b187b4.slice/crio-6b7e6b0eb1e1f7277df17e35c4228a9661d7f67f3e1c4ef7e8f44000a1b379ff WatchSource:0}: Error finding container 6b7e6b0eb1e1f7277df17e35c4228a9661d7f67f3e1c4ef7e8f44000a1b379ff: Status 404 returned error can't find the container with id 6b7e6b0eb1e1f7277df17e35c4228a9661d7f67f3e1c4ef7e8f44000a1b379ff
Sep 18 13:45:53.529021 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.529001    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:45:53.534083 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:45:53.533740    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff1e93a_09f6_4e0e_bb7c_08f4a5e56746.slice/crio-63d200d86821c0cc58138acb61b6f6bce9ce18362a776723dc163347b5901693 WatchSource:0}: Error finding container 63d200d86821c0cc58138acb61b6f6bce9ce18362a776723dc163347b5901693: Status 404 returned error can't find the container with id 63d200d86821c0cc58138acb61b6f6bce9ce18362a776723dc163347b5901693
Sep 18 13:45:53.810884 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.810787    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8" event={"ID":"b7adb34c-92db-4b15-b1c3-2e1e5a544af9","Type":"ContainerStarted","Data":"bc48675ca4adb6947b0e01e50e5c294dd94a33c68308f052d6ed9f7d1779e6db"}
Sep 18 13:45:53.813690 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.813532    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s" event={"ID":"07876426-7422-4f9e-bd6d-fc2a967580cb","Type":"ContainerStarted","Data":"cbfee97cc29953a70bae92ef649147fe162bfead876e5ba6731cedd6eea6803c"}
Sep 18 13:45:53.813690 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.813601    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s" event={"ID":"07876426-7422-4f9e-bd6d-fc2a967580cb","Type":"ContainerStarted","Data":"38668765d9b46d28cbf1931b433920c06132541837cfae0058e72d77ecac23a4"}
Sep 18 13:45:53.813690 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.813642    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s" event={"ID":"07876426-7422-4f9e-bd6d-fc2a967580cb","Type":"ContainerStarted","Data":"b67b12a621b4856209b667ca603ba18f2d650f77892f6302846ee5b94724dfad"}
Sep 18 13:45:53.815221 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.815159    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc" event={"ID":"9e67a49b-b4d2-4850-9aa0-de7870b187b4","Type":"ContainerStarted","Data":"6b7e6b0eb1e1f7277df17e35c4228a9661d7f67f3e1c4ef7e8f44000a1b379ff"}
Sep 18 13:45:53.817290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.817180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75fbb8fbf8-nn99s" event={"ID":"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0","Type":"ContainerStarted","Data":"a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e"}
Sep 18 13:45:53.817290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.817234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75fbb8fbf8-nn99s" event={"ID":"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0","Type":"ContainerStarted","Data":"c2ad91424c7f7d82b3e63c866c7e27cd06e0b9ccfe2f39bb162f5c8d055da9d3"}
Sep 18 13:45:53.819435 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.819314    2575 generic.go:356] "Generic (PLEG): container finished" podID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerID="269a5c909873ddb2b4be9cc33d1e577d3088e44f670a786a8be86f9458513ebd" exitCode=0
Sep 18 13:45:53.819435 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.819347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerDied","Data":"269a5c909873ddb2b4be9cc33d1e577d3088e44f670a786a8be86f9458513ebd"}
Sep 18 13:45:53.819564 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.819438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerStarted","Data":"63d200d86821c0cc58138acb61b6f6bce9ce18362a776723dc163347b5901693"}
Sep 18 13:45:53.824362 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.824336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerStarted","Data":"f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13"}
Sep 18 13:45:53.824464 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.824408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerStarted","Data":"2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e"}
Sep 18 13:45:53.824464 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.824460    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerStarted","Data":"b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2"}
Sep 18 13:45:53.824572 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.824504    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerStarted","Data":"191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4"}
Sep 18 13:45:53.824572 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.824545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerStarted","Data":"ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb"}
Sep 18 13:45:53.835145 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.835081    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8" podStartSLOduration=1.812048067 podStartE2EDuration="3.835061771s" totalImagesPullingTime="2.023013704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:53.833212656 +0000 UTC m=+79.669051369" watchObservedRunningTime="2026-09-18 13:45:53.835061771 +0000 UTC m=+79.670900479"
Sep 18 13:45:53.854290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:53.854242    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75fbb8fbf8-nn99s" podStartSLOduration=1.854223526 podStartE2EDuration="1.854223526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:53.852885358 +0000 UTC m=+79.688724072" watchObservedRunningTime="2026-09-18 13:45:53.854223526 +0000 UTC m=+79.690062240"
Sep 18 13:45:54.042542 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:54.042461    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:45:55.839072 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.839030    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerStarted","Data":"d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72"}
Sep 18 13:45:55.841926 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.841897    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6" event={"ID":"45b8df18-47ac-48d3-9761-30b717efa8c8","Type":"ContainerStarted","Data":"7c9614d521bfbddc718da0187e67c8d1b5f91269e06474b2142648a7e533c783"}
Sep 18 13:45:55.842109 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.842093    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6" event={"ID":"45b8df18-47ac-48d3-9761-30b717efa8c8","Type":"ContainerStarted","Data":"37d75a169acd4f556534bcc364ded428bc0f380a80b2238a8c10807d6fc2daec"}
Sep 18 13:45:55.842269 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.842243    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6" event={"ID":"45b8df18-47ac-48d3-9761-30b717efa8c8","Type":"ContainerStarted","Data":"d0064c2edfd0f7063b449852a0e61e016d059ebaf1b41e9ae564fe4d6d928a7f"}
Sep 18 13:45:55.845534 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.845511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s" event={"ID":"07876426-7422-4f9e-bd6d-fc2a967580cb","Type":"ContainerStarted","Data":"bd6141ee8280f3073d5e91411f184b4c390bd1a40a4ad7fde41428a4dae730d1"}
Sep 18 13:45:55.845627 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.845586    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s" event={"ID":"07876426-7422-4f9e-bd6d-fc2a967580cb","Type":"ContainerStarted","Data":"99a40d7ff6a154615361a9942433234dd29570bb888d2819e7026eef114126f0"}
Sep 18 13:45:55.845699 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.845638    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:45:55.845699 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.845678    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s" event={"ID":"07876426-7422-4f9e-bd6d-fc2a967580cb","Type":"ContainerStarted","Data":"3fca0842b965b0f6f2e6323de17d3d09dd83000d312eda30b04d846121c42e0e"}
Sep 18 13:45:55.847601 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.847578    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc" event={"ID":"9e67a49b-b4d2-4850-9aa0-de7870b187b4","Type":"ContainerStarted","Data":"10adef17aad741dada0fffc6a2499ad47fb220d971813b7d2931b9849bc204ba"}
Sep 18 13:45:55.847796 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.847752    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"
Sep 18 13:45:55.853304 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.853275    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc"
Sep 18 13:45:55.872660 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.871774    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.142063925 podStartE2EDuration="9.871747475s" totalImagesPullingTime="5.710962587s" totalInitContainerRuntime="18.720963ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:55.870659521 +0000 UTC m=+81.706498273" watchObservedRunningTime="2026-09-18 13:45:55.871747475 +0000 UTC m=+81.707586188"
Sep 18 13:45:55.896317 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.896258    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s" podStartSLOduration=2.299193599 podStartE2EDuration="6.896236141s" totalImagesPullingTime="4.597042542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:55.894200465 +0000 UTC m=+81.730039183" watchObservedRunningTime="2026-09-18 13:45:55.896236141 +0000 UTC m=+81.732074854"
Sep 18 13:45:55.912295 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.912216    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-pmdsc" podStartSLOduration=4.185300894 podStartE2EDuration="5.912195142s" totalImagesPullingTime="1.726894248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:55.910807298 +0000 UTC m=+81.746646010" watchObservedRunningTime="2026-09-18 13:45:55.912195142 +0000 UTC m=+81.748033855"
Sep 18 13:45:55.938634 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:55.938578    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c9556f9bc-tltk6" podStartSLOduration=2.07526512 podStartE2EDuration="4.938560673s" totalImagesPullingTime="2.863295553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:55.935111379 +0000 UTC m=+81.770950090" watchObservedRunningTime="2026-09-18 13:45:55.938560673 +0000 UTC m=+81.774399385"
Sep 18 13:45:56.049734 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:56.049694    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75fbb8fbf8-nn99s"]
Sep 18 13:45:57.867041 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:57.866968    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerStarted","Data":"be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29"}
Sep 18 13:45:57.867484 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:57.867067    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerStarted","Data":"ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c"}
Sep 18 13:45:57.867484 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:57.867095    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerStarted","Data":"9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0"}
Sep 18 13:45:58.874646 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:58.874615    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerStarted","Data":"05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4"}
Sep 18 13:45:58.874998 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:58.874677    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerStarted","Data":"a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46"}
Sep 18 13:45:58.874998 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:45:58.874703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerStarted","Data":"f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c"}
Sep 18 13:46:01.864698 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:01.864669    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-645d58d866-6jw8s"
Sep 18 13:46:01.894080 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:01.894018    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.071043796 podStartE2EDuration="9.89399894s" totalImagesPullingTime="3.797279688s" totalInitContainerRuntime="25.675456ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:58.921365543 +0000 UTC m=+84.757204281" watchObservedRunningTime="2026-09-18 13:46:01.89399894 +0000 UTC m=+87.729837693"
Sep 18 13:46:02.497467 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:02.497432    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:46:02.625277 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:02.625239    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:06.728336 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:06.728299    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7fdc8c47-stnb7"]
Sep 18 13:46:10.896274 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:10.896208    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:46:10.896763 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:10.896406    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:46:17.167680 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.167609    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b47cf6fd9-g5g4g" podUID="d7b32355-9321-4e8f-b827-c045966c21c8" containerName="console" containerID="cri-o://55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4" gracePeriod=15
Sep 18 13:46:17.451754 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.451721    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:46:17.490573 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.490542    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-oauth-serving-cert\") pod \"d7b32355-9321-4e8f-b827-c045966c21c8\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") "
Sep 18 13:46:17.490735 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.490586    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-console-config\") pod \"d7b32355-9321-4e8f-b827-c045966c21c8\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") "
Sep 18 13:46:17.490735 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.490612    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-oauth-config\") pod \"d7b32355-9321-4e8f-b827-c045966c21c8\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") "
Sep 18 13:46:17.490735 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.490629    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-service-ca\") pod \"d7b32355-9321-4e8f-b827-c045966c21c8\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") "
Sep 18 13:46:17.490735 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.490676    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-serving-cert\") pod \"d7b32355-9321-4e8f-b827-c045966c21c8\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") "
Sep 18 13:46:17.490735 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.490709    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xtp5\" (UniqueName: \"kubernetes.io/projected/d7b32355-9321-4e8f-b827-c045966c21c8-kube-api-access-5xtp5\") pod \"d7b32355-9321-4e8f-b827-c045966c21c8\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") "
Sep 18 13:46:17.490994 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.490778    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-trusted-ca-bundle\") pod \"d7b32355-9321-4e8f-b827-c045966c21c8\" (UID: \"d7b32355-9321-4e8f-b827-c045966c21c8\") "
Sep 18 13:46:17.490994 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.490928    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7b32355-9321-4e8f-b827-c045966c21c8" (UID: "d7b32355-9321-4e8f-b827-c045966c21c8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:17.490994 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.490982    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-console-config" (OuterVolumeSpecName: "console-config") pod "d7b32355-9321-4e8f-b827-c045966c21c8" (UID: "d7b32355-9321-4e8f-b827-c045966c21c8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:17.491184 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.491078    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-oauth-serving-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:17.491184 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.491103    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7b32355-9321-4e8f-b827-c045966c21c8" (UID: "d7b32355-9321-4e8f-b827-c045966c21c8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:17.491335 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.491309    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7b32355-9321-4e8f-b827-c045966c21c8" (UID: "d7b32355-9321-4e8f-b827-c045966c21c8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:17.493167 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.493116    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7b32355-9321-4e8f-b827-c045966c21c8" (UID: "d7b32355-9321-4e8f-b827-c045966c21c8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:46:17.493343 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.493323    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7b32355-9321-4e8f-b827-c045966c21c8" (UID: "d7b32355-9321-4e8f-b827-c045966c21c8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:46:17.493402 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.493323    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7b32355-9321-4e8f-b827-c045966c21c8-kube-api-access-5xtp5" (OuterVolumeSpecName: "kube-api-access-5xtp5") pod "d7b32355-9321-4e8f-b827-c045966c21c8" (UID: "d7b32355-9321-4e8f-b827-c045966c21c8"). InnerVolumeSpecName "kube-api-access-5xtp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:46:17.591586 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.591542    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-trusted-ca-bundle\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:17.591586 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.591575    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-console-config\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:17.591586 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.591585    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-oauth-config\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:17.591586 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.591593    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b32355-9321-4e8f-b827-c045966c21c8-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:17.591933 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.591625    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7b32355-9321-4e8f-b827-c045966c21c8-console-serving-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:17.591933 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.591636    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xtp5\" (UniqueName: \"kubernetes.io/projected/d7b32355-9321-4e8f-b827-c045966c21c8-kube-api-access-5xtp5\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:17.956059 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.956023    2575 generic.go:356] "Generic (PLEG): container finished" podID="d7b32355-9321-4e8f-b827-c045966c21c8" containerID="55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4" exitCode=0
Sep 18 13:46:17.956242 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.956073    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b47cf6fd9-g5g4g"
Sep 18 13:46:17.956242 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.956113    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b47cf6fd9-g5g4g" event={"ID":"d7b32355-9321-4e8f-b827-c045966c21c8","Type":"ContainerDied","Data":"55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4"}
Sep 18 13:46:17.956242 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.956181    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b47cf6fd9-g5g4g" event={"ID":"d7b32355-9321-4e8f-b827-c045966c21c8","Type":"ContainerDied","Data":"4b9664d32abadafb0c659383d80df0d34ec826b76fe926358bf2975d1d7c654d"}
Sep 18 13:46:17.956242 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.956204    2575 scope.go:117] "RemoveContainer" containerID="55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4"
Sep 18 13:46:17.965849 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.965834    2575 scope.go:117] "RemoveContainer" containerID="55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4"
Sep 18 13:46:17.966179 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:46:17.966155    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4\": container with ID starting with 55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4 not found: ID does not exist" containerID="55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4"
Sep 18 13:46:17.966231 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.966191    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4"} err="failed to get container status \"55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4\": rpc error: code = NotFound desc = could not find container \"55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4\": container with ID starting with 55df6668e5c7b3e90d17981f6037fac8831898687fd1eaf2ae2cdd917928e5e4 not found: ID does not exist"
Sep 18 13:46:17.980688 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.980661    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b47cf6fd9-g5g4g"]
Sep 18 13:46:17.984521 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:17.984497    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b47cf6fd9-g5g4g"]
Sep 18 13:46:18.292226 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:18.292151    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7b32355-9321-4e8f-b827-c045966c21c8" path="/var/lib/kubelet/pods/d7b32355-9321-4e8f-b827-c045966c21c8/volumes"
Sep 18 13:46:19.768049 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:19.768018    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5tmw4"
Sep 18 13:46:21.072606 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.072565    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75fbb8fbf8-nn99s" podUID="6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" containerName="console" containerID="cri-o://a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e" gracePeriod=15
Sep 18 13:46:21.339597 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.339528    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:46:21.428916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.428873    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-config\") pod \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") "
Sep 18 13:46:21.428916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.428919    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-trusted-ca-bundle\") pod \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") "
Sep 18 13:46:21.429178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.428948    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-serving-cert\") pod \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") "
Sep 18 13:46:21.429178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.428966    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-oauth-serving-cert\") pod \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") "
Sep 18 13:46:21.429178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.428996    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-oauth-config\") pod \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") "
Sep 18 13:46:21.429178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.429031    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-service-ca\") pod \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") "
Sep 18 13:46:21.429178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.429065    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29txk\" (UniqueName: \"kubernetes.io/projected/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-kube-api-access-29txk\") pod \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\" (UID: \"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0\") "
Sep 18 13:46:21.429431 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.429391    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-config" (OuterVolumeSpecName: "console-config") pod "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" (UID: "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:21.429561 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.429538    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" (UID: "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:21.429615 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.429593    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" (UID: "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:21.429670 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.429589    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" (UID: "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:21.431290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.431262    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" (UID: "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:46:21.431290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.431277    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" (UID: "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:46:21.431420 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.431385    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-kube-api-access-29txk" (OuterVolumeSpecName: "kube-api-access-29txk") pod "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" (UID: "6e51afc9-6c40-4b89-9e9e-47081dd2d0b0"). InnerVolumeSpecName "kube-api-access-29txk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:46:21.530738 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.530703    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-serving-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:21.530738 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.530730    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-oauth-serving-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:21.530738 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.530738    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-oauth-config\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:21.530738 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.530747    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:21.530984 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.530756    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29txk\" (UniqueName: \"kubernetes.io/projected/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-kube-api-access-29txk\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:21.530984 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.530764    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-console-config\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:21.530984 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.530773    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0-trusted-ca-bundle\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:21.974760 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.974724    2575 generic.go:356] "Generic (PLEG): container finished" podID="6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" containerID="a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e" exitCode=0
Sep 18 13:46:21.974970 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.974776    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75fbb8fbf8-nn99s"
Sep 18 13:46:21.974970 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.974781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75fbb8fbf8-nn99s" event={"ID":"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0","Type":"ContainerDied","Data":"a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e"}
Sep 18 13:46:21.974970 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.974900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75fbb8fbf8-nn99s" event={"ID":"6e51afc9-6c40-4b89-9e9e-47081dd2d0b0","Type":"ContainerDied","Data":"c2ad91424c7f7d82b3e63c866c7e27cd06e0b9ccfe2f39bb162f5c8d055da9d3"}
Sep 18 13:46:21.974970 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.974924    2575 scope.go:117] "RemoveContainer" containerID="a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e"
Sep 18 13:46:21.985582 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.985550    2575 scope.go:117] "RemoveContainer" containerID="a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e"
Sep 18 13:46:21.985946 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:46:21.985926    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e\": container with ID starting with a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e not found: ID does not exist" containerID="a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e"
Sep 18 13:46:21.986001 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.985955    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e"} err="failed to get container status \"a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e\": rpc error: code = NotFound desc = could not find container \"a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e\": container with ID starting with a8b348ca421a0bcbd5e9d4ec41a6c074a2b303532e8afbe7d15b099f0581168e not found: ID does not exist"
Sep 18 13:46:21.998109 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:21.998077    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75fbb8fbf8-nn99s"]
Sep 18 13:46:22.001276 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:22.001254    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75fbb8fbf8-nn99s"]
Sep 18 13:46:22.291904 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:22.291829    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" path="/var/lib/kubelet/pods/6e51afc9-6c40-4b89-9e9e-47081dd2d0b0/volumes"
Sep 18 13:46:30.901353 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:30.901325    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:46:30.905092 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:30.905066    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5dfd679d6-dl2r8"
Sep 18 13:46:31.747806 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:31.747734    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b7fdc8c47-stnb7" podUID="d7e5a544-ddea-4622-a338-ed05a2e5ec7c" containerName="console" containerID="cri-o://e29753f1550546ece0072306a154ddb6cf728ba0fb49cefd0d09f627c5ed95f5" gracePeriod=15
Sep 18 13:46:32.018793 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.018764    2575 generic.go:356] "Generic (PLEG): container finished" podID="d7e5a544-ddea-4622-a338-ed05a2e5ec7c" containerID="e29753f1550546ece0072306a154ddb6cf728ba0fb49cefd0d09f627c5ed95f5" exitCode=0
Sep 18 13:46:32.019102 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.018820    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7fdc8c47-stnb7" event={"ID":"d7e5a544-ddea-4622-a338-ed05a2e5ec7c","Type":"ContainerDied","Data":"e29753f1550546ece0072306a154ddb6cf728ba0fb49cefd0d09f627c5ed95f5"}
Sep 18 13:46:32.019102 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.018855    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7fdc8c47-stnb7" event={"ID":"d7e5a544-ddea-4622-a338-ed05a2e5ec7c","Type":"ContainerDied","Data":"3d25a003d187475db8a4d62fc14b40c280ead800bd927f47b497427feb8886c5"}
Sep 18 13:46:32.019102 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.018869    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d25a003d187475db8a4d62fc14b40c280ead800bd927f47b497427feb8886c5"
Sep 18 13:46:32.038633 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.038601    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:46:32.131314 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.131269    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-oauth-config\") pod \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") "
Sep 18 13:46:32.131489 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.131357    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-serving-cert\") pod \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") "
Sep 18 13:46:32.131489 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.131444    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-service-ca\") pod \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") "
Sep 18 13:46:32.131576 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.131506    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-config\") pod \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") "
Sep 18 13:46:32.131576 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.131543    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzd26\" (UniqueName: \"kubernetes.io/projected/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-kube-api-access-pzd26\") pod \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") "
Sep 18 13:46:32.131576 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.131563    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-oauth-serving-cert\") pod \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\" (UID: \"d7e5a544-ddea-4622-a338-ed05a2e5ec7c\") "
Sep 18 13:46:32.131925 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.131879    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7e5a544-ddea-4622-a338-ed05a2e5ec7c" (UID: "d7e5a544-ddea-4622-a338-ed05a2e5ec7c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:32.132053 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.131962    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-config" (OuterVolumeSpecName: "console-config") pod "d7e5a544-ddea-4622-a338-ed05a2e5ec7c" (UID: "d7e5a544-ddea-4622-a338-ed05a2e5ec7c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:32.132107 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.132056    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7e5a544-ddea-4622-a338-ed05a2e5ec7c" (UID: "d7e5a544-ddea-4622-a338-ed05a2e5ec7c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:32.133694 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.133671    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7e5a544-ddea-4622-a338-ed05a2e5ec7c" (UID: "d7e5a544-ddea-4622-a338-ed05a2e5ec7c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:46:32.134108 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.134083    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7e5a544-ddea-4622-a338-ed05a2e5ec7c" (UID: "d7e5a544-ddea-4622-a338-ed05a2e5ec7c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:46:32.134185 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.134092    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-kube-api-access-pzd26" (OuterVolumeSpecName: "kube-api-access-pzd26") pod "d7e5a544-ddea-4622-a338-ed05a2e5ec7c" (UID: "d7e5a544-ddea-4622-a338-ed05a2e5ec7c"). InnerVolumeSpecName "kube-api-access-pzd26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:46:32.232586 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.232550    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzd26\" (UniqueName: \"kubernetes.io/projected/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-kube-api-access-pzd26\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.232586 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.232579    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-oauth-serving-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.232586 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.232590    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-oauth-config\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.232815 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.232598    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-serving-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.232815 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.232607    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.232815 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:32.232614    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7e5a544-ddea-4622-a338-ed05a2e5ec7c-console-config\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:46:33.023060 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:33.023030    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7fdc8c47-stnb7"
Sep 18 13:46:33.040746 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:33.040715    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7fdc8c47-stnb7"]
Sep 18 13:46:33.043892 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:33.043872    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b7fdc8c47-stnb7"]
Sep 18 13:46:34.290999 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:34.290965    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7e5a544-ddea-4622-a338-ed05a2e5ec7c" path="/var/lib/kubelet/pods/d7e5a544-ddea-4622-a338-ed05a2e5ec7c/volumes"
Sep 18 13:46:52.625456 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:52.625412    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:52.646677 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:52.646641    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:53.132372 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:46:53.132339    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:06.408932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:06.408896    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:06.409359 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:06.409224    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="alertmanager" containerID="cri-o://ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb" gracePeriod=120
Sep 18 13:47:06.409359 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:06.409264    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy-metric" containerID="cri-o://f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13" gracePeriod=120
Sep 18 13:47:06.409359 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:06.409296    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy-web" containerID="cri-o://b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2" gracePeriod=120
Sep 18 13:47:06.409359 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:06.409294    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="config-reloader" containerID="cri-o://191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4" gracePeriod=120
Sep 18 13:47:06.409567 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:06.409337    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="prom-label-proxy" containerID="cri-o://d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72" gracePeriod=120
Sep 18 13:47:06.409567 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:06.409403    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy" containerID="cri-o://2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e" gracePeriod=120
Sep 18 13:47:07.176961 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.176931    2575 generic.go:356] "Generic (PLEG): container finished" podID="45a089bd-9447-47ad-80ef-371e10c5b672" containerID="d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72" exitCode=0
Sep 18 13:47:07.176961 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.176953    2575 generic.go:356] "Generic (PLEG): container finished" podID="45a089bd-9447-47ad-80ef-371e10c5b672" containerID="f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13" exitCode=0
Sep 18 13:47:07.176961 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.176959    2575 generic.go:356] "Generic (PLEG): container finished" podID="45a089bd-9447-47ad-80ef-371e10c5b672" containerID="2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e" exitCode=0
Sep 18 13:47:07.176961 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.176965    2575 generic.go:356] "Generic (PLEG): container finished" podID="45a089bd-9447-47ad-80ef-371e10c5b672" containerID="191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4" exitCode=0
Sep 18 13:47:07.176961 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.176970    2575 generic.go:356] "Generic (PLEG): container finished" podID="45a089bd-9447-47ad-80ef-371e10c5b672" containerID="ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb" exitCode=0
Sep 18 13:47:07.177360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.177008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerDied","Data":"d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72"}
Sep 18 13:47:07.177360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.177090    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerDied","Data":"f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13"}
Sep 18 13:47:07.177360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.177155    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerDied","Data":"2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e"}
Sep 18 13:47:07.177360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.177210    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerDied","Data":"191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4"}
Sep 18 13:47:07.177360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.177250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerDied","Data":"ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb"}
Sep 18 13:47:07.651876 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.651854    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:07.738145 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738058    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxsk9\" (UniqueName: \"kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-kube-api-access-jxsk9\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738145 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738097    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-config-out\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738145 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738119    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-main-tls\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738422 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738151    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-main-db\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738422 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738177    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-config-volume\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738422 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738207    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738422 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738233    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-web-config\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738422 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738273    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-metrics-client-ca\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738422 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738301    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-metric\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738422 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738327    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-cluster-tls-config\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738422 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738368    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-trusted-ca-bundle\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738422 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738423    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-tls-assets\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738867 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738471    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-web\") pod \"45a089bd-9447-47ad-80ef-371e10c5b672\" (UID: \"45a089bd-9447-47ad-80ef-371e10c5b672\") "
Sep 18 13:47:07.738867 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.738836    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:47:07.739564 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.739262    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:07.739914 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.739877    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:07.741442 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.741401    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:07.742491 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.742455    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-config-volume" (OuterVolumeSpecName: "config-volume") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:07.742491 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.742468    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-kube-api-access-jxsk9" (OuterVolumeSpecName: "kube-api-access-jxsk9") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "kube-api-access-jxsk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:47:07.742491 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.742469    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-config-out" (OuterVolumeSpecName: "config-out") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:47:07.742865 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.742799    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:07.742970 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.742945    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:07.743148 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.743109    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:47:07.743246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.743172    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:07.748061 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.748038    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:07.754646 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.754622    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-web-config" (OuterVolumeSpecName: "web-config") pod "45a089bd-9447-47ad-80ef-371e10c5b672" (UID: "45a089bd-9447-47ad-80ef-371e10c5b672"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:07.839731 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839704    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-web-config\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839731 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839726    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-metrics-client-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839737    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839747    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-cluster-tls-config\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839756    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839765    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-tls-assets\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839773    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839781    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxsk9\" (UniqueName: \"kubernetes.io/projected/45a089bd-9447-47ad-80ef-371e10c5b672-kube-api-access-jxsk9\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839801    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-config-out\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839809    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-main-tls\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839817    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45a089bd-9447-47ad-80ef-371e10c5b672-alertmanager-main-db\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839825    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:07.839875 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:07.839833    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45a089bd-9447-47ad-80ef-371e10c5b672-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:08.188394 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.188358    2575 generic.go:356] "Generic (PLEG): container finished" podID="45a089bd-9447-47ad-80ef-371e10c5b672" containerID="b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2" exitCode=0
Sep 18 13:47:08.188640 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.188407    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerDied","Data":"b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2"}
Sep 18 13:47:08.188640 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.188460    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.188640 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.188483    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45a089bd-9447-47ad-80ef-371e10c5b672","Type":"ContainerDied","Data":"eb9dab43fbf1021713a7e097a82977af67cbeccb915f10177a5746006b93bfaf"}
Sep 18 13:47:08.188640 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.188516    2575 scope.go:117] "RemoveContainer" containerID="d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72"
Sep 18 13:47:08.196439 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.196423    2575 scope.go:117] "RemoveContainer" containerID="f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13"
Sep 18 13:47:08.204101 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.204082    2575 scope.go:117] "RemoveContainer" containerID="2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e"
Sep 18 13:47:08.210665 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.210648    2575 scope.go:117] "RemoveContainer" containerID="b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2"
Sep 18 13:47:08.214435 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.214416    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:08.218489 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.218465    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:08.219081 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.219053    2575 scope.go:117] "RemoveContainer" containerID="191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4"
Sep 18 13:47:08.225885 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.225871    2575 scope.go:117] "RemoveContainer" containerID="ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb"
Sep 18 13:47:08.232569 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.232554    2575 scope.go:117] "RemoveContainer" containerID="09b4a7615a6115f3c100b7da45023b3df62a75cd5168e8c0fe8d98b789fc736a"
Sep 18 13:47:08.239734 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.239719    2575 scope.go:117] "RemoveContainer" containerID="d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72"
Sep 18 13:47:08.239974 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:08.239956    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72\": container with ID starting with d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72 not found: ID does not exist" containerID="d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72"
Sep 18 13:47:08.240027 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.239983    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72"} err="failed to get container status \"d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72\": rpc error: code = NotFound desc = could not find container \"d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72\": container with ID starting with d2cfdea6f53f144c0994ac65ffeaf8873aec3ba0e2f2be9e1a6d8e6568de9b72 not found: ID does not exist"
Sep 18 13:47:08.240027 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.240002    2575 scope.go:117] "RemoveContainer" containerID="f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13"
Sep 18 13:47:08.240282 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:08.240266    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13\": container with ID starting with f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13 not found: ID does not exist" containerID="f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13"
Sep 18 13:47:08.240339 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.240293    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13"} err="failed to get container status \"f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13\": rpc error: code = NotFound desc = could not find container \"f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13\": container with ID starting with f2fde32b0c4bc8201ccc53e0face7692a3fc14af982d8a794f6c3142ea005d13 not found: ID does not exist"
Sep 18 13:47:08.240339 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.240307    2575 scope.go:117] "RemoveContainer" containerID="2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e"
Sep 18 13:47:08.240539 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:08.240522    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e\": container with ID starting with 2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e not found: ID does not exist" containerID="2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e"
Sep 18 13:47:08.240599 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.240548    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e"} err="failed to get container status \"2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e\": rpc error: code = NotFound desc = could not find container \"2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e\": container with ID starting with 2cec4d4245f6481b1136a368d2c0ac097cd5670f3a0f8f4df883a3d7c3bbb44e not found: ID does not exist"
Sep 18 13:47:08.240599 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.240571    2575 scope.go:117] "RemoveContainer" containerID="b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2"
Sep 18 13:47:08.240807 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:08.240792    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2\": container with ID starting with b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2 not found: ID does not exist" containerID="b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2"
Sep 18 13:47:08.240842 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.240812    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2"} err="failed to get container status \"b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2\": rpc error: code = NotFound desc = could not find container \"b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2\": container with ID starting with b887d7329a840bfe08088d3742f98015fe7846b03b6265bf127574fb0d816eb2 not found: ID does not exist"
Sep 18 13:47:08.240842 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.240824    2575 scope.go:117] "RemoveContainer" containerID="191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4"
Sep 18 13:47:08.241036 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:08.241018    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4\": container with ID starting with 191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4 not found: ID does not exist" containerID="191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4"
Sep 18 13:47:08.241087 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.241043    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4"} err="failed to get container status \"191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4\": rpc error: code = NotFound desc = could not find container \"191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4\": container with ID starting with 191f3ba8b7834c158b4dc948ef93d2e7ad8f91a58c0491f7d19972064f5424c4 not found: ID does not exist"
Sep 18 13:47:08.241087 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.241058    2575 scope.go:117] "RemoveContainer" containerID="ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb"
Sep 18 13:47:08.241360 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:08.241341    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb\": container with ID starting with ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb not found: ID does not exist" containerID="ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb"
Sep 18 13:47:08.241447 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.241362    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb"} err="failed to get container status \"ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb\": rpc error: code = NotFound desc = could not find container \"ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb\": container with ID starting with ef0bd6447b19e15db85511424ba00a642c9717c44f0e6af8cb7e5ce02632d2eb not found: ID does not exist"
Sep 18 13:47:08.241447 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.241375    2575 scope.go:117] "RemoveContainer" containerID="09b4a7615a6115f3c100b7da45023b3df62a75cd5168e8c0fe8d98b789fc736a"
Sep 18 13:47:08.241641 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:08.241624    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09b4a7615a6115f3c100b7da45023b3df62a75cd5168e8c0fe8d98b789fc736a\": container with ID starting with 09b4a7615a6115f3c100b7da45023b3df62a75cd5168e8c0fe8d98b789fc736a not found: ID does not exist" containerID="09b4a7615a6115f3c100b7da45023b3df62a75cd5168e8c0fe8d98b789fc736a"
Sep 18 13:47:08.241685 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.241648    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b4a7615a6115f3c100b7da45023b3df62a75cd5168e8c0fe8d98b789fc736a"} err="failed to get container status \"09b4a7615a6115f3c100b7da45023b3df62a75cd5168e8c0fe8d98b789fc736a\": rpc error: code = NotFound desc = could not find container \"09b4a7615a6115f3c100b7da45023b3df62a75cd5168e8c0fe8d98b789fc736a\": container with ID starting with 09b4a7615a6115f3c100b7da45023b3df62a75cd5168e8c0fe8d98b789fc736a not found: ID does not exist"
Sep 18 13:47:08.245107 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245085    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:08.245410 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245396    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="prom-label-proxy"
Sep 18 13:47:08.245459 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245412    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="prom-label-proxy"
Sep 18 13:47:08.245459 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245421    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7b32355-9321-4e8f-b827-c045966c21c8" containerName="console"
Sep 18 13:47:08.245459 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245427    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7b32355-9321-4e8f-b827-c045966c21c8" containerName="console"
Sep 18 13:47:08.245459 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245433    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="config-reloader"
Sep 18 13:47:08.245459 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245439    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="config-reloader"
Sep 18 13:47:08.245459 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245445    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy-web"
Sep 18 13:47:08.245459 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245450    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy-web"
Sep 18 13:47:08.245459 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245455    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy-metric"
Sep 18 13:47:08.245459 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245460    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy-metric"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245476    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245481    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245488    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" containerName="console"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245493    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" containerName="console"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245503    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="alertmanager"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245508    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="alertmanager"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245515    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e5a544-ddea-4622-a338-ed05a2e5ec7c" containerName="console"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245520    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e5a544-ddea-4622-a338-ed05a2e5ec7c" containerName="console"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245528    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="init-config-reloader"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245533    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="init-config-reloader"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245575    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy-metric"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245581    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7b32355-9321-4e8f-b827-c045966c21c8" containerName="console"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245586    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy-web"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245593    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="kube-rbac-proxy"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245599    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7e5a544-ddea-4622-a338-ed05a2e5ec7c" containerName="console"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245604    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="alertmanager"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245610    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e51afc9-6c40-4b89-9e9e-47081dd2d0b0" containerName="console"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245616    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="prom-label-proxy"
Sep 18 13:47:08.245707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.245622    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" containerName="config-reloader"
Sep 18 13:47:08.250872 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.249390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.252377 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.252358    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 18 13:47:08.252377 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.252368    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 18 13:47:08.252513 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.252366    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 18 13:47:08.252690 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.252665    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 18 13:47:08.252690 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.252687    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 18 13:47:08.252982 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.252963    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 18 13:47:08.253054 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.253014    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 18 13:47:08.253054 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.252968    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 18 13:47:08.253206 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.253185    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dzvjw\""
Sep 18 13:47:08.258302 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.258283    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 18 13:47:08.264421 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.264402    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:08.291304 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.291267    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45a089bd-9447-47ad-80ef-371e10c5b672" path="/var/lib/kubelet/pods/45a089bd-9447-47ad-80ef-371e10c5b672/volumes"
Sep 18 13:47:08.343657 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzjb5\" (UniqueName: \"kubernetes.io/projected/80c94fbf-5228-4cda-8868-67a115102bb6-kube-api-access-pzjb5\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.343799 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-web-config\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.343799 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.343799 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343739    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.343799 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c94fbf-5228-4cda-8868-67a115102bb6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.343799 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c94fbf-5228-4cda-8868-67a115102bb6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.343962 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-config-volume\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.343962 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c94fbf-5228-4cda-8868-67a115102bb6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.343962 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.343962 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343880    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.343962 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80c94fbf-5228-4cda-8868-67a115102bb6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.343962 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c94fbf-5228-4cda-8868-67a115102bb6-config-out\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.344158 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.343994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445021 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.444941    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445021 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.444991    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjb5\" (UniqueName: \"kubernetes.io/projected/80c94fbf-5228-4cda-8868-67a115102bb6-kube-api-access-pzjb5\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445240 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.445038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-web-config\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445240 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.445067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445240 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.445103    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445240 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.445155    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c94fbf-5228-4cda-8868-67a115102bb6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445240 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.445192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c94fbf-5228-4cda-8868-67a115102bb6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445240 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.445222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-config-volume\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445521 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.445269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c94fbf-5228-4cda-8868-67a115102bb6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445521 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.445314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445521 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.445349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445521 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.445377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80c94fbf-5228-4cda-8868-67a115102bb6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.445521 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.445399    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c94fbf-5228-4cda-8868-67a115102bb6-config-out\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.446285 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.446032    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c94fbf-5228-4cda-8868-67a115102bb6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.448238 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.448205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c94fbf-5228-4cda-8868-67a115102bb6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.448349 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.448281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c94fbf-5228-4cda-8868-67a115102bb6-config-out\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.448349 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.448287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.448349 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.448298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-web-config\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.448502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.448379    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.448502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.448435    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.448612 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.448570    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80c94fbf-5228-4cda-8868-67a115102bb6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.448780 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.448747    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.448990 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.448968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c94fbf-5228-4cda-8868-67a115102bb6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.449101 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.449080    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-config-volume\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.450157 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.450120    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c94fbf-5228-4cda-8868-67a115102bb6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.457074 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.457052    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzjb5\" (UniqueName: \"kubernetes.io/projected/80c94fbf-5228-4cda-8868-67a115102bb6-kube-api-access-pzjb5\") pod \"alertmanager-main-0\" (UID: \"80c94fbf-5228-4cda-8868-67a115102bb6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.561004 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.560964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:08.843549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:08.843435    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:08.845716 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:47:08.845688    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c94fbf_5228_4cda_8868_67a115102bb6.slice/crio-cdffbb6be4e507f43a26b8ea3a7ff686ed485a94219df6d22e96ca75ad039e9d WatchSource:0}: Error finding container cdffbb6be4e507f43a26b8ea3a7ff686ed485a94219df6d22e96ca75ad039e9d: Status 404 returned error can't find the container with id cdffbb6be4e507f43a26b8ea3a7ff686ed485a94219df6d22e96ca75ad039e9d
Sep 18 13:47:09.194794 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:09.194709    2575 generic.go:356] "Generic (PLEG): container finished" podID="80c94fbf-5228-4cda-8868-67a115102bb6" containerID="b3d560b001a2797d11487f20211b438f0106c6dab3d0bbb6bf1ddd4aaaf19030" exitCode=0
Sep 18 13:47:09.194794 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:09.194751    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c94fbf-5228-4cda-8868-67a115102bb6","Type":"ContainerDied","Data":"b3d560b001a2797d11487f20211b438f0106c6dab3d0bbb6bf1ddd4aaaf19030"}
Sep 18 13:47:09.194971 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:09.194807    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c94fbf-5228-4cda-8868-67a115102bb6","Type":"ContainerStarted","Data":"cdffbb6be4e507f43a26b8ea3a7ff686ed485a94219df6d22e96ca75ad039e9d"}
Sep 18 13:47:10.201996 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.201957    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c94fbf-5228-4cda-8868-67a115102bb6","Type":"ContainerStarted","Data":"89faf8e356dac77393a1698c6858543ce213a05e5776f8a5d9c32f67b6105b9e"}
Sep 18 13:47:10.202407 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.202051    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c94fbf-5228-4cda-8868-67a115102bb6","Type":"ContainerStarted","Data":"0800090b51bd041d44d9688f9cd17780f1358a7b75dc3c81042814c77339bdc5"}
Sep 18 13:47:10.202407 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.202077    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c94fbf-5228-4cda-8868-67a115102bb6","Type":"ContainerStarted","Data":"4e9299735f3e447266a8dc7b0325d852798e54ab17ea314d8ac8fc562d277588"}
Sep 18 13:47:10.202407 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.202103    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c94fbf-5228-4cda-8868-67a115102bb6","Type":"ContainerStarted","Data":"0c7fcddc38be25199ce04029babc781d47f4c286601795afc1857bd2a38b077f"}
Sep 18 13:47:10.202407 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.202153    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c94fbf-5228-4cda-8868-67a115102bb6","Type":"ContainerStarted","Data":"6d6ab4e7c5a864d6aa5c0300fa8f1cecf09809f622ccfc89228180dc2d786665"}
Sep 18 13:47:10.202407 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.202177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c94fbf-5228-4cda-8868-67a115102bb6","Type":"ContainerStarted","Data":"cdb31a177fd301edd7afc68467eec0b413d15cbef34295af39df3d0e1295d5a1"}
Sep 18 13:47:10.233376 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.233321    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.21799777 podStartE2EDuration="2.233303627s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.305857ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:47:10.230890939 +0000 UTC m=+156.066729696" watchObservedRunningTime="2026-09-18 13:47:10.233303627 +0000 UTC m=+156.069142339"
Sep 18 13:47:10.655537 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.655502    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:10.655918 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.655885    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="prometheus" containerID="cri-o://9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0" gracePeriod=600
Sep 18 13:47:10.656007 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.655919    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy-thanos" containerID="cri-o://05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4" gracePeriod=600
Sep 18 13:47:10.656007 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.655948    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy" containerID="cri-o://a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46" gracePeriod=600
Sep 18 13:47:10.656154 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.655927    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="thanos-sidecar" containerID="cri-o://be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29" gracePeriod=600
Sep 18 13:47:10.656154 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.656096    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="config-reloader" containerID="cri-o://ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c" gracePeriod=600
Sep 18 13:47:10.656285 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:10.655911    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy-web" containerID="cri-o://f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c" gracePeriod=600
Sep 18 13:47:11.210069 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.210037    2575 generic.go:356] "Generic (PLEG): container finished" podID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerID="05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4" exitCode=0
Sep 18 13:47:11.210069 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.210061    2575 generic.go:356] "Generic (PLEG): container finished" podID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerID="a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46" exitCode=0
Sep 18 13:47:11.210069 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.210068    2575 generic.go:356] "Generic (PLEG): container finished" podID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerID="be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29" exitCode=0
Sep 18 13:47:11.210069 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.210074    2575 generic.go:356] "Generic (PLEG): container finished" podID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerID="ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c" exitCode=0
Sep 18 13:47:11.210532 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.210080    2575 generic.go:356] "Generic (PLEG): container finished" podID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerID="9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0" exitCode=0
Sep 18 13:47:11.210532 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.210106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerDied","Data":"05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4"}
Sep 18 13:47:11.210532 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.210188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerDied","Data":"a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46"}
Sep 18 13:47:11.210532 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.210216    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerDied","Data":"be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29"}
Sep 18 13:47:11.210532 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.210242    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerDied","Data":"ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c"}
Sep 18 13:47:11.210532 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.210265    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerDied","Data":"9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0"}
Sep 18 13:47:11.908298 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.908273    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:11.974859 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.974832    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-2\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.974874    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.974897    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-thanos-prometheus-http-client-file\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.974938    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-metrics-client-certs\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.974958    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-metrics-client-ca\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975011 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.974994    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-1\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975022    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975045    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975080    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-serving-certs-ca-bundle\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975108    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-kubelet-serving-ca-bundle\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975151    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-kube-rbac-proxy\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975213    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-0\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975237    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-db\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975262    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q9v6\" (UniqueName: \"kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-kube-api-access-4q9v6\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975286    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-trusted-ca-bundle\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975310    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-tls\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975794 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975337    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config-out\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975794 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975368    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-tls-assets\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975794 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975396    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-web-config\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975794 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975454    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-grpc-tls\") pod \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\" (UID: \"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746\") "
Sep 18 13:47:11.975794 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975617    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:11.975794 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975753    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:11.976239 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975423    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:11.976239 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.975970    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:11.977672 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.977118    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:11.977672 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.977633    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:11.977846 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.977772    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:47:11.980038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.978413    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:11.980038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.978667    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:11.980038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.978826    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:11.980038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.979307    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:11.980038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.979331    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config" (OuterVolumeSpecName: "config") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:11.980038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.979673    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:11.980038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.979968    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:11.980474 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.980091    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:11.980881 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.980854    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:47:11.981427 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.981396    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:11.981942 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.981915    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-kube-api-access-4q9v6" (OuterVolumeSpecName: "kube-api-access-4q9v6") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "kube-api-access-4q9v6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:47:11.982476 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.982441    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:11.982569 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.982499    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config-out" (OuterVolumeSpecName: "config-out") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:47:11.993170 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:11.993149    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-web-config" (OuterVolumeSpecName: "web-config") pod "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" (UID: "7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:12.076144 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076107    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076158    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-db\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076170    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q9v6\" (UniqueName: \"kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-kube-api-access-4q9v6\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076178    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076189    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076197    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config-out\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076205    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-tls-assets\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076212    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-web-config\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076219    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-grpc-tls\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076227    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076235    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076243    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076251    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-metrics-client-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076259    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-metrics-client-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076267    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076275    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076283    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-config\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076292    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.076575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.076301    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746-secret-kube-rbac-proxy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:47:12.219845 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.219816    2575 generic.go:356] "Generic (PLEG): container finished" podID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerID="f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c" exitCode=0
Sep 18 13:47:12.220178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.219890    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.220178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.219909    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerDied","Data":"f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c"}
Sep 18 13:47:12.220178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.219978    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746","Type":"ContainerDied","Data":"63d200d86821c0cc58138acb61b6f6bce9ce18362a776723dc163347b5901693"}
Sep 18 13:47:12.220178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.220019    2575 scope.go:117] "RemoveContainer" containerID="05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4"
Sep 18 13:47:12.228486 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.228462    2575 scope.go:117] "RemoveContainer" containerID="a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46"
Sep 18 13:47:12.235566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.235550    2575 scope.go:117] "RemoveContainer" containerID="f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c"
Sep 18 13:47:12.241868 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.241854    2575 scope.go:117] "RemoveContainer" containerID="be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29"
Sep 18 13:47:12.245275 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.245253    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:12.248896 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.248880    2575 scope.go:117] "RemoveContainer" containerID="ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c"
Sep 18 13:47:12.251918 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.251894    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:12.255970 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.255951    2575 scope.go:117] "RemoveContainer" containerID="9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0"
Sep 18 13:47:12.262921 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.262906    2575 scope.go:117] "RemoveContainer" containerID="269a5c909873ddb2b4be9cc33d1e577d3088e44f670a786a8be86f9458513ebd"
Sep 18 13:47:12.269398 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.269379    2575 scope.go:117] "RemoveContainer" containerID="05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4"
Sep 18 13:47:12.269650 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:12.269631    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4\": container with ID starting with 05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4 not found: ID does not exist" containerID="05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4"
Sep 18 13:47:12.269708 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.269658    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4"} err="failed to get container status \"05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4\": rpc error: code = NotFound desc = could not find container \"05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4\": container with ID starting with 05f0d4f88995668aacc91a9ea290edb5ad5db84d29afb4964ff7c5f2b1698ba4 not found: ID does not exist"
Sep 18 13:47:12.269708 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.269681    2575 scope.go:117] "RemoveContainer" containerID="a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46"
Sep 18 13:47:12.269918 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:12.269900    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46\": container with ID starting with a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46 not found: ID does not exist" containerID="a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46"
Sep 18 13:47:12.269962 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.269923    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46"} err="failed to get container status \"a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46\": rpc error: code = NotFound desc = could not find container \"a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46\": container with ID starting with a1efbf7ebaf5a8656d8cf3d5eb6830f1fed67a256d1efb288c8dd4b8a894ca46 not found: ID does not exist"
Sep 18 13:47:12.269962 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.269937    2575 scope.go:117] "RemoveContainer" containerID="f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c"
Sep 18 13:47:12.270158 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:12.270143    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c\": container with ID starting with f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c not found: ID does not exist" containerID="f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c"
Sep 18 13:47:12.270207 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.270160    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c"} err="failed to get container status \"f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c\": rpc error: code = NotFound desc = could not find container \"f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c\": container with ID starting with f29aef4f5af3dbbcdf1db8b320a72735da3d8838bf8eff652f8500aed258f33c not found: ID does not exist"
Sep 18 13:47:12.270207 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.270173    2575 scope.go:117] "RemoveContainer" containerID="be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29"
Sep 18 13:47:12.270384 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:12.270370    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29\": container with ID starting with be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29 not found: ID does not exist" containerID="be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29"
Sep 18 13:47:12.270419 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.270387    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29"} err="failed to get container status \"be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29\": rpc error: code = NotFound desc = could not find container \"be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29\": container with ID starting with be7e4bf531cb7d00c95812524a20448fec9324a5ba96b862e8f9c52f97cf2f29 not found: ID does not exist"
Sep 18 13:47:12.270419 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.270399    2575 scope.go:117] "RemoveContainer" containerID="ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c"
Sep 18 13:47:12.270662 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:12.270644    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c\": container with ID starting with ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c not found: ID does not exist" containerID="ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c"
Sep 18 13:47:12.270701 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.270668    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c"} err="failed to get container status \"ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c\": rpc error: code = NotFound desc = could not find container \"ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c\": container with ID starting with ea9fa4998f1b8fc2c9cd8b400d8b2ef13da8e1d85ccc9f04cb23b120a0d8920c not found: ID does not exist"
Sep 18 13:47:12.270701 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.270686    2575 scope.go:117] "RemoveContainer" containerID="9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0"
Sep 18 13:47:12.271001 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:12.270980    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0\": container with ID starting with 9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0 not found: ID does not exist" containerID="9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0"
Sep 18 13:47:12.271075 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.271003    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0"} err="failed to get container status \"9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0\": rpc error: code = NotFound desc = could not find container \"9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0\": container with ID starting with 9d6f6ed0e4c8f4f6d942ea085e7d2efb76872e29395aca9c7d50f7f155447fb0 not found: ID does not exist"
Sep 18 13:47:12.271075 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.271017    2575 scope.go:117] "RemoveContainer" containerID="269a5c909873ddb2b4be9cc33d1e577d3088e44f670a786a8be86f9458513ebd"
Sep 18 13:47:12.271346 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:47:12.271323    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"269a5c909873ddb2b4be9cc33d1e577d3088e44f670a786a8be86f9458513ebd\": container with ID starting with 269a5c909873ddb2b4be9cc33d1e577d3088e44f670a786a8be86f9458513ebd not found: ID does not exist" containerID="269a5c909873ddb2b4be9cc33d1e577d3088e44f670a786a8be86f9458513ebd"
Sep 18 13:47:12.271432 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.271355    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269a5c909873ddb2b4be9cc33d1e577d3088e44f670a786a8be86f9458513ebd"} err="failed to get container status \"269a5c909873ddb2b4be9cc33d1e577d3088e44f670a786a8be86f9458513ebd\": rpc error: code = NotFound desc = could not find container \"269a5c909873ddb2b4be9cc33d1e577d3088e44f670a786a8be86f9458513ebd\": container with ID starting with 269a5c909873ddb2b4be9cc33d1e577d3088e44f670a786a8be86f9458513ebd not found: ID does not exist"
Sep 18 13:47:12.281250 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281227    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:12.281513 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281502    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="prometheus"
Sep 18 13:47:12.281559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281515    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="prometheus"
Sep 18 13:47:12.281559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281525    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="thanos-sidecar"
Sep 18 13:47:12.281559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281531    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="thanos-sidecar"
Sep 18 13:47:12.281559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281539    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy"
Sep 18 13:47:12.281559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281544    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy"
Sep 18 13:47:12.281559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281551    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="config-reloader"
Sep 18 13:47:12.281559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281556    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="config-reloader"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281568    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="init-config-reloader"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281574    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="init-config-reloader"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281583    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy-web"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281588    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy-web"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281596    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy-thanos"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281601    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy-thanos"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281642    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="config-reloader"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281650    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy-web"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281657    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281662    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="prometheus"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281669    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="thanos-sidecar"
Sep 18 13:47:12.281758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.281673    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" containerName="kube-rbac-proxy-thanos"
Sep 18 13:47:12.284329 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.284307    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.288373 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.288356    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 18 13:47:12.288461 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.288432    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rngj4\""
Sep 18 13:47:12.288560 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.288543    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 18 13:47:12.288763 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.288746    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 18 13:47:12.288865 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.288774    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 18 13:47:12.288998 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.288981    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 18 13:47:12.289207 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.289190    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 18 13:47:12.289303 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.289293    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 18 13:47:12.289410 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.289391    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 18 13:47:12.289526 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.289511    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 18 13:47:12.289728 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.289622    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3k39dho4qmosk\""
Sep 18 13:47:12.289823 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.289701    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 18 13:47:12.290200 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.290178    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 18 13:47:12.290319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.290219    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 18 13:47:12.298532 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.298508    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 18 13:47:12.298867 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.298843    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746" path="/var/lib/kubelet/pods/7ff1e93a-09f6-4e0e-bb7c-08f4a5e56746/volumes"
Sep 18 13:47:12.299942 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.299927    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 18 13:47:12.303053 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.303032    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:12.379351 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379351 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-config\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379428    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwqkv\" (UniqueName: \"kubernetes.io/projected/92618e6c-2e9a-495d-aa12-c42838b7ed15-kube-api-access-kwqkv\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379456    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-web-config\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379943 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379609    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92618e6c-2e9a-495d-aa12-c42838b7ed15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379943 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379943 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379943 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379943 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379750    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379943 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379819    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379943 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379859    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379943 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92618e6c-2e9a-495d-aa12-c42838b7ed15-config-out\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.379943 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.380269 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.379965    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.480882 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.480850    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92618e6c-2e9a-495d-aa12-c42838b7ed15-config-out\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.480882 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.480886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.480903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.480931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.480946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.480964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-config\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.480979    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.480999    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqkv\" (UniqueName: \"kubernetes.io/projected/92618e6c-2e9a-495d-aa12-c42838b7ed15-kube-api-access-kwqkv\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481069    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-web-config\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481608 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481608 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481186    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92618e6c-2e9a-495d-aa12-c42838b7ed15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481608 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481608 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481608 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481608 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481608 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481608 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481997 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481776    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.481997 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.481904    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.484058 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.483946    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-web-config\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.484058 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.483965    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92618e6c-2e9a-495d-aa12-c42838b7ed15-config-out\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.484280 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.484224    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-config\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.484342 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.484301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92618e6c-2e9a-495d-aa12-c42838b7ed15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.484391 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.484353    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.484566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.484538    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.484678 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.484656    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.484753 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.484737    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.484936 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.484909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.485006 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.484948    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.485337 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.485308    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.485807 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.485750    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92618e6c-2e9a-495d-aa12-c42838b7ed15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.486677 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.486654    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.486998 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.486970    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.487081 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.487007    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.487081 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.487008    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.487081 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.487075    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92618e6c-2e9a-495d-aa12-c42838b7ed15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.489398 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.489382    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwqkv\" (UniqueName: \"kubernetes.io/projected/92618e6c-2e9a-495d-aa12-c42838b7ed15-kube-api-access-kwqkv\") pod \"prometheus-k8s-0\" (UID: \"92618e6c-2e9a-495d-aa12-c42838b7ed15\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.599797 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.599749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:12.881051 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:12.880729    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:12.883629 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:47:12.883602    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92618e6c_2e9a_495d_aa12_c42838b7ed15.slice/crio-2635160e24e4d7c566fc699f1c27d7a01d5d3790902049964b540a4674bcadda WatchSource:0}: Error finding container 2635160e24e4d7c566fc699f1c27d7a01d5d3790902049964b540a4674bcadda: Status 404 returned error can't find the container with id 2635160e24e4d7c566fc699f1c27d7a01d5d3790902049964b540a4674bcadda
Sep 18 13:47:13.226712 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:13.226681    2575 generic.go:356] "Generic (PLEG): container finished" podID="92618e6c-2e9a-495d-aa12-c42838b7ed15" containerID="172b41d8ff0a1680a605018993b15e019308d660c12ae4fcb90cffa95f19a3eb" exitCode=0
Sep 18 13:47:13.227083 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:13.226769    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92618e6c-2e9a-495d-aa12-c42838b7ed15","Type":"ContainerDied","Data":"172b41d8ff0a1680a605018993b15e019308d660c12ae4fcb90cffa95f19a3eb"}
Sep 18 13:47:13.227083 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:13.226834    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92618e6c-2e9a-495d-aa12-c42838b7ed15","Type":"ContainerStarted","Data":"2635160e24e4d7c566fc699f1c27d7a01d5d3790902049964b540a4674bcadda"}
Sep 18 13:47:14.234326 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:14.234289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92618e6c-2e9a-495d-aa12-c42838b7ed15","Type":"ContainerStarted","Data":"40a27906b3b5e06b81d58e9e4c2676429e0ed989c99a01e5171701391cdb7996"}
Sep 18 13:47:14.234746 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:14.234358    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92618e6c-2e9a-495d-aa12-c42838b7ed15","Type":"ContainerStarted","Data":"8952935bb88055748be276f881652f521b956eed4be594951f1bedbcac3d1376"}
Sep 18 13:47:14.234746 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:14.234384    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92618e6c-2e9a-495d-aa12-c42838b7ed15","Type":"ContainerStarted","Data":"cdd539affafeb31a02653cf233796bd8771c3069ef77305aa433ad7a43112b6a"}
Sep 18 13:47:14.234746 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:14.234408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92618e6c-2e9a-495d-aa12-c42838b7ed15","Type":"ContainerStarted","Data":"b0c7f49e3fad9cfdcc36691c5464371b60620a52f83c3f502e2081818b9f43c8"}
Sep 18 13:47:14.234746 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:14.234430    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92618e6c-2e9a-495d-aa12-c42838b7ed15","Type":"ContainerStarted","Data":"05505b3e51b15e146d524b63a12c55b19ca5a0212a0b9fb3f9b1048955796a10"}
Sep 18 13:47:14.234746 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:14.234453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92618e6c-2e9a-495d-aa12-c42838b7ed15","Type":"ContainerStarted","Data":"4757c2cf92c4c7d0e8cd661126cb9909937f18878507db92000053f46c8dbb17"}
Sep 18 13:47:14.264789 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:14.264734    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.246200067 podStartE2EDuration="2.264716888s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.516821ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:47:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:47:14.26273742 +0000 UTC m=+160.098576154" watchObservedRunningTime="2026-09-18 13:47:14.264716888 +0000 UTC m=+160.100555601"
Sep 18 13:47:17.600704 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:47:17.600650    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:48:12.600183 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:12.600105    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:48:12.615832 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:12.615806    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:48:13.495368 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:13.495342    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:48:47.677693 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.677657    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gmb65"]
Sep 18 13:48:47.680736 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.680719    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gmb65"
Sep 18 13:48:47.683381 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.683360    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 18 13:48:47.684628 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.684604    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zngwl\""
Sep 18 13:48:47.684729 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.684627    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 18 13:48:47.689093 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.689072    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gmb65"]
Sep 18 13:48:47.806422 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.806381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t226\" (UniqueName: \"kubernetes.io/projected/b05d90b9-bd1d-4777-a820-c2c9e959030c-kube-api-access-2t226\") pod \"cert-manager-cainjector-559cdd8c87-gmb65\" (UID: \"b05d90b9-bd1d-4777-a820-c2c9e959030c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gmb65"
Sep 18 13:48:47.806598 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.806446    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b05d90b9-bd1d-4777-a820-c2c9e959030c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gmb65\" (UID: \"b05d90b9-bd1d-4777-a820-c2c9e959030c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gmb65"
Sep 18 13:48:47.906832 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.906802    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t226\" (UniqueName: \"kubernetes.io/projected/b05d90b9-bd1d-4777-a820-c2c9e959030c-kube-api-access-2t226\") pod \"cert-manager-cainjector-559cdd8c87-gmb65\" (UID: \"b05d90b9-bd1d-4777-a820-c2c9e959030c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gmb65"
Sep 18 13:48:47.906951 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.906865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b05d90b9-bd1d-4777-a820-c2c9e959030c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gmb65\" (UID: \"b05d90b9-bd1d-4777-a820-c2c9e959030c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gmb65"
Sep 18 13:48:47.918606 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.918573    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b05d90b9-bd1d-4777-a820-c2c9e959030c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gmb65\" (UID: \"b05d90b9-bd1d-4777-a820-c2c9e959030c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gmb65"
Sep 18 13:48:47.918745 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:47.918727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t226\" (UniqueName: \"kubernetes.io/projected/b05d90b9-bd1d-4777-a820-c2c9e959030c-kube-api-access-2t226\") pod \"cert-manager-cainjector-559cdd8c87-gmb65\" (UID: \"b05d90b9-bd1d-4777-a820-c2c9e959030c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gmb65"
Sep 18 13:48:48.001752 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:48.001677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gmb65"
Sep 18 13:48:48.272546 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:48.272489    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gmb65"]
Sep 18 13:48:48.275413 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:48:48.275367    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb05d90b9_bd1d_4777_a820_c2c9e959030c.slice/crio-d22a4592a2c4b63466c24da09403f218872dd91d452952fd45814b66ba86ccb7 WatchSource:0}: Error finding container d22a4592a2c4b63466c24da09403f218872dd91d452952fd45814b66ba86ccb7: Status 404 returned error can't find the container with id d22a4592a2c4b63466c24da09403f218872dd91d452952fd45814b66ba86ccb7
Sep 18 13:48:48.623849 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:48.623815    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gmb65" event={"ID":"b05d90b9-bd1d-4777-a820-c2c9e959030c","Type":"ContainerStarted","Data":"d22a4592a2c4b63466c24da09403f218872dd91d452952fd45814b66ba86ccb7"}
Sep 18 13:48:51.640113 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:51.640079    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gmb65" event={"ID":"b05d90b9-bd1d-4777-a820-c2c9e959030c","Type":"ContainerStarted","Data":"0bd4a84a378cdf5cae15f91c9c0b50bdd05c9989ebecc882b2406e948eaf114b"}
Sep 18 13:48:51.656933 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:48:51.656880    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gmb65" podStartSLOduration=1.657080441 podStartE2EDuration="4.656858495s" totalImagesPullingTime="2.999778054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:48:51.656334007 +0000 UTC m=+257.492172745" watchObservedRunningTime="2026-09-18 13:48:51.656858495 +0000 UTC m=+257.492697210"
Sep 18 13:49:24.002276 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.002236    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"]
Sep 18 13:49:24.008605 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.008580    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.011970 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.011947    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 13:49:24.012162 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.012120    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 13:49:24.012472 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.012447    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 13:49:24.012472 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.012458    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dlrjx\""
Sep 18 13:49:24.012627 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.012488    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 13:49:24.036902 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.036873    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"]
Sep 18 13:49:24.124772 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.124737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40f4a16f-43ae-4469-aa10-54ecc22e4112-tmp\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.124928 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.124783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40f4a16f-43ae-4469-aa10-54ecc22e4112-webhook-cert\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.124928 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.124815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfts9\" (UniqueName: \"kubernetes.io/projected/40f4a16f-43ae-4469-aa10-54ecc22e4112-kube-api-access-xfts9\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.124928 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.124905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40f4a16f-43ae-4469-aa10-54ecc22e4112-apiservice-cert\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.125034 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.124938    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40f4a16f-43ae-4469-aa10-54ecc22e4112-manifests\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.226361 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.226327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40f4a16f-43ae-4469-aa10-54ecc22e4112-tmp\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.226526 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.226375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40f4a16f-43ae-4469-aa10-54ecc22e4112-webhook-cert\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.226526 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.226401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfts9\" (UniqueName: \"kubernetes.io/projected/40f4a16f-43ae-4469-aa10-54ecc22e4112-kube-api-access-xfts9\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.226526 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.226437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40f4a16f-43ae-4469-aa10-54ecc22e4112-apiservice-cert\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.226526 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.226454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40f4a16f-43ae-4469-aa10-54ecc22e4112-manifests\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.226808 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.226783    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40f4a16f-43ae-4469-aa10-54ecc22e4112-manifests\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.228722 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.228694    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40f4a16f-43ae-4469-aa10-54ecc22e4112-tmp\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.228857 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.228838    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40f4a16f-43ae-4469-aa10-54ecc22e4112-apiservice-cert\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.228898 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.228879    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40f4a16f-43ae-4469-aa10-54ecc22e4112-webhook-cert\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.234890 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.234869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfts9\" (UniqueName: \"kubernetes.io/projected/40f4a16f-43ae-4469-aa10-54ecc22e4112-kube-api-access-xfts9\") pod \"opendatahub-operator-controller-manager-978ccd68d-g52bn\" (UID: \"40f4a16f-43ae-4469-aa10-54ecc22e4112\") " pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.319103 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.319078    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:24.625279 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.625255    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"]
Sep 18 13:49:24.627562 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:49:24.627536    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40f4a16f_43ae_4469_aa10_54ecc22e4112.slice/crio-662892020ffa3870bfa86a2a32a0c35a54e3fe4e41bc9b05519353ec0f5d238b WatchSource:0}: Error finding container 662892020ffa3870bfa86a2a32a0c35a54e3fe4e41bc9b05519353ec0f5d238b: Status 404 returned error can't find the container with id 662892020ffa3870bfa86a2a32a0c35a54e3fe4e41bc9b05519353ec0f5d238b
Sep 18 13:49:24.783486 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:24.783450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn" event={"ID":"40f4a16f-43ae-4469-aa10-54ecc22e4112","Type":"ContainerStarted","Data":"662892020ffa3870bfa86a2a32a0c35a54e3fe4e41bc9b05519353ec0f5d238b"}
Sep 18 13:49:27.801154 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:27.801096    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn" event={"ID":"40f4a16f-43ae-4469-aa10-54ecc22e4112","Type":"ContainerStarted","Data":"04cccf88cc40e29158bef1d445e7edb4a03217a39c388c2cc3cc9054897965e8"}
Sep 18 13:49:28.807707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:28.807670    2575 generic.go:356] "Generic (PLEG): container finished" podID="40f4a16f-43ae-4469-aa10-54ecc22e4112" containerID="04cccf88cc40e29158bef1d445e7edb4a03217a39c388c2cc3cc9054897965e8" exitCode=0
Sep 18 13:49:28.808073 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:28.807765    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn" event={"ID":"40f4a16f-43ae-4469-aa10-54ecc22e4112","Type":"ContainerDied","Data":"04cccf88cc40e29158bef1d445e7edb4a03217a39c388c2cc3cc9054897965e8"}
Sep 18 13:49:29.814768 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:29.814725    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn" event={"ID":"40f4a16f-43ae-4469-aa10-54ecc22e4112","Type":"ContainerStarted","Data":"46db6a4851733aca5824fa673d455ff4c0de87db177386ab035ce15528f240f3"}
Sep 18 13:49:29.815210 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:29.814916    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:29.848786 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:29.848736    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn" podStartSLOduration=2.523145337 podStartE2EDuration="6.84872128s" totalImagesPullingTime="3.304075155s" totalInitContainerRuntime="1.021500788s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:49:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:49:29.846572198 +0000 UTC m=+295.682410949" watchObservedRunningTime="2026-09-18 13:49:29.84872128 +0000 UTC m=+295.684559993"
Sep 18 13:49:36.183960 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:36.183934    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 13:49:36.186887 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:36.186864    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 13:49:36.190803 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:36.190779    2575 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 13:49:40.822564 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:40.822531    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-978ccd68d-g52bn"
Sep 18 13:49:51.041685 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.041643    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"]
Sep 18 13:49:51.045164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.045113    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.050575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.050555    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 13:49:51.050575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.050556    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 13:49:51.050748 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.050556    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 13:49:51.050972 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.050957    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cvnw8\""
Sep 18 13:49:51.068097 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.068052    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"]
Sep 18 13:49:51.172945 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.172908    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.173161 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.172959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.173161 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.172997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.173161 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.173024    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.173161 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.173052    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.173161 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.173090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.173161 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.173114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.173393 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.173165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr4v8\" (UniqueName: \"kubernetes.io/projected/ebb191b6-d7fa-4b59-8ec4-0182ead09892-kube-api-access-lr4v8\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.173393 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.173196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.274579 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.274545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.274773 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.274589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.274773 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.274608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.274773 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.274628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.274773 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.274645    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.274773 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.274677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.274773 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.274702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.274773 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.274727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr4v8\" (UniqueName: \"kubernetes.io/projected/ebb191b6-d7fa-4b59-8ec4-0182ead09892-kube-api-access-lr4v8\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.274773 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.274765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.275231 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.275028    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.275231 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.275086    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.275333 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.275274    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.275371 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.275344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.275497 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.275481    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.277078 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.277057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.277199 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.277181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.287097 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.287074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb191b6-d7fa-4b59-8ec4-0182ead09892-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.287222 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.287074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr4v8\" (UniqueName: \"kubernetes.io/projected/ebb191b6-d7fa-4b59-8ec4-0182ead09892-kube-api-access-lr4v8\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw\" (UID: \"ebb191b6-d7fa-4b59-8ec4-0182ead09892\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.355416 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.355389    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:51.638465 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.638387    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"]
Sep 18 13:49:51.641465 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:49:51.641433    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb191b6_d7fa_4b59_8ec4_0182ead09892.slice/crio-126863be8f1c88c8825484ff3bc1870822864b60b7941051009313b3baf35f81 WatchSource:0}: Error finding container 126863be8f1c88c8825484ff3bc1870822864b60b7941051009313b3baf35f81: Status 404 returned error can't find the container with id 126863be8f1c88c8825484ff3bc1870822864b60b7941051009313b3baf35f81
Sep 18 13:49:51.643402 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.643385    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:49:51.913539 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:51.913453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw" event={"ID":"ebb191b6-d7fa-4b59-8ec4-0182ead09892","Type":"ContainerStarted","Data":"126863be8f1c88c8825484ff3bc1870822864b60b7941051009313b3baf35f81"}
Sep 18 13:49:54.119563 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.119519    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:49:54.119843 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.119598    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:49:54.119843 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.119625    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:49:54.337377 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.337340    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9kk4g"]
Sep 18 13:49:54.341253 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.341230    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g"
Sep 18 13:49:54.344956 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.344937    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-99jkk\""
Sep 18 13:49:54.345220 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.345198    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 18 13:49:54.357227 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.357203    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9kk4g"]
Sep 18 13:49:54.505833 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.505746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2d1e7e5-5395-493c-ab75-459ca47fa50c-cert\") pod \"odh-model-controller-7998c67dc4-9kk4g\" (UID: \"c2d1e7e5-5395-493c-ab75-459ca47fa50c\") " pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g"
Sep 18 13:49:54.505967 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.505890    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjnw4\" (UniqueName: \"kubernetes.io/projected/c2d1e7e5-5395-493c-ab75-459ca47fa50c-kube-api-access-jjnw4\") pod \"odh-model-controller-7998c67dc4-9kk4g\" (UID: \"c2d1e7e5-5395-493c-ab75-459ca47fa50c\") " pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g"
Sep 18 13:49:54.606371 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.606337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjnw4\" (UniqueName: \"kubernetes.io/projected/c2d1e7e5-5395-493c-ab75-459ca47fa50c-kube-api-access-jjnw4\") pod \"odh-model-controller-7998c67dc4-9kk4g\" (UID: \"c2d1e7e5-5395-493c-ab75-459ca47fa50c\") " pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g"
Sep 18 13:49:54.606555 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.606414    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2d1e7e5-5395-493c-ab75-459ca47fa50c-cert\") pod \"odh-model-controller-7998c67dc4-9kk4g\" (UID: \"c2d1e7e5-5395-493c-ab75-459ca47fa50c\") " pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g"
Sep 18 13:49:54.606555 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:49:54.606552    2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 18 13:49:54.606675 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:49:54.606615    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d1e7e5-5395-493c-ab75-459ca47fa50c-cert podName:c2d1e7e5-5395-493c-ab75-459ca47fa50c nodeName:}" failed. No retries permitted until 2026-09-18 13:49:55.106596753 +0000 UTC m=+320.942435448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c2d1e7e5-5395-493c-ab75-459ca47fa50c-cert") pod "odh-model-controller-7998c67dc4-9kk4g" (UID: "c2d1e7e5-5395-493c-ab75-459ca47fa50c") : secret "odh-model-controller-webhook-cert" not found
Sep 18 13:49:54.625013 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.624985    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjnw4\" (UniqueName: \"kubernetes.io/projected/c2d1e7e5-5395-493c-ab75-459ca47fa50c-kube-api-access-jjnw4\") pod \"odh-model-controller-7998c67dc4-9kk4g\" (UID: \"c2d1e7e5-5395-493c-ab75-459ca47fa50c\") " pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g"
Sep 18 13:49:54.929277 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.929226    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw" event={"ID":"ebb191b6-d7fa-4b59-8ec4-0182ead09892","Type":"ContainerStarted","Data":"5b7eb23aac92fc396e8b2681bc0164bcb5a7f74f7605f3795f073ad5360272bc"}
Sep 18 13:49:54.958621 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:54.958569    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw" podStartSLOduration=1.482813263 podStartE2EDuration="3.958551852s" totalImagesPullingTime="2.475738589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:49:54.957042531 +0000 UTC m=+320.792881247" watchObservedRunningTime="2026-09-18 13:49:54.958551852 +0000 UTC m=+320.794390566"
Sep 18 13:49:55.110689 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:55.110652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2d1e7e5-5395-493c-ab75-459ca47fa50c-cert\") pod \"odh-model-controller-7998c67dc4-9kk4g\" (UID: \"c2d1e7e5-5395-493c-ab75-459ca47fa50c\") " pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g"
Sep 18 13:49:55.113189 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:55.113157    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2d1e7e5-5395-493c-ab75-459ca47fa50c-cert\") pod \"odh-model-controller-7998c67dc4-9kk4g\" (UID: \"c2d1e7e5-5395-493c-ab75-459ca47fa50c\") " pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g"
Sep 18 13:49:55.251908 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:55.251825    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g"
Sep 18 13:49:55.356287 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:55.356260    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:55.360655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:55.360628    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:55.523369 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:55.523112    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9kk4g"]
Sep 18 13:49:55.525853 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:49:55.525827    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d1e7e5_5395_493c_ab75_459ca47fa50c.slice/crio-bc9d08d1ce47e3ed7f851cfe307eb4ad8eb5758de876f5e05be134b829d3dd3a WatchSource:0}: Error finding container bc9d08d1ce47e3ed7f851cfe307eb4ad8eb5758de876f5e05be134b829d3dd3a: Status 404 returned error can't find the container with id bc9d08d1ce47e3ed7f851cfe307eb4ad8eb5758de876f5e05be134b829d3dd3a
Sep 18 13:49:55.934845 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:55.934813    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g" event={"ID":"c2d1e7e5-5395-493c-ab75-459ca47fa50c","Type":"ContainerStarted","Data":"bc9d08d1ce47e3ed7f851cfe307eb4ad8eb5758de876f5e05be134b829d3dd3a"}
Sep 18 13:49:55.935114 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:55.935102    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:55.936164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:55.936123    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw"
Sep 18 13:49:58.953889 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:58.953852    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g" event={"ID":"c2d1e7e5-5395-493c-ab75-459ca47fa50c","Type":"ContainerStarted","Data":"29e14e094779184da604e718094b5186eccbcb23f15a46f0637e0cea5ca72ca5"}
Sep 18 13:49:58.954279 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:58.953992    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g"
Sep 18 13:49:58.972586 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:49:58.972537    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g" podStartSLOduration=2.162517178 podStartE2EDuration="4.972521991s" totalImagesPullingTime="2.810004813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:49:58.971815606 +0000 UTC m=+324.807654321" watchObservedRunningTime="2026-09-18 13:49:58.972521991 +0000 UTC m=+324.808360704"
Sep 18 13:50:01.897758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.897714    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"]
Sep 18 13:50:01.959752 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.959718    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"]
Sep 18 13:50:01.959912 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.959839    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:01.962834 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.962810    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:50:01.963981 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.963960    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 18 13:50:01.964090 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.963999    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 18 13:50:01.964090 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.964077    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q6vxx\""
Sep 18 13:50:01.964225 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.964101    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 18 13:50:01.964225 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.964204    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 18 13:50:01.972949 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.972928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/adeb8047-14f1-44d3-8419-f5be177efc66-metrics-cert\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:01.973038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.972976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/adeb8047-14f1-44d3-8419-f5be177efc66-manager-config\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:01.973038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.972991    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adeb8047-14f1-44d3-8419-f5be177efc66-cert\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:01.973107 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:01.973054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9rhm\" (UniqueName: \"kubernetes.io/projected/adeb8047-14f1-44d3-8419-f5be177efc66-kube-api-access-z9rhm\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:02.073880 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:02.073831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/adeb8047-14f1-44d3-8419-f5be177efc66-manager-config\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:02.074149 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:02.073889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adeb8047-14f1-44d3-8419-f5be177efc66-cert\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:02.074149 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:02.073930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9rhm\" (UniqueName: \"kubernetes.io/projected/adeb8047-14f1-44d3-8419-f5be177efc66-kube-api-access-z9rhm\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:02.074149 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:02.074029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/adeb8047-14f1-44d3-8419-f5be177efc66-metrics-cert\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:02.074788 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:02.074759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/adeb8047-14f1-44d3-8419-f5be177efc66-manager-config\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:02.077180 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:02.077154    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adeb8047-14f1-44d3-8419-f5be177efc66-cert\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:02.077493 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:02.077459    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/adeb8047-14f1-44d3-8419-f5be177efc66-metrics-cert\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:02.088614 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:02.088587    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9rhm\" (UniqueName: \"kubernetes.io/projected/adeb8047-14f1-44d3-8419-f5be177efc66-kube-api-access-z9rhm\") pod \"lws-controller-manager-6cdc5b77c9-7b4w2\" (UID: \"adeb8047-14f1-44d3-8419-f5be177efc66\") " pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:02.269898 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:02.269815    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:02.554975 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:02.554949    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"]
Sep 18 13:50:02.561277 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:50:02.558422    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadeb8047_14f1_44d3_8419_f5be177efc66.slice/crio-1287ab76733790c1099c154d8b44992c8f67185509dd388b984d978f6df7bf16 WatchSource:0}: Error finding container 1287ab76733790c1099c154d8b44992c8f67185509dd388b984d978f6df7bf16: Status 404 returned error can't find the container with id 1287ab76733790c1099c154d8b44992c8f67185509dd388b984d978f6df7bf16
Sep 18 13:50:02.974663 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:02.974575    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2" event={"ID":"adeb8047-14f1-44d3-8419-f5be177efc66","Type":"ContainerStarted","Data":"1287ab76733790c1099c154d8b44992c8f67185509dd388b984d978f6df7bf16"}
Sep 18 13:50:04.743769 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.743747    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"]
Sep 18 13:50:04.747322 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.747302    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"
Sep 18 13:50:04.750260 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.750235    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 18 13:50:04.750364 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.750269    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gnnpq\""
Sep 18 13:50:04.756473 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.754422    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"]
Sep 18 13:50:04.758051 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.758034    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:04.761254 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.761184    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"]
Sep 18 13:50:04.762806 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.762785    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-s27n8\""
Sep 18 13:50:04.763825 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.763806    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 18 13:50:04.784727 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.784701    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"]
Sep 18 13:50:04.798437 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.798191    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hzgm\" (UniqueName: \"kubernetes.io/projected/94a5c9d4-17c4-4963-962d-69f53b0d3b98-kube-api-access-6hzgm\") pod \"llmisvc-controller-manager-777c6bd7d5-mv44n\" (UID: \"94a5c9d4-17c4-4963-962d-69f53b0d3b98\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:04.798437 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.798290    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f700fcd-28c8-403d-9100-a67bcbea7504-cert\") pod \"kserve-controller-manager-d6f4b65b8-bnd97\" (UID: \"4f700fcd-28c8-403d-9100-a67bcbea7504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"
Sep 18 13:50:04.798437 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.798331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94a5c9d4-17c4-4963-962d-69f53b0d3b98-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mv44n\" (UID: \"94a5c9d4-17c4-4963-962d-69f53b0d3b98\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:04.798437 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.798361    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hddw\" (UniqueName: \"kubernetes.io/projected/4f700fcd-28c8-403d-9100-a67bcbea7504-kube-api-access-9hddw\") pod \"kserve-controller-manager-d6f4b65b8-bnd97\" (UID: \"4f700fcd-28c8-403d-9100-a67bcbea7504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"
Sep 18 13:50:04.899287 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.899251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hzgm\" (UniqueName: \"kubernetes.io/projected/94a5c9d4-17c4-4963-962d-69f53b0d3b98-kube-api-access-6hzgm\") pod \"llmisvc-controller-manager-777c6bd7d5-mv44n\" (UID: \"94a5c9d4-17c4-4963-962d-69f53b0d3b98\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:04.899455 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.899309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f700fcd-28c8-403d-9100-a67bcbea7504-cert\") pod \"kserve-controller-manager-d6f4b65b8-bnd97\" (UID: \"4f700fcd-28c8-403d-9100-a67bcbea7504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"
Sep 18 13:50:04.899455 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.899358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94a5c9d4-17c4-4963-962d-69f53b0d3b98-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mv44n\" (UID: \"94a5c9d4-17c4-4963-962d-69f53b0d3b98\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:04.899455 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.899401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hddw\" (UniqueName: \"kubernetes.io/projected/4f700fcd-28c8-403d-9100-a67bcbea7504-kube-api-access-9hddw\") pod \"kserve-controller-manager-d6f4b65b8-bnd97\" (UID: \"4f700fcd-28c8-403d-9100-a67bcbea7504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"
Sep 18 13:50:04.899580 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:50:04.899539    2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 18 13:50:04.899614 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:50:04.899607    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94a5c9d4-17c4-4963-962d-69f53b0d3b98-cert podName:94a5c9d4-17c4-4963-962d-69f53b0d3b98 nodeName:}" failed. No retries permitted until 2026-09-18 13:50:05.399585795 +0000 UTC m=+331.235424501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/94a5c9d4-17c4-4963-962d-69f53b0d3b98-cert") pod "llmisvc-controller-manager-777c6bd7d5-mv44n" (UID: "94a5c9d4-17c4-4963-962d-69f53b0d3b98") : secret "llmisvc-webhook-server-cert" not found
Sep 18 13:50:04.901791 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.901768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f700fcd-28c8-403d-9100-a67bcbea7504-cert\") pod \"kserve-controller-manager-d6f4b65b8-bnd97\" (UID: \"4f700fcd-28c8-403d-9100-a67bcbea7504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"
Sep 18 13:50:04.909673 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.909649    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hzgm\" (UniqueName: \"kubernetes.io/projected/94a5c9d4-17c4-4963-962d-69f53b0d3b98-kube-api-access-6hzgm\") pod \"llmisvc-controller-manager-777c6bd7d5-mv44n\" (UID: \"94a5c9d4-17c4-4963-962d-69f53b0d3b98\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:04.909804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.909786    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hddw\" (UniqueName: \"kubernetes.io/projected/4f700fcd-28c8-403d-9100-a67bcbea7504-kube-api-access-9hddw\") pod \"kserve-controller-manager-d6f4b65b8-bnd97\" (UID: \"4f700fcd-28c8-403d-9100-a67bcbea7504\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"
Sep 18 13:50:04.986717 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.986680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2" event={"ID":"adeb8047-14f1-44d3-8419-f5be177efc66","Type":"ContainerStarted","Data":"944e935b88a3ee74782453fb53a8a33b50bc635b660e690e308c198ee721eaf7"}
Sep 18 13:50:04.986876 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:04.986835    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:05.016454 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:05.016353    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2" podStartSLOduration=1.835293718 podStartE2EDuration="4.016337813s" totalImagesPullingTime="2.181044095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:50:05.010091494 +0000 UTC m=+330.845930209" watchObservedRunningTime="2026-09-18 13:50:05.016337813 +0000 UTC m=+330.852176525"
Sep 18 13:50:05.097929 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:05.097890    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"
Sep 18 13:50:05.372315 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:05.372286    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"]
Sep 18 13:50:05.374439 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:50:05.374409    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f700fcd_28c8_403d_9100_a67bcbea7504.slice/crio-b825d25d7efdf3df86ed1872c32e010b85a67c520cddc8181d32add5e5dc16fe WatchSource:0}: Error finding container b825d25d7efdf3df86ed1872c32e010b85a67c520cddc8181d32add5e5dc16fe: Status 404 returned error can't find the container with id b825d25d7efdf3df86ed1872c32e010b85a67c520cddc8181d32add5e5dc16fe
Sep 18 13:50:05.403984 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:05.403947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94a5c9d4-17c4-4963-962d-69f53b0d3b98-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mv44n\" (UID: \"94a5c9d4-17c4-4963-962d-69f53b0d3b98\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:05.404214 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:50:05.404184    2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 18 13:50:05.404307 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:50:05.404288    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94a5c9d4-17c4-4963-962d-69f53b0d3b98-cert podName:94a5c9d4-17c4-4963-962d-69f53b0d3b98 nodeName:}" failed. No retries permitted until 2026-09-18 13:50:06.404261594 +0000 UTC m=+332.240100297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/94a5c9d4-17c4-4963-962d-69f53b0d3b98-cert") pod "llmisvc-controller-manager-777c6bd7d5-mv44n" (UID: "94a5c9d4-17c4-4963-962d-69f53b0d3b98") : secret "llmisvc-webhook-server-cert" not found
Sep 18 13:50:05.992231 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:05.992193    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97" event={"ID":"4f700fcd-28c8-403d-9100-a67bcbea7504","Type":"ContainerStarted","Data":"b825d25d7efdf3df86ed1872c32e010b85a67c520cddc8181d32add5e5dc16fe"}
Sep 18 13:50:06.413153 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:06.413094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94a5c9d4-17c4-4963-962d-69f53b0d3b98-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mv44n\" (UID: \"94a5c9d4-17c4-4963-962d-69f53b0d3b98\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:06.416184 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:06.416157    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94a5c9d4-17c4-4963-962d-69f53b0d3b98-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mv44n\" (UID: \"94a5c9d4-17c4-4963-962d-69f53b0d3b98\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:06.611973 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:06.611936    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:06.901922 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:06.901882    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"]
Sep 18 13:50:08.132946 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:50:08.132903    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod94a5c9d4_17c4_4963_962d_69f53b0d3b98.slice/crio-2e879319c6b455617c5341a4df2fe3ecc47c635912ae95cb9e4247d39d9e50da WatchSource:0}: Error finding container 2e879319c6b455617c5341a4df2fe3ecc47c635912ae95cb9e4247d39d9e50da: Status 404 returned error can't find the container with id 2e879319c6b455617c5341a4df2fe3ecc47c635912ae95cb9e4247d39d9e50da
Sep 18 13:50:09.012393 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:09.012351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n" event={"ID":"94a5c9d4-17c4-4963-962d-69f53b0d3b98","Type":"ContainerStarted","Data":"2e879319c6b455617c5341a4df2fe3ecc47c635912ae95cb9e4247d39d9e50da"}
Sep 18 13:50:09.014157 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:09.014111    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97" event={"ID":"4f700fcd-28c8-403d-9100-a67bcbea7504","Type":"ContainerStarted","Data":"23e35c7ad5a7eeaed7c81de4161854d5aa3193d1c231b3410bff5799d1026515"}
Sep 18 13:50:09.014280 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:09.014209    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"
Sep 18 13:50:09.040379 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:09.040313    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97" podStartSLOduration=2.229590198 podStartE2EDuration="5.040288065s" totalImagesPullingTime="2.810697867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:50:09.039561737 +0000 UTC m=+334.875400459" watchObservedRunningTime="2026-09-18 13:50:09.040288065 +0000 UTC m=+334.876126779"
Sep 18 13:50:09.961853 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:09.961819    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9kk4g"
Sep 18 13:50:11.027190 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:11.027156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n" event={"ID":"94a5c9d4-17c4-4963-962d-69f53b0d3b98","Type":"ContainerStarted","Data":"9b80f455deb4d6db0fcf51919a105f71ce1a162ba3fbd52688dcd87184bc32c2"}
Sep 18 13:50:11.027606 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:11.027261    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:11.052615 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:11.052507    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n" podStartSLOduration=4.388093802 podStartE2EDuration="7.052489615s" totalImagesPullingTime="2.664395813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:50:11.05014818 +0000 UTC m=+336.885986891" watchObservedRunningTime="2026-09-18 13:50:11.052489615 +0000 UTC m=+336.888328327"
Sep 18 13:50:15.994680 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:15.994640    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6cdc5b77c9-7b4w2"
Sep 18 13:50:40.026549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:40.026474    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnd97"
Sep 18 13:50:42.034540 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:42.034512    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mv44n"
Sep 18 13:50:43.845061 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.845028    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d6bcf46bc-h6xsb"]
Sep 18 13:50:43.858023 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.857983    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.860271 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.860244    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6bcf46bc-h6xsb"]
Sep 18 13:50:43.860979 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.860954    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 13:50:43.860979 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.860969    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 13:50:43.862255 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.862236    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 13:50:43.862365 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.862280    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wkjzx\""
Sep 18 13:50:43.862365 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.862321    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 13:50:43.862478 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.862388    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 13:50:43.862478 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.862441    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 13:50:43.862619 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.862604    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 13:50:43.864465 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.864445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce9ded1d-d195-45f8-a886-45ac505446e0-console-oauth-config\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.864580 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.864473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-oauth-serving-cert\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.864580 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.864521    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-service-ca\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.864580 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.864550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce9ded1d-d195-45f8-a886-45ac505446e0-console-serving-cert\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.864740 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.864579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-trusted-ca-bundle\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.864740 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.864686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-console-config\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.864830 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.864782    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh294\" (UniqueName: \"kubernetes.io/projected/ce9ded1d-d195-45f8-a886-45ac505446e0-kube-api-access-hh294\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.866553 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.866358    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 13:50:43.965448 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.965417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-service-ca\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.965657 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.965453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce9ded1d-d195-45f8-a886-45ac505446e0-console-serving-cert\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.965657 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.965478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-trusted-ca-bundle\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.965657 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.965510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-console-config\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.965657 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.965629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh294\" (UniqueName: \"kubernetes.io/projected/ce9ded1d-d195-45f8-a886-45ac505446e0-kube-api-access-hh294\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.965881 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.965694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce9ded1d-d195-45f8-a886-45ac505446e0-console-oauth-config\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.965881 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.965711    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-oauth-serving-cert\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.966243 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.966218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-console-config\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.966358 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.966327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-service-ca\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.966409 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.966355    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-oauth-serving-cert\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.966471 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.966449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce9ded1d-d195-45f8-a886-45ac505446e0-trusted-ca-bundle\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.967991 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.967970    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce9ded1d-d195-45f8-a886-45ac505446e0-console-serving-cert\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.968221 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.968204    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce9ded1d-d195-45f8-a886-45ac505446e0-console-oauth-config\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:43.974525 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:43.974503    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh294\" (UniqueName: \"kubernetes.io/projected/ce9ded1d-d195-45f8-a886-45ac505446e0-kube-api-access-hh294\") pod \"console-d6bcf46bc-h6xsb\" (UID: \"ce9ded1d-d195-45f8-a886-45ac505446e0\") " pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:44.169961 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:44.169871    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:44.441388 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:44.441362    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6bcf46bc-h6xsb"]
Sep 18 13:50:44.443650 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:50:44.443625    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9ded1d_d195_45f8_a886_45ac505446e0.slice/crio-3b61763769f856d2b1f23f700cf9af4512acfd036802ee3c537a65191bd7b0f4 WatchSource:0}: Error finding container 3b61763769f856d2b1f23f700cf9af4512acfd036802ee3c537a65191bd7b0f4: Status 404 returned error can't find the container with id 3b61763769f856d2b1f23f700cf9af4512acfd036802ee3c537a65191bd7b0f4
Sep 18 13:50:45.197660 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:45.197624    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6bcf46bc-h6xsb" event={"ID":"ce9ded1d-d195-45f8-a886-45ac505446e0","Type":"ContainerStarted","Data":"4ea10584d93a31fd85f85535f02d226315a376e9701f0a3e881049974765cc31"}
Sep 18 13:50:45.198050 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:45.197671    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6bcf46bc-h6xsb" event={"ID":"ce9ded1d-d195-45f8-a886-45ac505446e0","Type":"ContainerStarted","Data":"3b61763769f856d2b1f23f700cf9af4512acfd036802ee3c537a65191bd7b0f4"}
Sep 18 13:50:45.218178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:45.218103    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d6bcf46bc-h6xsb" podStartSLOduration=2.218088181 podStartE2EDuration="2.218088181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:50:45.216443241 +0000 UTC m=+371.052281953" watchObservedRunningTime="2026-09-18 13:50:45.218088181 +0000 UTC m=+371.053926893"
Sep 18 13:50:54.170885 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:54.170847    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:54.171398 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:54.170926    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:54.175630 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:54.175609    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:50:54.245720 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:50:54.245693    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d6bcf46bc-h6xsb"
Sep 18 13:51:32.131649 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.131610    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"]
Sep 18 13:51:32.135319 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.135296    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:32.138411 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.138390    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 13:51:32.138991 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.138976    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rfdfx\""
Sep 18 13:51:32.140331 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.140316    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 13:51:32.153087 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.153055    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"]
Sep 18 13:51:32.216281 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.216241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" (UID: \"98495c48-ef55-4e81-af23-a6a5f1bb9cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:32.216452 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.216402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h6mc\" (UniqueName: \"kubernetes.io/projected/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-kube-api-access-7h6mc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" (UID: \"98495c48-ef55-4e81-af23-a6a5f1bb9cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:32.317780 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.317731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h6mc\" (UniqueName: \"kubernetes.io/projected/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-kube-api-access-7h6mc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" (UID: \"98495c48-ef55-4e81-af23-a6a5f1bb9cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:32.317990 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.317855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" (UID: \"98495c48-ef55-4e81-af23-a6a5f1bb9cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:32.318558 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.318522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" (UID: \"98495c48-ef55-4e81-af23-a6a5f1bb9cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:32.336919 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.336885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h6mc\" (UniqueName: \"kubernetes.io/projected/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-kube-api-access-7h6mc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" (UID: \"98495c48-ef55-4e81-af23-a6a5f1bb9cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:32.446280 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.446191    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:32.737510 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:32.737483    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"]
Sep 18 13:51:32.740013 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:51:32.739974    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98495c48_ef55_4e81_af23_a6a5f1bb9cbc.slice/crio-1ce5c30b9dc61397e24d8685a67c72bfbbf8b8043ae995e22ba11783b12b79f4 WatchSource:0}: Error finding container 1ce5c30b9dc61397e24d8685a67c72bfbbf8b8043ae995e22ba11783b12b79f4: Status 404 returned error can't find the container with id 1ce5c30b9dc61397e24d8685a67c72bfbbf8b8043ae995e22ba11783b12b79f4
Sep 18 13:51:33.435897 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:33.435861    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4" event={"ID":"98495c48-ef55-4e81-af23-a6a5f1bb9cbc","Type":"ContainerStarted","Data":"1ce5c30b9dc61397e24d8685a67c72bfbbf8b8043ae995e22ba11783b12b79f4"}
Sep 18 13:51:37.460957 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:37.460919    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4" event={"ID":"98495c48-ef55-4e81-af23-a6a5f1bb9cbc","Type":"ContainerStarted","Data":"4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c"}
Sep 18 13:51:37.461483 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:37.460995    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:37.498803 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:37.498754    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4" podStartSLOduration=1.390773903 podStartE2EDuration="5.498739562s" totalImagesPullingTime="4.107965659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:51:37.497415347 +0000 UTC m=+423.333254061" watchObservedRunningTime="2026-09-18 13:51:37.498739562 +0000 UTC m=+423.334578274"
Sep 18 13:51:48.468236 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:48.468162    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:50.684074 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.684041    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"]
Sep 18 13:51:50.684518 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.684225    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" containerName="manager" containerID="cri-o://4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c" gracePeriod=2
Sep 18 13:51:50.688667 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.688641    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"]
Sep 18 13:51:50.689145 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:51:50.689102    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" is forbidden: User \"system:node:ip-10-0-136-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-76.ec2.internal' and this object" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:50.719603 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.719563    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"]
Sep 18 13:51:50.720230 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.720211    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" containerName="manager"
Sep 18 13:51:50.720311 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.720233    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" containerName="manager"
Sep 18 13:51:50.720373 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.720359    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" containerName="manager"
Sep 18 13:51:50.727758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.727735    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:51:50.731659 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:51:50.731626    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" is forbidden: User \"system:node:ip-10-0-136-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-76.ec2.internal' and this object" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:50.739060 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.739039    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"]
Sep 18 13:51:50.794861 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.794829    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c0350ec-77a3-46c7-8651-41661b4fb009-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qq6k6\" (UID: \"9c0350ec-77a3-46c7-8651-41661b4fb009\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:51:50.794861 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.794862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85f5g\" (UniqueName: \"kubernetes.io/projected/9c0350ec-77a3-46c7-8651-41661b4fb009-kube-api-access-85f5g\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qq6k6\" (UID: \"9c0350ec-77a3-46c7-8651-41661b4fb009\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:51:50.895728 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.895690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c0350ec-77a3-46c7-8651-41661b4fb009-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qq6k6\" (UID: \"9c0350ec-77a3-46c7-8651-41661b4fb009\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:51:50.895728 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.895732    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85f5g\" (UniqueName: \"kubernetes.io/projected/9c0350ec-77a3-46c7-8651-41661b4fb009-kube-api-access-85f5g\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qq6k6\" (UID: \"9c0350ec-77a3-46c7-8651-41661b4fb009\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:51:50.896198 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.896172    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c0350ec-77a3-46c7-8651-41661b4fb009-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qq6k6\" (UID: \"9c0350ec-77a3-46c7-8651-41661b4fb009\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:51:50.906339 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.906315    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85f5g\" (UniqueName: \"kubernetes.io/projected/9c0350ec-77a3-46c7-8651-41661b4fb009-kube-api-access-85f5g\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qq6k6\" (UID: \"9c0350ec-77a3-46c7-8651-41661b4fb009\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:51:50.927318 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.927292    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:50.929949 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:51:50.929922    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" is forbidden: User \"system:node:ip-10-0-136-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-76.ec2.internal' and this object" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:50.996520 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.996435    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h6mc\" (UniqueName: \"kubernetes.io/projected/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-kube-api-access-7h6mc\") pod \"98495c48-ef55-4e81-af23-a6a5f1bb9cbc\" (UID: \"98495c48-ef55-4e81-af23-a6a5f1bb9cbc\") "
Sep 18 13:51:50.996520 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.996477    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-extensions-socket-volume\") pod \"98495c48-ef55-4e81-af23-a6a5f1bb9cbc\" (UID: \"98495c48-ef55-4e81-af23-a6a5f1bb9cbc\") "
Sep 18 13:51:50.997004 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.996980    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "98495c48-ef55-4e81-af23-a6a5f1bb9cbc" (UID: "98495c48-ef55-4e81-af23-a6a5f1bb9cbc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:51:50.998719 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:50.998693    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-kube-api-access-7h6mc" (OuterVolumeSpecName: "kube-api-access-7h6mc") pod "98495c48-ef55-4e81-af23-a6a5f1bb9cbc" (UID: "98495c48-ef55-4e81-af23-a6a5f1bb9cbc"). InnerVolumeSpecName "kube-api-access-7h6mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:51:51.071330 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.071295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:51:51.097433 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.097405    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h6mc\" (UniqueName: \"kubernetes.io/projected/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-kube-api-access-7h6mc\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:51:51.097433 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.097432    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98495c48-ef55-4e81-af23-a6a5f1bb9cbc-extensions-socket-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:51:51.377718 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.377677    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"]
Sep 18 13:51:51.383688 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:51:51.383659    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0350ec_77a3_46c7_8651_41661b4fb009.slice/crio-220f22625512df76281a140200f1dd5a5f6596ead181332281232576f53c128c WatchSource:0}: Error finding container 220f22625512df76281a140200f1dd5a5f6596ead181332281232576f53c128c: Status 404 returned error can't find the container with id 220f22625512df76281a140200f1dd5a5f6596ead181332281232576f53c128c
Sep 18 13:51:51.534867 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.534833    2575 generic.go:356] "Generic (PLEG): container finished" podID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" containerID="4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c" exitCode=0
Sep 18 13:51:51.535074 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.534883    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:51.535074 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.534944    2575 scope.go:117] "RemoveContainer" containerID="4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c"
Sep 18 13:51:51.537298 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.537258    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6" event={"ID":"9c0350ec-77a3-46c7-8651-41661b4fb009","Type":"ContainerStarted","Data":"659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d"}
Sep 18 13:51:51.537419 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.537336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6" event={"ID":"9c0350ec-77a3-46c7-8651-41661b4fb009","Type":"ContainerStarted","Data":"220f22625512df76281a140200f1dd5a5f6596ead181332281232576f53c128c"}
Sep 18 13:51:51.537419 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.537380    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:51:51.538357 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:51:51.538331    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" is forbidden: User \"system:node:ip-10-0-136-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-76.ec2.internal' and this object" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:51.544728 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.544708    2575 scope.go:117] "RemoveContainer" containerID="4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c"
Sep 18 13:51:51.545041 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:51:51.545015    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c\": container with ID starting with 4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c not found: ID does not exist" containerID="4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c"
Sep 18 13:51:51.545154 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.545048    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c"} err="failed to get container status \"4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c\": rpc error: code = NotFound desc = could not find container \"4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c\": container with ID starting with 4603600cdde9fc95b87ca0b49d418e537323ff8269449de117d33cacfb3bfa3c not found: ID does not exist"
Sep 18 13:51:51.564010 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:51.563963    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6" podStartSLOduration=1.563948952 podStartE2EDuration="1.563948952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:51:51.563121305 +0000 UTC m=+437.398960019" watchObservedRunningTime="2026-09-18 13:51:51.563948952 +0000 UTC m=+437.399787665"
Sep 18 13:51:51.565603 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:51:51.565576    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" is forbidden: User \"system:node:ip-10-0-136-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-76.ec2.internal' and this object" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:51.568148 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:51:51.568117    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" is forbidden: User \"system:node:ip-10-0-136-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-76.ec2.internal' and this object" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:52.088077 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.088043    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"]
Sep 18 13:51:52.092602 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.092583    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 13:51:52.095310 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:51:52.095283    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-vzml4\" is forbidden: User \"system:node:ip-10-0-136-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-76.ec2.internal' and this object" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-vzml4"
Sep 18 13:51:52.105974 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.105951    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"]
Sep 18 13:51:52.207416 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.207381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr742\" (UniqueName: \"kubernetes.io/projected/1728b4fd-e854-4f7e-a663-81f51b57e2f5-kube-api-access-vr742\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7bjr7\" (UID: \"1728b4fd-e854-4f7e-a663-81f51b57e2f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 13:51:52.207591 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.207482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1728b4fd-e854-4f7e-a663-81f51b57e2f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7bjr7\" (UID: \"1728b4fd-e854-4f7e-a663-81f51b57e2f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 13:51:52.292745 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.292709    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98495c48-ef55-4e81-af23-a6a5f1bb9cbc" path="/var/lib/kubelet/pods/98495c48-ef55-4e81-af23-a6a5f1bb9cbc/volumes"
Sep 18 13:51:52.308986 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.308952    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1728b4fd-e854-4f7e-a663-81f51b57e2f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7bjr7\" (UID: \"1728b4fd-e854-4f7e-a663-81f51b57e2f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 13:51:52.309104 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.309035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr742\" (UniqueName: \"kubernetes.io/projected/1728b4fd-e854-4f7e-a663-81f51b57e2f5-kube-api-access-vr742\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7bjr7\" (UID: \"1728b4fd-e854-4f7e-a663-81f51b57e2f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 13:51:52.309384 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.309364    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1728b4fd-e854-4f7e-a663-81f51b57e2f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7bjr7\" (UID: \"1728b4fd-e854-4f7e-a663-81f51b57e2f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 13:51:52.324051 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.324014    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr742\" (UniqueName: \"kubernetes.io/projected/1728b4fd-e854-4f7e-a663-81f51b57e2f5-kube-api-access-vr742\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7bjr7\" (UID: \"1728b4fd-e854-4f7e-a663-81f51b57e2f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 13:51:52.403362 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.403287    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 13:51:52.708337 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:52.708249    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"]
Sep 18 13:51:52.714503 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:51:52.714472    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1728b4fd_e854_4f7e_a663_81f51b57e2f5.slice/crio-f1597fb7017a3811b5a1b4ef15228b31809953f2c0c8964cec75b961644a2093 WatchSource:0}: Error finding container f1597fb7017a3811b5a1b4ef15228b31809953f2c0c8964cec75b961644a2093: Status 404 returned error can't find the container with id f1597fb7017a3811b5a1b4ef15228b31809953f2c0c8964cec75b961644a2093
Sep 18 13:51:53.550657 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:53.550614    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7" event={"ID":"1728b4fd-e854-4f7e-a663-81f51b57e2f5","Type":"ContainerStarted","Data":"f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c"}
Sep 18 13:51:53.551035 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:53.550682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7" event={"ID":"1728b4fd-e854-4f7e-a663-81f51b57e2f5","Type":"ContainerStarted","Data":"f1597fb7017a3811b5a1b4ef15228b31809953f2c0c8964cec75b961644a2093"}
Sep 18 13:51:53.551035 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:51:53.550734    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 13:52:02.545947 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:02.545915    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:52:02.571332 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:02.571278    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7" podStartSLOduration=10.571260587 podStartE2EDuration="10.571260587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:51:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:51:53.573289414 +0000 UTC m=+439.409128129" watchObservedRunningTime="2026-09-18 13:52:02.571260587 +0000 UTC m=+448.407099299"
Sep 18 13:52:04.556978 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:04.556943    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 13:52:04.627353 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:04.627324    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"]
Sep 18 13:52:04.627575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:04.627523    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6" podUID="9c0350ec-77a3-46c7-8651-41661b4fb009" containerName="manager" containerID="cri-o://659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d" gracePeriod=10
Sep 18 13:52:04.868166 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:04.868125    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:52:04.924601 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:04.924572    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85f5g\" (UniqueName: \"kubernetes.io/projected/9c0350ec-77a3-46c7-8651-41661b4fb009-kube-api-access-85f5g\") pod \"9c0350ec-77a3-46c7-8651-41661b4fb009\" (UID: \"9c0350ec-77a3-46c7-8651-41661b4fb009\") "
Sep 18 13:52:04.924777 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:04.924630    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c0350ec-77a3-46c7-8651-41661b4fb009-extensions-socket-volume\") pod \"9c0350ec-77a3-46c7-8651-41661b4fb009\" (UID: \"9c0350ec-77a3-46c7-8651-41661b4fb009\") "
Sep 18 13:52:04.924944 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:04.924919    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c0350ec-77a3-46c7-8651-41661b4fb009-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c0350ec-77a3-46c7-8651-41661b4fb009" (UID: "9c0350ec-77a3-46c7-8651-41661b4fb009"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:52:04.926706 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:04.926679    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c0350ec-77a3-46c7-8651-41661b4fb009-kube-api-access-85f5g" (OuterVolumeSpecName: "kube-api-access-85f5g") pod "9c0350ec-77a3-46c7-8651-41661b4fb009" (UID: "9c0350ec-77a3-46c7-8651-41661b4fb009"). InnerVolumeSpecName "kube-api-access-85f5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:52:05.025329 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:05.025298    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85f5g\" (UniqueName: \"kubernetes.io/projected/9c0350ec-77a3-46c7-8651-41661b4fb009-kube-api-access-85f5g\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:52:05.025329 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:05.025325    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c0350ec-77a3-46c7-8651-41661b4fb009-extensions-socket-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:52:05.610265 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:05.610232    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c0350ec-77a3-46c7-8651-41661b4fb009" containerID="659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d" exitCode=0
Sep 18 13:52:05.610686 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:05.610287    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"
Sep 18 13:52:05.610686 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:05.610309    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6" event={"ID":"9c0350ec-77a3-46c7-8651-41661b4fb009","Type":"ContainerDied","Data":"659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d"}
Sep 18 13:52:05.610686 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:05.610367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6" event={"ID":"9c0350ec-77a3-46c7-8651-41661b4fb009","Type":"ContainerDied","Data":"220f22625512df76281a140200f1dd5a5f6596ead181332281232576f53c128c"}
Sep 18 13:52:05.610686 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:05.610390    2575 scope.go:117] "RemoveContainer" containerID="659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d"
Sep 18 13:52:05.620435 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:05.620417    2575 scope.go:117] "RemoveContainer" containerID="659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d"
Sep 18 13:52:05.620690 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:52:05.620672    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d\": container with ID starting with 659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d not found: ID does not exist" containerID="659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d"
Sep 18 13:52:05.620747 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:05.620699    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d"} err="failed to get container status \"659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d\": rpc error: code = NotFound desc = could not find container \"659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d\": container with ID starting with 659f4bac69ce95830a71f3bc08e3d67847e2ab9253d7b04edc8efccaacaf7a9d not found: ID does not exist"
Sep 18 13:52:05.639949 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:05.639927    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"]
Sep 18 13:52:05.645784 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:05.645759    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qq6k6"]
Sep 18 13:52:06.292335 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:06.292302    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c0350ec-77a3-46c7-8651-41661b4fb009" path="/var/lib/kubelet/pods/9c0350ec-77a3-46c7-8651-41661b4fb009/volumes"
Sep 18 13:52:21.187953 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.187919    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"]
Sep 18 13:52:21.188425 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.188330    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0350ec-77a3-46c7-8651-41661b4fb009" containerName="manager"
Sep 18 13:52:21.188425 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.188341    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0350ec-77a3-46c7-8651-41661b4fb009" containerName="manager"
Sep 18 13:52:21.188425 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.188406    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c0350ec-77a3-46c7-8651-41661b4fb009" containerName="manager"
Sep 18 13:52:21.190802 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.190784    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.193620 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.193595    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9tw4s\""
Sep 18 13:52:21.205204 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.205179    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"]
Sep 18 13:52:21.271763 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.271724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.271763 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.271767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjwkb\" (UniqueName: \"kubernetes.io/projected/a0799f42-d527-43eb-9dc7-189bc2dc4893-kube-api-access-rjwkb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.272007 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.271832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.272007 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.271877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.272007 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.271893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.272007 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.271953    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.272007 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.271969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.272007 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.271997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0799f42-d527-43eb-9dc7-189bc2dc4893-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.272379 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.272034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373114 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373114 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0799f42-d527-43eb-9dc7-189bc2dc4893-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjwkb\" (UniqueName: \"kubernetes.io/projected/a0799f42-d527-43eb-9dc7-189bc2dc4893-kube-api-access-rjwkb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373345    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373666 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373666 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373495    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373666 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373562    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373826 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373704    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373826 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373796    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.373918 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.373880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0799f42-d527-43eb-9dc7-189bc2dc4893-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.375709 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.375688    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.375911 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.375894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.384825 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.384796    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0799f42-d527-43eb-9dc7-189bc2dc4893-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.384915 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.384827    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjwkb\" (UniqueName: \"kubernetes.io/projected/a0799f42-d527-43eb-9dc7-189bc2dc4893-kube-api-access-rjwkb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2bw5x\" (UID: \"a0799f42-d527-43eb-9dc7-189bc2dc4893\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.500970 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.500879    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:21.779783 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.779755    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"]
Sep 18 13:52:21.781814 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:52:21.781789    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0799f42_d527_43eb_9dc7_189bc2dc4893.slice/crio-916f66a186116193a4dc3c0063e89be9806cdf0d223cd392bc2a2e33160ef30e WatchSource:0}: Error finding container 916f66a186116193a4dc3c0063e89be9806cdf0d223cd392bc2a2e33160ef30e: Status 404 returned error can't find the container with id 916f66a186116193a4dc3c0063e89be9806cdf0d223cd392bc2a2e33160ef30e
Sep 18 13:52:21.783952 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.783923    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:52:21.784027 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.783986    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:52:21.784027 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:21.784024    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:52:22.698360 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:22.698321    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x" event={"ID":"a0799f42-d527-43eb-9dc7-189bc2dc4893","Type":"ContainerStarted","Data":"373d1eaa274b0cd95060d849658403d28b153d467bc9081f21a6cd3903183a46"}
Sep 18 13:52:22.698757 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:22.698407    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x" event={"ID":"a0799f42-d527-43eb-9dc7-189bc2dc4893","Type":"ContainerStarted","Data":"916f66a186116193a4dc3c0063e89be9806cdf0d223cd392bc2a2e33160ef30e"}
Sep 18 13:52:22.734869 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:22.734814    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x" podStartSLOduration=1.734798771 podStartE2EDuration="1.734798771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:52:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:52:22.731430677 +0000 UTC m=+468.567269393" watchObservedRunningTime="2026-09-18 13:52:22.734798771 +0000 UTC m=+468.570637485"
Sep 18 13:52:23.501211 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:23.501179    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:23.505896 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:23.505869    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:23.703608 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:23.703574    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:23.704593 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:23.704572    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:52:23.971716 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:23.971678    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8xqhl"]
Sep 18 13:52:23.974707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:23.974683    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:23.978869 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:23.978846    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 18 13:52:23.979008 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:23.978846    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xhqst\""
Sep 18 13:52:24.022151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.022101    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8xqhl"]
Sep 18 13:52:24.098843 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.098808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8czg\" (UniqueName: \"kubernetes.io/projected/d46d12d7-a122-462e-bc6f-628f4de9adbd-kube-api-access-r8czg\") pod \"limitador-limitador-8588749977-8xqhl\" (UID: \"d46d12d7-a122-462e-bc6f-628f4de9adbd\") " pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:24.099041 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.098927    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d46d12d7-a122-462e-bc6f-628f4de9adbd-config-file\") pod \"limitador-limitador-8588749977-8xqhl\" (UID: \"d46d12d7-a122-462e-bc6f-628f4de9adbd\") " pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:24.112835 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.112807    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8xqhl"]
Sep 18 13:52:24.200070 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.200034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d46d12d7-a122-462e-bc6f-628f4de9adbd-config-file\") pod \"limitador-limitador-8588749977-8xqhl\" (UID: \"d46d12d7-a122-462e-bc6f-628f4de9adbd\") " pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:24.200262 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.200166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8czg\" (UniqueName: \"kubernetes.io/projected/d46d12d7-a122-462e-bc6f-628f4de9adbd-kube-api-access-r8czg\") pod \"limitador-limitador-8588749977-8xqhl\" (UID: \"d46d12d7-a122-462e-bc6f-628f4de9adbd\") " pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:24.200696 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.200675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d46d12d7-a122-462e-bc6f-628f4de9adbd-config-file\") pod \"limitador-limitador-8588749977-8xqhl\" (UID: \"d46d12d7-a122-462e-bc6f-628f4de9adbd\") " pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:24.218648 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.218613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8czg\" (UniqueName: \"kubernetes.io/projected/d46d12d7-a122-462e-bc6f-628f4de9adbd-kube-api-access-r8czg\") pod \"limitador-limitador-8588749977-8xqhl\" (UID: \"d46d12d7-a122-462e-bc6f-628f4de9adbd\") " pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:24.285331 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.285249    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:24.565228 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.565203    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8xqhl"]
Sep 18 13:52:24.566941 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:52:24.566890    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46d12d7_a122_462e_bc6f_628f4de9adbd.slice/crio-d7286ae35b131788dc22167fbacbe07f3a31c4303cdf266712c66aca84d313e9 WatchSource:0}: Error finding container d7286ae35b131788dc22167fbacbe07f3a31c4303cdf266712c66aca84d313e9: Status 404 returned error can't find the container with id d7286ae35b131788dc22167fbacbe07f3a31c4303cdf266712c66aca84d313e9
Sep 18 13:52:24.709683 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.709648    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl" event={"ID":"d46d12d7-a122-462e-bc6f-628f4de9adbd","Type":"ContainerStarted","Data":"d7286ae35b131788dc22167fbacbe07f3a31c4303cdf266712c66aca84d313e9"}
Sep 18 13:52:24.956275 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.956182    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wrfbh"]
Sep 18 13:52:24.959575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.959551    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh"
Sep 18 13:52:24.962449 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.962429    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9j8ss\""
Sep 18 13:52:24.968073 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:24.968050    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wrfbh"]
Sep 18 13:52:25.008430 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:25.008398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk89m\" (UniqueName: \"kubernetes.io/projected/8ae693c3-e3f0-404e-ae3e-09e9f4170306-kube-api-access-pk89m\") pod \"authorino-7bcfd8f9cd-wrfbh\" (UID: \"8ae693c3-e3f0-404e-ae3e-09e9f4170306\") " pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh"
Sep 18 13:52:25.109410 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:25.109376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk89m\" (UniqueName: \"kubernetes.io/projected/8ae693c3-e3f0-404e-ae3e-09e9f4170306-kube-api-access-pk89m\") pod \"authorino-7bcfd8f9cd-wrfbh\" (UID: \"8ae693c3-e3f0-404e-ae3e-09e9f4170306\") " pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh"
Sep 18 13:52:25.121124 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:25.121089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk89m\" (UniqueName: \"kubernetes.io/projected/8ae693c3-e3f0-404e-ae3e-09e9f4170306-kube-api-access-pk89m\") pod \"authorino-7bcfd8f9cd-wrfbh\" (UID: \"8ae693c3-e3f0-404e-ae3e-09e9f4170306\") " pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh"
Sep 18 13:52:25.270225 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:25.270127    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh"
Sep 18 13:52:25.547500 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:25.547462    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wrfbh"]
Sep 18 13:52:25.549997 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:52:25.549968    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ae693c3_e3f0_404e_ae3e_09e9f4170306.slice/crio-1870d227eb965f742fc55bee5a21457df59c21c09c4bdb45cefda35af979edb4 WatchSource:0}: Error finding container 1870d227eb965f742fc55bee5a21457df59c21c09c4bdb45cefda35af979edb4: Status 404 returned error can't find the container with id 1870d227eb965f742fc55bee5a21457df59c21c09c4bdb45cefda35af979edb4
Sep 18 13:52:25.717088 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:25.717046    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh" event={"ID":"8ae693c3-e3f0-404e-ae3e-09e9f4170306","Type":"ContainerStarted","Data":"1870d227eb965f742fc55bee5a21457df59c21c09c4bdb45cefda35af979edb4"}
Sep 18 13:52:26.724822 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:26.724784    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl" event={"ID":"d46d12d7-a122-462e-bc6f-628f4de9adbd","Type":"ContainerStarted","Data":"634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade"}
Sep 18 13:52:26.725291 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:26.724967    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:26.745317 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:26.745257    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl" podStartSLOduration=2.494378401 podStartE2EDuration="3.745236046s" totalImagesPullingTime="1.250857645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:52:26.743639539 +0000 UTC m=+472.579478248" watchObservedRunningTime="2026-09-18 13:52:26.745236046 +0000 UTC m=+472.581074757"
Sep 18 13:52:27.731844 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:27.731807    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh" event={"ID":"8ae693c3-e3f0-404e-ae3e-09e9f4170306","Type":"ContainerStarted","Data":"c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc"}
Sep 18 13:52:27.752623 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:27.752575    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh" podStartSLOduration=2.078150367 podStartE2EDuration="3.752561287s" totalImagesPullingTime="1.67441092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:52:27.75026653 +0000 UTC m=+473.586105243" watchObservedRunningTime="2026-09-18 13:52:27.752561287 +0000 UTC m=+473.588399999"
Sep 18 13:52:29.495060 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:29.495020    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wrfbh"]
Sep 18 13:52:29.742837 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:29.742797    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh" podUID="8ae693c3-e3f0-404e-ae3e-09e9f4170306" containerName="authorino" containerID="cri-o://c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc" gracePeriod=30
Sep 18 13:52:29.993694 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:29.993666    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh"
Sep 18 13:52:30.056253 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.056231    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk89m\" (UniqueName: \"kubernetes.io/projected/8ae693c3-e3f0-404e-ae3e-09e9f4170306-kube-api-access-pk89m\") pod \"8ae693c3-e3f0-404e-ae3e-09e9f4170306\" (UID: \"8ae693c3-e3f0-404e-ae3e-09e9f4170306\") "
Sep 18 13:52:30.058410 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.058374    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae693c3-e3f0-404e-ae3e-09e9f4170306-kube-api-access-pk89m" (OuterVolumeSpecName: "kube-api-access-pk89m") pod "8ae693c3-e3f0-404e-ae3e-09e9f4170306" (UID: "8ae693c3-e3f0-404e-ae3e-09e9f4170306"). InnerVolumeSpecName "kube-api-access-pk89m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:52:30.157554 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.157513    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk89m\" (UniqueName: \"kubernetes.io/projected/8ae693c3-e3f0-404e-ae3e-09e9f4170306-kube-api-access-pk89m\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:52:30.748913 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.748872    2575 generic.go:356] "Generic (PLEG): container finished" podID="8ae693c3-e3f0-404e-ae3e-09e9f4170306" containerID="c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc" exitCode=0
Sep 18 13:52:30.749399 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.748919    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh"
Sep 18 13:52:30.749399 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.748954    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh" event={"ID":"8ae693c3-e3f0-404e-ae3e-09e9f4170306","Type":"ContainerDied","Data":"c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc"}
Sep 18 13:52:30.749399 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.748994    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-wrfbh" event={"ID":"8ae693c3-e3f0-404e-ae3e-09e9f4170306","Type":"ContainerDied","Data":"1870d227eb965f742fc55bee5a21457df59c21c09c4bdb45cefda35af979edb4"}
Sep 18 13:52:30.749399 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.749010    2575 scope.go:117] "RemoveContainer" containerID="c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc"
Sep 18 13:52:30.757485 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.757467    2575 scope.go:117] "RemoveContainer" containerID="c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc"
Sep 18 13:52:30.757761 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:52:30.757741    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc\": container with ID starting with c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc not found: ID does not exist" containerID="c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc"
Sep 18 13:52:30.757834 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.757768    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc"} err="failed to get container status \"c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc\": rpc error: code = NotFound desc = could not find container \"c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc\": container with ID starting with c241ee8476db58b762883cdf093b38802f9de0eb6cc37843f44bb299883307fc not found: ID does not exist"
Sep 18 13:52:30.767478 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.767457    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wrfbh"]
Sep 18 13:52:30.769960 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:30.769940    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wrfbh"]
Sep 18 13:52:32.293430 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:32.293392    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae693c3-e3f0-404e-ae3e-09e9f4170306" path="/var/lib/kubelet/pods/8ae693c3-e3f0-404e-ae3e-09e9f4170306/volumes"
Sep 18 13:52:36.228303 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:36.228275    2575 scope.go:117] "RemoveContainer" containerID="e29753f1550546ece0072306a154ddb6cf728ba0fb49cefd0d09f627c5ed95f5"
Sep 18 13:52:37.733186 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:37.733125    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:40.512733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:40.512696    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8xqhl"]
Sep 18 13:52:40.513237 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:40.512892    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl" podUID="d46d12d7-a122-462e-bc6f-628f4de9adbd" containerName="limitador" containerID="cri-o://634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade" gracePeriod=30
Sep 18 13:52:41.063454 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.063429    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:41.177986 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.177894    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d46d12d7-a122-462e-bc6f-628f4de9adbd-config-file\") pod \"d46d12d7-a122-462e-bc6f-628f4de9adbd\" (UID: \"d46d12d7-a122-462e-bc6f-628f4de9adbd\") "
Sep 18 13:52:41.178127 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.178004    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8czg\" (UniqueName: \"kubernetes.io/projected/d46d12d7-a122-462e-bc6f-628f4de9adbd-kube-api-access-r8czg\") pod \"d46d12d7-a122-462e-bc6f-628f4de9adbd\" (UID: \"d46d12d7-a122-462e-bc6f-628f4de9adbd\") "
Sep 18 13:52:41.178290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.178268    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d46d12d7-a122-462e-bc6f-628f4de9adbd-config-file" (OuterVolumeSpecName: "config-file") pod "d46d12d7-a122-462e-bc6f-628f4de9adbd" (UID: "d46d12d7-a122-462e-bc6f-628f4de9adbd"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:52:41.178369 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.178357    2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d46d12d7-a122-462e-bc6f-628f4de9adbd-config-file\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:52:41.180071 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.180049    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d46d12d7-a122-462e-bc6f-628f4de9adbd-kube-api-access-r8czg" (OuterVolumeSpecName: "kube-api-access-r8czg") pod "d46d12d7-a122-462e-bc6f-628f4de9adbd" (UID: "d46d12d7-a122-462e-bc6f-628f4de9adbd"). InnerVolumeSpecName "kube-api-access-r8czg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:52:41.278923 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.278890    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8czg\" (UniqueName: \"kubernetes.io/projected/d46d12d7-a122-462e-bc6f-628f4de9adbd-kube-api-access-r8czg\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:52:41.807307 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.807276    2575 generic.go:356] "Generic (PLEG): container finished" podID="d46d12d7-a122-462e-bc6f-628f4de9adbd" containerID="634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade" exitCode=0
Sep 18 13:52:41.807690 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.807320    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl"
Sep 18 13:52:41.807690 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.807347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl" event={"ID":"d46d12d7-a122-462e-bc6f-628f4de9adbd","Type":"ContainerDied","Data":"634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade"}
Sep 18 13:52:41.807690 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.807389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-8xqhl" event={"ID":"d46d12d7-a122-462e-bc6f-628f4de9adbd","Type":"ContainerDied","Data":"d7286ae35b131788dc22167fbacbe07f3a31c4303cdf266712c66aca84d313e9"}
Sep 18 13:52:41.807690 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.807409    2575 scope.go:117] "RemoveContainer" containerID="634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade"
Sep 18 13:52:41.817103 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.817086    2575 scope.go:117] "RemoveContainer" containerID="634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade"
Sep 18 13:52:41.817403 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:52:41.817385    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade\": container with ID starting with 634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade not found: ID does not exist" containerID="634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade"
Sep 18 13:52:41.817448 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.817411    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade"} err="failed to get container status \"634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade\": rpc error: code = NotFound desc = could not find container \"634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade\": container with ID starting with 634ee60e00b510a1982ee4148bb5acc1244f11b4477c77743f2d0bdfae88eade not found: ID does not exist"
Sep 18 13:52:41.831593 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.831565    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8xqhl"]
Sep 18 13:52:41.835987 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:41.835965    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8xqhl"]
Sep 18 13:52:42.292704 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:42.292625    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d46d12d7-a122-462e-bc6f-628f4de9adbd" path="/var/lib/kubelet/pods/d46d12d7-a122-462e-bc6f-628f4de9adbd/volumes"
Sep 18 13:52:45.640518 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.640487    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"]
Sep 18 13:52:45.641000 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.640882    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae693c3-e3f0-404e-ae3e-09e9f4170306" containerName="authorino"
Sep 18 13:52:45.641000 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.640893    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae693c3-e3f0-404e-ae3e-09e9f4170306" containerName="authorino"
Sep 18 13:52:45.641000 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.640906    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d46d12d7-a122-462e-bc6f-628f4de9adbd" containerName="limitador"
Sep 18 13:52:45.641000 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.640912    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d46d12d7-a122-462e-bc6f-628f4de9adbd" containerName="limitador"
Sep 18 13:52:45.641000 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.640969    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d46d12d7-a122-462e-bc6f-628f4de9adbd" containerName="limitador"
Sep 18 13:52:45.641000 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.640982    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae693c3-e3f0-404e-ae3e-09e9f4170306" containerName="authorino"
Sep 18 13:52:45.645455 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.645433    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"
Sep 18 13:52:45.648442 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.648420    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-8ml2m\""
Sep 18 13:52:45.648698 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.648679    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 18 13:52:45.648807 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.648709    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 13:52:45.649085 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.649070    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 13:52:45.655869 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.655843    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"]
Sep 18 13:52:45.720156 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.720097    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2e2f82d0-d411-400c-a776-0c85396395d6-data\") pod \"postgres-69fb4594cf-tfkxz\" (UID: \"2e2f82d0-d411-400c-a776-0c85396395d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"
Sep 18 13:52:45.720329 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.720193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8vkz\" (UniqueName: \"kubernetes.io/projected/2e2f82d0-d411-400c-a776-0c85396395d6-kube-api-access-d8vkz\") pod \"postgres-69fb4594cf-tfkxz\" (UID: \"2e2f82d0-d411-400c-a776-0c85396395d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"
Sep 18 13:52:45.821454 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.821418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2e2f82d0-d411-400c-a776-0c85396395d6-data\") pod \"postgres-69fb4594cf-tfkxz\" (UID: \"2e2f82d0-d411-400c-a776-0c85396395d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"
Sep 18 13:52:45.821625 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.821471    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8vkz\" (UniqueName: \"kubernetes.io/projected/2e2f82d0-d411-400c-a776-0c85396395d6-kube-api-access-d8vkz\") pod \"postgres-69fb4594cf-tfkxz\" (UID: \"2e2f82d0-d411-400c-a776-0c85396395d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"
Sep 18 13:52:45.821808 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.821787    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2e2f82d0-d411-400c-a776-0c85396395d6-data\") pod \"postgres-69fb4594cf-tfkxz\" (UID: \"2e2f82d0-d411-400c-a776-0c85396395d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"
Sep 18 13:52:45.833303 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.833276    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8vkz\" (UniqueName: \"kubernetes.io/projected/2e2f82d0-d411-400c-a776-0c85396395d6-kube-api-access-d8vkz\") pod \"postgres-69fb4594cf-tfkxz\" (UID: \"2e2f82d0-d411-400c-a776-0c85396395d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"
Sep 18 13:52:45.956331 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:45.956250    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"
Sep 18 13:52:46.230616 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:46.230588    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"]
Sep 18 13:52:46.232736 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:52:46.232707    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2f82d0_d411_400c_a776_0c85396395d6.slice/crio-dc417d16f9684abf0e5a63ca3d62f1874ab34ab7daf5b162002a4e798485a8aa WatchSource:0}: Error finding container dc417d16f9684abf0e5a63ca3d62f1874ab34ab7daf5b162002a4e798485a8aa: Status 404 returned error can't find the container with id dc417d16f9684abf0e5a63ca3d62f1874ab34ab7daf5b162002a4e798485a8aa
Sep 18 13:52:46.835996 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:46.835947    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz" event={"ID":"2e2f82d0-d411-400c-a776-0c85396395d6","Type":"ContainerStarted","Data":"dc417d16f9684abf0e5a63ca3d62f1874ab34ab7daf5b162002a4e798485a8aa"}
Sep 18 13:52:51.863480 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:51.863443    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz" event={"ID":"2e2f82d0-d411-400c-a776-0c85396395d6","Type":"ContainerStarted","Data":"de34a25d81231dd06e906f798449ffa61ee601c10c974794ff3de6fb10092111"}
Sep 18 13:52:51.863947 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:51.863615    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"
Sep 18 13:52:51.884279 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:51.884235    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz" podStartSLOduration=2.193248061 podStartE2EDuration="6.884219752s" totalImagesPullingTime="4.690971691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:52:51.883515381 +0000 UTC m=+497.719354094" watchObservedRunningTime="2026-09-18 13:52:51.884219752 +0000 UTC m=+497.720058465"
Sep 18 13:52:57.901224 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:57.901194    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tfkxz"
Sep 18 13:52:58.499270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.499238    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-9qllp"]
Sep 18 13:52:58.502420 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.502398    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9qllp"
Sep 18 13:52:58.505189 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.505165    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9j8ss\""
Sep 18 13:52:58.512678 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.512656    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-9qllp"]
Sep 18 13:52:58.544311 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.544279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzvqj\" (UniqueName: \"kubernetes.io/projected/e3ac1a52-5759-4bba-8b5a-4216bc8f670f-kube-api-access-kzvqj\") pod \"authorino-557f876f69-9qllp\" (UID: \"e3ac1a52-5759-4bba-8b5a-4216bc8f670f\") " pod="kuadrant-system/authorino-557f876f69-9qllp"
Sep 18 13:52:58.628838 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.628797    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-9qllp"]
Sep 18 13:52:58.629549 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:52:58.629517    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kzvqj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-9qllp" podUID="e3ac1a52-5759-4bba-8b5a-4216bc8f670f"
Sep 18 13:52:58.645071 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.645046    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzvqj\" (UniqueName: \"kubernetes.io/projected/e3ac1a52-5759-4bba-8b5a-4216bc8f670f-kube-api-access-kzvqj\") pod \"authorino-557f876f69-9qllp\" (UID: \"e3ac1a52-5759-4bba-8b5a-4216bc8f670f\") " pod="kuadrant-system/authorino-557f876f69-9qllp"
Sep 18 13:52:58.659744 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.659720    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzvqj\" (UniqueName: \"kubernetes.io/projected/e3ac1a52-5759-4bba-8b5a-4216bc8f670f-kube-api-access-kzvqj\") pod \"authorino-557f876f69-9qllp\" (UID: \"e3ac1a52-5759-4bba-8b5a-4216bc8f670f\") " pod="kuadrant-system/authorino-557f876f69-9qllp"
Sep 18 13:52:58.787700 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.787612    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7479487454-pq4jq"]
Sep 18 13:52:58.790451 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.790429    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7479487454-pq4jq"
Sep 18 13:52:58.793552 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.793531    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 18 13:52:58.801171 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.801146    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7479487454-pq4jq"]
Sep 18 13:52:58.847165 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.847117    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe429afb-c6c5-49f8-b279-339d13a76b7d-tls-cert\") pod \"authorino-7479487454-pq4jq\" (UID: \"fe429afb-c6c5-49f8-b279-339d13a76b7d\") " pod="kuadrant-system/authorino-7479487454-pq4jq"
Sep 18 13:52:58.847326 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.847174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tlg6\" (UniqueName: \"kubernetes.io/projected/fe429afb-c6c5-49f8-b279-339d13a76b7d-kube-api-access-9tlg6\") pod \"authorino-7479487454-pq4jq\" (UID: \"fe429afb-c6c5-49f8-b279-339d13a76b7d\") " pod="kuadrant-system/authorino-7479487454-pq4jq"
Sep 18 13:52:58.901872 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.901839    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9qllp"
Sep 18 13:52:58.907811 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.907788    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9qllp"
Sep 18 13:52:58.948249 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.948223    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzvqj\" (UniqueName: \"kubernetes.io/projected/e3ac1a52-5759-4bba-8b5a-4216bc8f670f-kube-api-access-kzvqj\") pod \"e3ac1a52-5759-4bba-8b5a-4216bc8f670f\" (UID: \"e3ac1a52-5759-4bba-8b5a-4216bc8f670f\") "
Sep 18 13:52:58.948407 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.948358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe429afb-c6c5-49f8-b279-339d13a76b7d-tls-cert\") pod \"authorino-7479487454-pq4jq\" (UID: \"fe429afb-c6c5-49f8-b279-339d13a76b7d\") " pod="kuadrant-system/authorino-7479487454-pq4jq"
Sep 18 13:52:58.948407 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.948390    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tlg6\" (UniqueName: \"kubernetes.io/projected/fe429afb-c6c5-49f8-b279-339d13a76b7d-kube-api-access-9tlg6\") pod \"authorino-7479487454-pq4jq\" (UID: \"fe429afb-c6c5-49f8-b279-339d13a76b7d\") " pod="kuadrant-system/authorino-7479487454-pq4jq"
Sep 18 13:52:58.950340 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.950310    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ac1a52-5759-4bba-8b5a-4216bc8f670f-kube-api-access-kzvqj" (OuterVolumeSpecName: "kube-api-access-kzvqj") pod "e3ac1a52-5759-4bba-8b5a-4216bc8f670f" (UID: "e3ac1a52-5759-4bba-8b5a-4216bc8f670f"). InnerVolumeSpecName "kube-api-access-kzvqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:52:58.950702 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.950685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe429afb-c6c5-49f8-b279-339d13a76b7d-tls-cert\") pod \"authorino-7479487454-pq4jq\" (UID: \"fe429afb-c6c5-49f8-b279-339d13a76b7d\") " pod="kuadrant-system/authorino-7479487454-pq4jq"
Sep 18 13:52:58.957621 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:58.957602    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tlg6\" (UniqueName: \"kubernetes.io/projected/fe429afb-c6c5-49f8-b279-339d13a76b7d-kube-api-access-9tlg6\") pod \"authorino-7479487454-pq4jq\" (UID: \"fe429afb-c6c5-49f8-b279-339d13a76b7d\") " pod="kuadrant-system/authorino-7479487454-pq4jq"
Sep 18 13:52:59.049539 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:59.049513    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzvqj\" (UniqueName: \"kubernetes.io/projected/e3ac1a52-5759-4bba-8b5a-4216bc8f670f-kube-api-access-kzvqj\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:52:59.100309 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:59.100278    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7479487454-pq4jq"
Sep 18 13:52:59.378571 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:59.378545    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7479487454-pq4jq"]
Sep 18 13:52:59.380012 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:52:59.379980    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe429afb_c6c5_49f8_b279_339d13a76b7d.slice/crio-3778241c527c77711d7ad6d4dfa5bf7870d4119b75ebbd28f794a011f39b907f WatchSource:0}: Error finding container 3778241c527c77711d7ad6d4dfa5bf7870d4119b75ebbd28f794a011f39b907f: Status 404 returned error can't find the container with id 3778241c527c77711d7ad6d4dfa5bf7870d4119b75ebbd28f794a011f39b907f
Sep 18 13:52:59.908368 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:59.908336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7479487454-pq4jq" event={"ID":"fe429afb-c6c5-49f8-b279-339d13a76b7d","Type":"ContainerStarted","Data":"3778241c527c77711d7ad6d4dfa5bf7870d4119b75ebbd28f794a011f39b907f"}
Sep 18 13:52:59.908368 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:59.908352    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9qllp"
Sep 18 13:52:59.982860 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:59.982809    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-9qllp"]
Sep 18 13:52:59.985316 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:52:59.985289    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-9qllp"]
Sep 18 13:53:00.293245 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:00.293164    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3ac1a52-5759-4bba-8b5a-4216bc8f670f" path="/var/lib/kubelet/pods/e3ac1a52-5759-4bba-8b5a-4216bc8f670f/volumes"
Sep 18 13:53:00.914327 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:00.914291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7479487454-pq4jq" event={"ID":"fe429afb-c6c5-49f8-b279-339d13a76b7d","Type":"ContainerStarted","Data":"b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67"}
Sep 18 13:53:00.931581 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:00.931526    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7479487454-pq4jq" podStartSLOduration=2.402404082 podStartE2EDuration="2.931509178s" totalImagesPullingTime="529.105096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:00.930557511 +0000 UTC m=+506.766396224" watchObservedRunningTime="2026-09-18 13:53:00.931509178 +0000 UTC m=+506.767347890"
Sep 18 13:53:43.765478 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.765438    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"]
Sep 18 13:53:43.786878 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.786842    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"]
Sep 18 13:53:43.787047 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.786951    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"
Sep 18 13:53:43.790001 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.789977    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rn49c\""
Sep 18 13:53:43.790001 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.790006    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 18 13:53:43.796804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.796781    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"]
Sep 18 13:53:43.800565 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.800546    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"
Sep 18 13:53:43.815574 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.815542    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"]
Sep 18 13:53:43.877673 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.877627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svcp4\" (UniqueName: \"kubernetes.io/projected/2dae585c-fdd4-4bbd-8a04-74e1e25ea992-kube-api-access-svcp4\") pod \"payload-pre-processing-59fbc47bf8-pzffv\" (UID: \"2dae585c-fdd4-4bbd-8a04-74e1e25ea992\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"
Sep 18 13:53:43.877881 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.877696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55bf2a5c-0c24-49ae-9b43-96af77cf2b54-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-qmrgz\" (UID: \"55bf2a5c-0c24-49ae-9b43-96af77cf2b54\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"
Sep 18 13:53:43.877881 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.877743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dae585c-fdd4-4bbd-8a04-74e1e25ea992-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-pzffv\" (UID: \"2dae585c-fdd4-4bbd-8a04-74e1e25ea992\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"
Sep 18 13:53:43.877881 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.877793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fpjk\" (UniqueName: \"kubernetes.io/projected/55bf2a5c-0c24-49ae-9b43-96af77cf2b54-kube-api-access-7fpjk\") pod \"payload-processing-5b54b7fbb7-qmrgz\" (UID: \"55bf2a5c-0c24-49ae-9b43-96af77cf2b54\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"
Sep 18 13:53:43.978606 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.978557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55bf2a5c-0c24-49ae-9b43-96af77cf2b54-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-qmrgz\" (UID: \"55bf2a5c-0c24-49ae-9b43-96af77cf2b54\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"
Sep 18 13:53:43.978811 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.978623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dae585c-fdd4-4bbd-8a04-74e1e25ea992-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-pzffv\" (UID: \"2dae585c-fdd4-4bbd-8a04-74e1e25ea992\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"
Sep 18 13:53:43.978811 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.978701    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fpjk\" (UniqueName: \"kubernetes.io/projected/55bf2a5c-0c24-49ae-9b43-96af77cf2b54-kube-api-access-7fpjk\") pod \"payload-processing-5b54b7fbb7-qmrgz\" (UID: \"55bf2a5c-0c24-49ae-9b43-96af77cf2b54\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"
Sep 18 13:53:43.978943 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.978817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svcp4\" (UniqueName: \"kubernetes.io/projected/2dae585c-fdd4-4bbd-8a04-74e1e25ea992-kube-api-access-svcp4\") pod \"payload-pre-processing-59fbc47bf8-pzffv\" (UID: \"2dae585c-fdd4-4bbd-8a04-74e1e25ea992\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"
Sep 18 13:53:43.979613 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.979570    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dae585c-fdd4-4bbd-8a04-74e1e25ea992-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-pzffv\" (UID: \"2dae585c-fdd4-4bbd-8a04-74e1e25ea992\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"
Sep 18 13:53:43.979746 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.979622    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55bf2a5c-0c24-49ae-9b43-96af77cf2b54-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-qmrgz\" (UID: \"55bf2a5c-0c24-49ae-9b43-96af77cf2b54\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"
Sep 18 13:53:43.996572 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.996540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fpjk\" (UniqueName: \"kubernetes.io/projected/55bf2a5c-0c24-49ae-9b43-96af77cf2b54-kube-api-access-7fpjk\") pod \"payload-processing-5b54b7fbb7-qmrgz\" (UID: \"55bf2a5c-0c24-49ae-9b43-96af77cf2b54\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"
Sep 18 13:53:43.997509 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:43.997478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svcp4\" (UniqueName: \"kubernetes.io/projected/2dae585c-fdd4-4bbd-8a04-74e1e25ea992-kube-api-access-svcp4\") pod \"payload-pre-processing-59fbc47bf8-pzffv\" (UID: \"2dae585c-fdd4-4bbd-8a04-74e1e25ea992\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"
Sep 18 13:53:44.098508 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:44.098473    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"
Sep 18 13:53:44.110942 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:44.110918    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"
Sep 18 13:53:44.394233 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:44.394205    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"]
Sep 18 13:53:44.396343 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:53:44.396316    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55bf2a5c_0c24_49ae_9b43_96af77cf2b54.slice/crio-a2418723340edf28eff996fa88ef27470843d1c5bb036eb067b86179dbc1b96b WatchSource:0}: Error finding container a2418723340edf28eff996fa88ef27470843d1c5bb036eb067b86179dbc1b96b: Status 404 returned error can't find the container with id a2418723340edf28eff996fa88ef27470843d1c5bb036eb067b86179dbc1b96b
Sep 18 13:53:44.414677 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:44.414650    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"]
Sep 18 13:53:44.416699 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:53:44.416676    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dae585c_fdd4_4bbd_8a04_74e1e25ea992.slice/crio-e84aa73f2d78f5fa1307031cc144df1952184f6ae472c8353d3d5119aafe5685 WatchSource:0}: Error finding container e84aa73f2d78f5fa1307031cc144df1952184f6ae472c8353d3d5119aafe5685: Status 404 returned error can't find the container with id e84aa73f2d78f5fa1307031cc144df1952184f6ae472c8353d3d5119aafe5685
Sep 18 13:53:45.165448 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:45.165402    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz" event={"ID":"55bf2a5c-0c24-49ae-9b43-96af77cf2b54","Type":"ContainerStarted","Data":"a2418723340edf28eff996fa88ef27470843d1c5bb036eb067b86179dbc1b96b"}
Sep 18 13:53:45.168053 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:45.168016    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv" event={"ID":"2dae585c-fdd4-4bbd-8a04-74e1e25ea992","Type":"ContainerStarted","Data":"e84aa73f2d78f5fa1307031cc144df1952184f6ae472c8353d3d5119aafe5685"}
Sep 18 13:53:46.175348 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:46.175226    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz" event={"ID":"55bf2a5c-0c24-49ae-9b43-96af77cf2b54","Type":"ContainerStarted","Data":"010eee2635370e83dc2429e8e153e6e0418a9cf776c067ada412f7ae99b50361"}
Sep 18 13:53:46.175348 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:46.175347    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"
Sep 18 13:53:46.177065 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:46.177034    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv" event={"ID":"2dae585c-fdd4-4bbd-8a04-74e1e25ea992","Type":"ContainerStarted","Data":"f778fa25058b615b92a4ab7d230f927523391067f675b174d9b01db81944db20"}
Sep 18 13:53:46.177202 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:46.177092    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"
Sep 18 13:53:46.194490 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:46.194432    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz" podStartSLOduration=1.692113583 podStartE2EDuration="3.194413338s" totalImagesPullingTime="1.502299755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:46.191632513 +0000 UTC m=+552.027471228" watchObservedRunningTime="2026-09-18 13:53:46.194413338 +0000 UTC m=+552.030252053"
Sep 18 13:53:46.208244 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:46.208201    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv" podStartSLOduration=1.723541182 podStartE2EDuration="3.208186117s" totalImagesPullingTime="1.484644935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:46.207355309 +0000 UTC m=+552.043194025" watchObservedRunningTime="2026-09-18 13:53:46.208186117 +0000 UTC m=+552.044024829"
Sep 18 13:53:53.215881 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:53.215846    2575 generic.go:356] "Generic (PLEG): container finished" podID="a0799f42-d527-43eb-9dc7-189bc2dc4893" containerID="373d1eaa274b0cd95060d849658403d28b153d467bc9081f21a6cd3903183a46" exitCode=0
Sep 18 13:53:53.216309 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:53.215887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x" event={"ID":"a0799f42-d527-43eb-9dc7-189bc2dc4893","Type":"ContainerDied","Data":"373d1eaa274b0cd95060d849658403d28b153d467bc9081f21a6cd3903183a46"}
Sep 18 13:53:53.216352 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:53.216338    2575 scope.go:117] "RemoveContainer" containerID="373d1eaa274b0cd95060d849658403d28b153d467bc9081f21a6cd3903183a46"
Sep 18 13:53:53.217397 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:53.217365    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:53:53.217467 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:53.217454    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:53:53.217518 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:53.217502    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:53:53.704355 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:53.704320    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:53:54.223325 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:54.223292    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x" event={"ID":"a0799f42-d527-43eb-9dc7-189bc2dc4893","Type":"ContainerStarted","Data":"3c597a394cb5e8966e243ac2731e85e4a4b3b5320be43895acedfcb93f891dde"}
Sep 18 13:53:54.501162 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:54.501045    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:53:54.502176 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:54.502124    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2bw5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 18 13:53:54.502281 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:54.502197    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x" podUID="a0799f42-d527-43eb-9dc7-189bc2dc4893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 18 13:53:55.501819 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:55.501782    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2bw5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 18 13:53:55.502232 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:55.501839    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x" podUID="a0799f42-d527-43eb-9dc7-189bc2dc4893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 18 13:53:56.502278 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:56.502237    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2bw5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 18 13:53:56.502658 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:56.502306    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x" podUID="a0799f42-d527-43eb-9dc7-189bc2dc4893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 18 13:53:57.184203 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:57.184164    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-qmrgz"
Sep 18 13:53:57.184367 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:57.184247    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv"
Sep 18 13:53:57.502395 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:57.502308    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2bw5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 18 13:53:57.502395 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:57.502364    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x" podUID="a0799f42-d527-43eb-9dc7-189bc2dc4893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 18 13:53:58.502075 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:58.502044    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2bw5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 18 13:53:58.502262 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:58.502102    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x" podUID="a0799f42-d527-43eb-9dc7-189bc2dc4893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 18 13:53:59.505716 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:59.505686    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:53:59.506176 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:59.505965    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:53:59.506762 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:53:59.506744    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x"
Sep 18 13:54:21.903440 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.903410    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"]
Sep 18 13:54:21.906979 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.906951    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:21.909956 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.909935    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 13:54:21.910051 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.909958    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mt56b\""
Sep 18 13:54:21.911526 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.911505    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 13:54:21.911632 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.911616    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 18 13:54:21.919925 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.919905    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"]
Sep 18 13:54:21.959727 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.959695    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05119603-8d6a-4a1e-875c-2d2a3a180494-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:21.959903 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.959758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:21.959903 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.959791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:21.959903 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.959833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:21.960059 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.959961    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:21.960059 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:21.960044    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kfgd\" (UniqueName: \"kubernetes.io/projected/05119603-8d6a-4a1e-875c-2d2a3a180494-kube-api-access-6kfgd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.060739 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.060698    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.060739 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.060739    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.060998 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.060767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.060998 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.060816    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.060998 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.060865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kfgd\" (UniqueName: \"kubernetes.io/projected/05119603-8d6a-4a1e-875c-2d2a3a180494-kube-api-access-6kfgd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.060998 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.060924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05119603-8d6a-4a1e-875c-2d2a3a180494-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.061271 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.061245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.061333 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.061255    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.061397 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.061373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.063192 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.063166    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05119603-8d6a-4a1e-875c-2d2a3a180494-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.063455 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.063439    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05119603-8d6a-4a1e-875c-2d2a3a180494-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.070064 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.070036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kfgd\" (UniqueName: \"kubernetes.io/projected/05119603-8d6a-4a1e-875c-2d2a3a180494-kube-api-access-6kfgd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v\" (UID: \"05119603-8d6a-4a1e-875c-2d2a3a180494\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.217531 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.217433    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:22.497887 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:22.497861    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"]
Sep 18 13:54:22.499435 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:54:22.499409    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05119603_8d6a_4a1e_875c_2d2a3a180494.slice/crio-ff987cfc434fb948af9554efcd3d5d0d4560daba2b8dc0a34557f3d38078a1e4 WatchSource:0}: Error finding container ff987cfc434fb948af9554efcd3d5d0d4560daba2b8dc0a34557f3d38078a1e4: Status 404 returned error can't find the container with id ff987cfc434fb948af9554efcd3d5d0d4560daba2b8dc0a34557f3d38078a1e4
Sep 18 13:54:23.403498 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:23.403456    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v" event={"ID":"05119603-8d6a-4a1e-875c-2d2a3a180494","Type":"ContainerStarted","Data":"ff987cfc434fb948af9554efcd3d5d0d4560daba2b8dc0a34557f3d38078a1e4"}
Sep 18 13:54:24.409722 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:24.409679    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v" event={"ID":"05119603-8d6a-4a1e-875c-2d2a3a180494","Type":"ContainerStarted","Data":"31a34643140ca992838d834dc460c58d82ce68e3141f02b92efb77622836e428"}
Sep 18 13:54:24.429150 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:24.429095    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v" podStartSLOduration=2.391050745 podStartE2EDuration="3.429079905s" totalImagesPullingTime="1.03802916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:54:24.427660043 +0000 UTC m=+590.263498789" watchObservedRunningTime="2026-09-18 13:54:24.429079905 +0000 UTC m=+590.264918617"
Sep 18 13:54:25.996417 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:25.996385    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"]
Sep 18 13:54:26.000429 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.000407    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.003293 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.003271    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 18 13:54:26.012265 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.012240    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"]
Sep 18 13:54:26.110379 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.110336    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.110379 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.110377    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.110617 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.110451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.110617 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.110477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.110617 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.110524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnxb9\" (UniqueName: \"kubernetes.io/projected/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-kube-api-access-vnxb9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.110617 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.110584    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.211440 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.211403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnxb9\" (UniqueName: \"kubernetes.io/projected/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-kube-api-access-vnxb9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.211631 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.211470    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.211631 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.211562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.211631 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.211584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.211832 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.211645    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.211832 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.211674    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.211986 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.211963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.211986 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.211978    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.212109 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.212089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.214084 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.214056    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.214084 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.214081    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.220242 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.220221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnxb9\" (UniqueName: \"kubernetes.io/projected/483b2ee5-7ec7-4cbc-b880-11feaba5b9db-kube-api-access-vnxb9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvbz8\" (UID: \"483b2ee5-7ec7-4cbc-b880-11feaba5b9db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.312185 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.312150    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:26.587175 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:26.587149    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"]
Sep 18 13:54:26.589697 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:54:26.589669    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod483b2ee5_7ec7_4cbc_b880_11feaba5b9db.slice/crio-56d189d611c9a9196207d22563892204dee95bdcf09d88f106684a241f5f302d WatchSource:0}: Error finding container 56d189d611c9a9196207d22563892204dee95bdcf09d88f106684a241f5f302d: Status 404 returned error can't find the container with id 56d189d611c9a9196207d22563892204dee95bdcf09d88f106684a241f5f302d
Sep 18 13:54:27.427361 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:27.426766    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8" event={"ID":"483b2ee5-7ec7-4cbc-b880-11feaba5b9db","Type":"ContainerStarted","Data":"d3f8fc16e533b9c747885cf619c7439e7e19437e3c5d1a6abd4a92310766498e"}
Sep 18 13:54:27.427361 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:27.426832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8" event={"ID":"483b2ee5-7ec7-4cbc-b880-11feaba5b9db","Type":"ContainerStarted","Data":"56d189d611c9a9196207d22563892204dee95bdcf09d88f106684a241f5f302d"}
Sep 18 13:54:27.446998 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:27.446929    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8" podStartSLOduration=2.26091805 podStartE2EDuration="2.446912398s" totalImagesPullingTime="185.994348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:54:27.444894324 +0000 UTC m=+593.280733039" watchObservedRunningTime="2026-09-18 13:54:27.446912398 +0000 UTC m=+593.282751110"
Sep 18 13:54:32.218110 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:32.218065    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:32.218577 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:32.218178    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:32.230764 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:32.230742    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:32.466257 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:32.466227    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v"
Sep 18 13:54:36.235537 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:36.235510    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 13:54:36.237400 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:36.237369    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 13:54:36.312683 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:36.312651    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:36.312832 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:36.312728    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:36.326069 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:36.326038    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:36.497216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:36.497091    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvbz8"
Sep 18 13:54:38.997250 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:38.997209    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"]
Sep 18 13:54:39.003381 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.003360    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.005956 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.005936    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 18 13:54:39.012873 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.012844    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"]
Sep 18 13:54:39.045784 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.045749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.045952 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.045801    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9krd\" (UniqueName: \"kubernetes.io/projected/357da5fd-6df3-49e5-a979-0e211120f868-kube-api-access-c9krd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.045952 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.045847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.045952 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.045869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.046146 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.046004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/357da5fd-6df3-49e5-a979-0e211120f868-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.046146 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.046032    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.147120 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.147079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.147120 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.147120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.147394 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.147287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/357da5fd-6df3-49e5-a979-0e211120f868-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.147394 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.147316    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.147394 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.147375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.147551 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.147413    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9krd\" (UniqueName: \"kubernetes.io/projected/357da5fd-6df3-49e5-a979-0e211120f868-kube-api-access-c9krd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.147551 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.147462    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.147551 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.147540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.147693 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.147657    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.149541 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.149520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/357da5fd-6df3-49e5-a979-0e211120f868-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.149796 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.149776    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/357da5fd-6df3-49e5-a979-0e211120f868-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.158906 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.158880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9krd\" (UniqueName: \"kubernetes.io/projected/357da5fd-6df3-49e5-a979-0e211120f868-kube-api-access-c9krd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbppg\" (UID: \"357da5fd-6df3-49e5-a979-0e211120f868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.324207 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.324173    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:39.599020 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:39.598993    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"]
Sep 18 13:54:39.601110 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:54:39.601083    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357da5fd_6df3_49e5_a979_0e211120f868.slice/crio-29b31a369d3c9c8adafba0698ca881f7506a5fa2f8048efef69f3bbf6b979647 WatchSource:0}: Error finding container 29b31a369d3c9c8adafba0698ca881f7506a5fa2f8048efef69f3bbf6b979647: Status 404 returned error can't find the container with id 29b31a369d3c9c8adafba0698ca881f7506a5fa2f8048efef69f3bbf6b979647
Sep 18 13:54:40.500824 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:40.500782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg" event={"ID":"357da5fd-6df3-49e5-a979-0e211120f868","Type":"ContainerStarted","Data":"0e06ac39d46278390823a126b1a44233ea0d550557a0f4c37bbbee6acedfbe29"}
Sep 18 13:54:40.501215 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:40.500848    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg" event={"ID":"357da5fd-6df3-49e5-a979-0e211120f868","Type":"ContainerStarted","Data":"29b31a369d3c9c8adafba0698ca881f7506a5fa2f8048efef69f3bbf6b979647"}
Sep 18 13:54:40.522474 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:40.522425    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg" podStartSLOduration=2.342764343 podStartE2EDuration="2.522407123s" totalImagesPullingTime="179.64278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:54:40.519780162 +0000 UTC m=+606.355618888" watchObservedRunningTime="2026-09-18 13:54:40.522407123 +0000 UTC m=+606.358245836"
Sep 18 13:54:49.324390 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:49.324304    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:49.324783 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:49.324398    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:49.336872 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:49.336845    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:54:49.567408 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:54:49.567381    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbppg"
Sep 18 13:55:51.500449 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.500409    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7479487454-pq4jq"]
Sep 18 13:55:51.501063 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.500598    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7479487454-pq4jq" podUID="fe429afb-c6c5-49f8-b279-339d13a76b7d" containerName="authorino" containerID="cri-o://b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67" gracePeriod=30
Sep 18 13:55:51.762087 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.762032    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7479487454-pq4jq"
Sep 18 13:55:51.769893 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.769874    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tlg6\" (UniqueName: \"kubernetes.io/projected/fe429afb-c6c5-49f8-b279-339d13a76b7d-kube-api-access-9tlg6\") pod \"fe429afb-c6c5-49f8-b279-339d13a76b7d\" (UID: \"fe429afb-c6c5-49f8-b279-339d13a76b7d\") "
Sep 18 13:55:51.769979 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.769933    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe429afb-c6c5-49f8-b279-339d13a76b7d-tls-cert\") pod \"fe429afb-c6c5-49f8-b279-339d13a76b7d\" (UID: \"fe429afb-c6c5-49f8-b279-339d13a76b7d\") "
Sep 18 13:55:51.771898 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.771865    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe429afb-c6c5-49f8-b279-339d13a76b7d-kube-api-access-9tlg6" (OuterVolumeSpecName: "kube-api-access-9tlg6") pod "fe429afb-c6c5-49f8-b279-339d13a76b7d" (UID: "fe429afb-c6c5-49f8-b279-339d13a76b7d"). InnerVolumeSpecName "kube-api-access-9tlg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:55:51.782064 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.782031    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe429afb-c6c5-49f8-b279-339d13a76b7d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fe429afb-c6c5-49f8-b279-339d13a76b7d" (UID: "fe429afb-c6c5-49f8-b279-339d13a76b7d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:55:51.870717 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.870685    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe429afb-c6c5-49f8-b279-339d13a76b7d-tls-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:55:51.870717 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.870713    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tlg6\" (UniqueName: \"kubernetes.io/projected/fe429afb-c6c5-49f8-b279-339d13a76b7d-kube-api-access-9tlg6\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:55:51.884014 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.883979    2575 generic.go:356] "Generic (PLEG): container finished" podID="fe429afb-c6c5-49f8-b279-339d13a76b7d" containerID="b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67" exitCode=0
Sep 18 13:55:51.884189 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.884022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7479487454-pq4jq" event={"ID":"fe429afb-c6c5-49f8-b279-339d13a76b7d","Type":"ContainerDied","Data":"b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67"}
Sep 18 13:55:51.884189 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.884059    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7479487454-pq4jq" event={"ID":"fe429afb-c6c5-49f8-b279-339d13a76b7d","Type":"ContainerDied","Data":"3778241c527c77711d7ad6d4dfa5bf7870d4119b75ebbd28f794a011f39b907f"}
Sep 18 13:55:51.884189 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.884077    2575 scope.go:117] "RemoveContainer" containerID="b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67"
Sep 18 13:55:51.884189 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.884027    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7479487454-pq4jq"
Sep 18 13:55:51.894310 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.894292    2575 scope.go:117] "RemoveContainer" containerID="b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67"
Sep 18 13:55:51.894584 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:55:51.894567    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67\": container with ID starting with b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67 not found: ID does not exist" containerID="b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67"
Sep 18 13:55:51.894633 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.894591    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67"} err="failed to get container status \"b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67\": rpc error: code = NotFound desc = could not find container \"b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67\": container with ID starting with b84a5b4ac328285fdb89ed6b10cb16bac7dedc7b04c4b0c8a3cf278b8bdaff67 not found: ID does not exist"
Sep 18 13:55:51.908292 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.908270    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7479487454-pq4jq"]
Sep 18 13:55:51.910050 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:51.910029    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7479487454-pq4jq"]
Sep 18 13:55:52.293296 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:55:52.293264    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe429afb-c6c5-49f8-b279-339d13a76b7d" path="/var/lib/kubelet/pods/fe429afb-c6c5-49f8-b279-339d13a76b7d/volumes"
Sep 18 13:56:10.646239 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.646206    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"]
Sep 18 13:56:10.646733 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.646718    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe429afb-c6c5-49f8-b279-339d13a76b7d" containerName="authorino"
Sep 18 13:56:10.646803 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.646735    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe429afb-c6c5-49f8-b279-339d13a76b7d" containerName="authorino"
Sep 18 13:56:10.646862 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.646818    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe429afb-c6c5-49f8-b279-339d13a76b7d" containerName="authorino"
Sep 18 13:56:10.651182 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.651163    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.654505 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.654485    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-df2eb8-openshift-default-dockercfg-8l82z\""
Sep 18 13:56:10.676595 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.676572    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"]
Sep 18 13:56:10.749483 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.749441    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8588\" (UniqueName: \"kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-kube-api-access-n8588\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.749665 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.749538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-data\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.749665 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.749574    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-socket\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.749665 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.749609    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-envoy\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.749791 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.749665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-credential-socket\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.749791 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.749688    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-token\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.749791 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.749711    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-podinfo\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.749791 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.749747    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-certs\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.749921 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.749808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istiod-ca-cert\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.758723 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.758693    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"]
Sep 18 13:56:10.762537 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.762519    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.765409 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.765389    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-377ca2-openshift-default-dockercfg-cv89l\""
Sep 18 13:56:10.776845 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.776824    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"]
Sep 18 13:56:10.851359 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-socket\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.851549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-certs\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.851549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8588\" (UniqueName: \"kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-kube-api-access-n8588\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.851549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-data\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.851549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851468    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-socket\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.851549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-credential-socket\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.851549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-envoy\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.851549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851529    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-envoy\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.851932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851554    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-data\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.851932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b52115b0-5068-47e8-801e-8114d9abe026-istiod-ca-cert\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.851932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-credential-socket\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.851932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-token\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.851932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-podinfo\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.851932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmg8k\" (UniqueName: \"kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-kube-api-access-pmg8k\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.851932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-certs\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.851932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b52115b0-5068-47e8-801e-8114d9abe026-istio-podinfo\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.851932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-istio-token\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.851932 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.851918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istiod-ca-cert\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.852470 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.852009    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-credential-socket\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.852470 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.852072    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-socket\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.852470 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.852091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-data\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.852470 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.852407    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-certs\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.852676 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.852638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istiod-ca-cert\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.853993 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.853964    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-envoy\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.854583 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.854556    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-podinfo\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.860398 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.860374    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-token\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.860748 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.860726    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8588\" (UniqueName: \"kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-kube-api-access-n8588\") pod \"e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") " pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.953275 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.953186    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-envoy\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.953275 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.953234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-data\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.953275 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.953263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b52115b0-5068-47e8-801e-8114d9abe026-istiod-ca-cert\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.953559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.953321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmg8k\" (UniqueName: \"kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-kube-api-access-pmg8k\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.953559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.953353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b52115b0-5068-47e8-801e-8114d9abe026-istio-podinfo\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.953559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.953380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-istio-token\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.953559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.953426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-socket\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.953559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.953473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-certs\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.953906 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.953588    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-credential-socket\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.954109 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.954055    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-data\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.954466 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.954423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-credential-socket\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.954565 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.954493    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b52115b0-5068-47e8-801e-8114d9abe026-istiod-ca-cert\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.954565 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.954504    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-certs\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.954787 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.954765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-socket\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.956640 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.956544    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-envoy\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.957354 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.957333    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b52115b0-5068-47e8-801e-8114d9abe026-istio-podinfo\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.962509 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.962346    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:10.966949 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.965813    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmg8k\" (UniqueName: \"kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-kube-api-access-pmg8k\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:10.969702 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:10.969677    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-istio-token\") pod \"e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") " pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:11.073230 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.072941    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:11.244142 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.244090    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"]
Sep 18 13:56:11.246190 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:56:11.246159    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd00ce6_a6c4_4d5f_b7c8_40f7049c735b.slice/crio-06214f9bd7d2aa1db7cf59177f270b7e2151ce9ce149ef1580643c5317f74b00 WatchSource:0}: Error finding container 06214f9bd7d2aa1db7cf59177f270b7e2151ce9ce149ef1580643c5317f74b00: Status 404 returned error can't find the container with id 06214f9bd7d2aa1db7cf59177f270b7e2151ce9ce149ef1580643c5317f74b00
Sep 18 13:56:11.248372 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.248339    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:11.248441 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.248413    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:11.248480 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.248444    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:11.350737 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.350701    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"]
Sep 18 13:56:11.354258 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:56:11.354225    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52115b0_5068_47e8_801e_8114d9abe026.slice/crio-f4f43bc85966aa9696112705c4ad55703898727d192d648a3113822eeb7d9bca WatchSource:0}: Error finding container f4f43bc85966aa9696112705c4ad55703898727d192d648a3113822eeb7d9bca: Status 404 returned error can't find the container with id f4f43bc85966aa9696112705c4ad55703898727d192d648a3113822eeb7d9bca
Sep 18 13:56:11.356557 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.356520    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:11.356672 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.356590    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:11.356672 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.356619    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:11.994189 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.994160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" event={"ID":"b52115b0-5068-47e8-801e-8114d9abe026","Type":"ContainerStarted","Data":"cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456"}
Sep 18 13:56:11.994671 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.994207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" event={"ID":"b52115b0-5068-47e8-801e-8114d9abe026","Type":"ContainerStarted","Data":"f4f43bc85966aa9696112705c4ad55703898727d192d648a3113822eeb7d9bca"}
Sep 18 13:56:11.995839 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.995818    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" event={"ID":"add00ce6-a6c4-4d5f-b7c8-40f7049c735b","Type":"ContainerStarted","Data":"96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc"}
Sep 18 13:56:11.995955 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:11.995855    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" event={"ID":"add00ce6-a6c4-4d5f-b7c8-40f7049c735b","Type":"ContainerStarted","Data":"06214f9bd7d2aa1db7cf59177f270b7e2151ce9ce149ef1580643c5317f74b00"}
Sep 18 13:56:12.019303 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:12.019257    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" podStartSLOduration=2.019243548 podStartE2EDuration="2.019243548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:56:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:56:12.016456627 +0000 UTC m=+697.852295341" watchObservedRunningTime="2026-09-18 13:56:12.019243548 +0000 UTC m=+697.855082262"
Sep 18 13:56:12.040085 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:12.040036    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" podStartSLOduration=2.040022846 podStartE2EDuration="2.040022846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:56:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:56:12.037277096 +0000 UTC m=+697.873115810" watchObservedRunningTime="2026-09-18 13:56:12.040022846 +0000 UTC m=+697.875861561"
Sep 18 13:56:12.073925 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:12.073898    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:12.078909 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:12.078887    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:12.963169 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:12.963110    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:12.968818 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:12.968790    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:13.001444 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:13.001415    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:13.001830 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:13.001468    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:13.002272 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:13.002250    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:13.002368 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:13.002315    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:15.827698 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:15.827655    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"]
Sep 18 13:56:15.831868 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:15.831845    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 13:56:15.842456 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:15.842425    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"]
Sep 18 13:56:15.842816 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:15.842792    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-df2eb8\""
Sep 18 13:56:15.907045 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:15.907005    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb6177c5-9851-445c-a57d-4452f6aae807-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t\" (UID: \"eb6177c5-9851-445c-a57d-4452f6aae807\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 13:56:15.907248 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:15.907196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nv6b\" (UniqueName: \"kubernetes.io/projected/eb6177c5-9851-445c-a57d-4452f6aae807-kube-api-access-7nv6b\") pod \"payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t\" (UID: \"eb6177c5-9851-445c-a57d-4452f6aae807\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 13:56:15.989919 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:15.989879    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"]
Sep 18 13:56:15.994052 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:15.994028    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 13:56:15.997168 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:15.997140    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-df2eb8-dockercfg-ct68d\""
Sep 18 13:56:16.006997 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.006973    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"]
Sep 18 13:56:16.008192 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.008113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nv6b\" (UniqueName: \"kubernetes.io/projected/eb6177c5-9851-445c-a57d-4452f6aae807-kube-api-access-7nv6b\") pod \"payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t\" (UID: \"eb6177c5-9851-445c-a57d-4452f6aae807\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 13:56:16.008303 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.008252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb6177c5-9851-445c-a57d-4452f6aae807-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t\" (UID: \"eb6177c5-9851-445c-a57d-4452f6aae807\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 13:56:16.008963 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.008938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb6177c5-9851-445c-a57d-4452f6aae807-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t\" (UID: \"eb6177c5-9851-445c-a57d-4452f6aae807\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 13:56:16.017604 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.017578    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nv6b\" (UniqueName: \"kubernetes.io/projected/eb6177c5-9851-445c-a57d-4452f6aae807-kube-api-access-7nv6b\") pod \"payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t\" (UID: \"eb6177c5-9851-445c-a57d-4452f6aae807\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 13:56:16.109016 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.108935    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz6zr\" (UniqueName: \"kubernetes.io/projected/bf3b6891-1ec0-49f7-8e5a-1981169b1349-kube-api-access-mz6zr\") pod \"payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl\" (UID: \"bf3b6891-1ec0-49f7-8e5a-1981169b1349\") " pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 13:56:16.109016 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.109009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf3b6891-1ec0-49f7-8e5a-1981169b1349-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl\" (UID: \"bf3b6891-1ec0-49f7-8e5a-1981169b1349\") " pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 13:56:16.155645 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.155610    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 13:56:16.210512 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.210480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf3b6891-1ec0-49f7-8e5a-1981169b1349-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl\" (UID: \"bf3b6891-1ec0-49f7-8e5a-1981169b1349\") " pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 13:56:16.210710 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.210612    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz6zr\" (UniqueName: \"kubernetes.io/projected/bf3b6891-1ec0-49f7-8e5a-1981169b1349-kube-api-access-mz6zr\") pod \"payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl\" (UID: \"bf3b6891-1ec0-49f7-8e5a-1981169b1349\") " pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 13:56:16.211561 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.211535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf3b6891-1ec0-49f7-8e5a-1981169b1349-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl\" (UID: \"bf3b6891-1ec0-49f7-8e5a-1981169b1349\") " pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 13:56:16.225515 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.225470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz6zr\" (UniqueName: \"kubernetes.io/projected/bf3b6891-1ec0-49f7-8e5a-1981169b1349-kube-api-access-mz6zr\") pod \"payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl\" (UID: \"bf3b6891-1ec0-49f7-8e5a-1981169b1349\") " pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 13:56:16.306282 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.306252    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 13:56:16.443228 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.443197    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"]
Sep 18 13:56:16.446458 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:56:16.446430    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6177c5_9851_445c_a57d_4452f6aae807.slice/crio-0adfbe401a615a0c6a493e41731b394275a61902285b3079f9be4420ffd4f7eb WatchSource:0}: Error finding container 0adfbe401a615a0c6a493e41731b394275a61902285b3079f9be4420ffd4f7eb: Status 404 returned error can't find the container with id 0adfbe401a615a0c6a493e41731b394275a61902285b3079f9be4420ffd4f7eb
Sep 18 13:56:16.585543 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.585517    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"]
Sep 18 13:56:16.587655 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:56:16.587631    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3b6891_1ec0_49f7_8e5a_1981169b1349.slice/crio-4bae5465c951f0cfc9f31e72e28b9f127938c688af368789a1a5685643fb7b69 WatchSource:0}: Error finding container 4bae5465c951f0cfc9f31e72e28b9f127938c688af368789a1a5685643fb7b69: Status 404 returned error can't find the container with id 4bae5465c951f0cfc9f31e72e28b9f127938c688af368789a1a5685643fb7b69
Sep 18 13:56:16.815222 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.815185    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"]
Sep 18 13:56:16.818950 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.818929    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 13:56:16.821944 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.821922    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-377ca2-dockercfg-68xdt\""
Sep 18 13:56:16.822109 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.821923    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-377ca2\""
Sep 18 13:56:16.829586 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.829562    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"]
Sep 18 13:56:16.917102 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.916997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv\" (UID: \"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 13:56:16.917102 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:16.917066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85w68\" (UniqueName: \"kubernetes.io/projected/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-kube-api-access-85w68\") pod \"payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv\" (UID: \"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 13:56:17.018544 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.018514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv\" (UID: \"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 13:56:17.018721 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.018598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85w68\" (UniqueName: \"kubernetes.io/projected/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-kube-api-access-85w68\") pod \"payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv\" (UID: \"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 13:56:17.019592 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.019566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv\" (UID: \"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 13:56:17.027507 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.027474    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl" event={"ID":"bf3b6891-1ec0-49f7-8e5a-1981169b1349","Type":"ContainerStarted","Data":"e0da727a09460dc0e3727d81aa1a8105f3ab637d94a0fab2402bb8936441585b"}
Sep 18 13:56:17.027663 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.027533    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl" event={"ID":"bf3b6891-1ec0-49f7-8e5a-1981169b1349","Type":"ContainerStarted","Data":"4bae5465c951f0cfc9f31e72e28b9f127938c688af368789a1a5685643fb7b69"}
Sep 18 13:56:17.027663 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.027576    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 13:56:17.029659 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.029521    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t" event={"ID":"eb6177c5-9851-445c-a57d-4452f6aae807","Type":"ContainerStarted","Data":"cea0a4c960fca625a2918f933553a991e27b40c05cc9ea9dcbdb11265f4e409c"}
Sep 18 13:56:17.029659 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.029573    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t" event={"ID":"eb6177c5-9851-445c-a57d-4452f6aae807","Type":"ContainerStarted","Data":"0adfbe401a615a0c6a493e41731b394275a61902285b3079f9be4420ffd4f7eb"}
Sep 18 13:56:17.029861 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.029682    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 13:56:17.030010 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.029987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85w68\" (UniqueName: \"kubernetes.io/projected/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-kube-api-access-85w68\") pod \"payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv\" (UID: \"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 13:56:17.075455 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.075397    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl" podStartSLOduration=2.075380875 podStartE2EDuration="2.075380875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:56:17.070804658 +0000 UTC m=+702.906643373" watchObservedRunningTime="2026-09-18 13:56:17.075380875 +0000 UTC m=+702.911219587"
Sep 18 13:56:17.104543 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.104490    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t" podStartSLOduration=2.104473603 podStartE2EDuration="2.104473603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:56:17.102426599 +0000 UTC m=+702.938265312" watchObservedRunningTime="2026-09-18 13:56:17.104473603 +0000 UTC m=+702.940312316"
Sep 18 13:56:17.131089 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.131060    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 13:56:17.410088 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:17.410053    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"]
Sep 18 13:56:17.410253 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:56:17.410217    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ddebbe5_776d_4979_a32f_f7e1ad7b98b3.slice/crio-d82d6f303d543326c5747659b0e6a738c519d37bf3cf426ea2ef7ecd1208fb8d WatchSource:0}: Error finding container d82d6f303d543326c5747659b0e6a738c519d37bf3cf426ea2ef7ecd1208fb8d: Status 404 returned error can't find the container with id d82d6f303d543326c5747659b0e6a738c519d37bf3cf426ea2ef7ecd1208fb8d
Sep 18 13:56:18.037594 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:18.037547    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv" event={"ID":"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3","Type":"ContainerStarted","Data":"00fdaa7810213fb43c875e92c934e82ea0c0aa670f3972f84cd86c895efcc8f3"}
Sep 18 13:56:18.038066 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:18.037664    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 13:56:18.038066 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:18.037690    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv" event={"ID":"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3","Type":"ContainerStarted","Data":"d82d6f303d543326c5747659b0e6a738c519d37bf3cf426ea2ef7ecd1208fb8d"}
Sep 18 13:56:18.058418 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:18.058362    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv" podStartSLOduration=2.058341368 podStartE2EDuration="2.058341368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:56:18.055546996 +0000 UTC m=+703.891385712" watchObservedRunningTime="2026-09-18 13:56:18.058341368 +0000 UTC m=+703.894180082"
Sep 18 13:56:20.452439 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.452404    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"]
Sep 18 13:56:20.456544 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.456521    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.459429 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.459407    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e095dac8-openshift-default-dockercfg-84qmr\""
Sep 18 13:56:20.469041 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.469016    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"]
Sep 18 13:56:20.558648 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.558610    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-socket\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.558825 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.558656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-certs\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.558825 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.558740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e463d94-d73d-485a-8469-7a0284ead985-istio-podinfo\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.558825 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.558807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p45r\" (UniqueName: \"kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-kube-api-access-9p45r\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.558994 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.558839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-credential-socket\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.559057 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.559006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-envoy\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.559057 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.559040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e463d94-d73d-485a-8469-7a0284ead985-istiod-ca-cert\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.559215 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.559076    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-data\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.559215 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.559120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-istio-token\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660081 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660040    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-envoy\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660277 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e463d94-d73d-485a-8469-7a0284ead985-istiod-ca-cert\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660277 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660160    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-data\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660277 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660209    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-istio-token\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660277 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-socket\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660279    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-certs\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660577 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660534    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e463d94-d73d-485a-8469-7a0284ead985-istio-podinfo\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660648 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p45r\" (UniqueName: \"kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-kube-api-access-9p45r\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660704 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-credential-socket\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660712    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-certs\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660813 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-data\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.660979 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.660953    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-socket\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.661071 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.661011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-credential-socket\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.661243 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.661217    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e463d94-d73d-485a-8469-7a0284ead985-istiod-ca-cert\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.662798 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.662774    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-envoy\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.663466 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.663440    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e463d94-d73d-485a-8469-7a0284ead985-istio-podinfo\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.678034 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.678010    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p45r\" (UniqueName: \"kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-kube-api-access-9p45r\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.695151 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.695104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-istio-token\") pod \"e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") " pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:20.769956 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:20.769823    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:21.058271 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:21.058248    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"]
Sep 18 13:56:21.059735 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:56:21.059711    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e463d94_d73d_485a_8469_7a0284ead985.slice/crio-3009c033988729daed4fe3bf8ab651e502624b369aed67818366862b2fd63bf0 WatchSource:0}: Error finding container 3009c033988729daed4fe3bf8ab651e502624b369aed67818366862b2fd63bf0: Status 404 returned error can't find the container with id 3009c033988729daed4fe3bf8ab651e502624b369aed67818366862b2fd63bf0
Sep 18 13:56:21.061915 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:21.061887    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:21.061973 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:21.061948    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:21.062019 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:21.061975    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:22.072313 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:22.072268    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" event={"ID":"4e463d94-d73d-485a-8469-7a0284ead985","Type":"ContainerStarted","Data":"bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf"}
Sep 18 13:56:22.072827 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:22.072352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" event={"ID":"4e463d94-d73d-485a-8469-7a0284ead985","Type":"ContainerStarted","Data":"3009c033988729daed4fe3bf8ab651e502624b369aed67818366862b2fd63bf0"}
Sep 18 13:56:22.096787 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:22.096727    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" podStartSLOduration=2.096709729 podStartE2EDuration="2.096709729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:56:22.095313753 +0000 UTC m=+707.931152478" watchObservedRunningTime="2026-09-18 13:56:22.096709729 +0000 UTC m=+707.932548499"
Sep 18 13:56:22.770103 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:22.770065    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:22.775206 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:22.775182    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:23.078036 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.078007    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:23.079164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.079118    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:23.512542 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.512464    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"]
Sep 18 13:56:23.516237 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.516218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 13:56:23.521825 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.521802    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-ed4c53\""
Sep 18 13:56:23.530981 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.530949    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"]
Sep 18 13:56:23.694349 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.694307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhwbs\" (UniqueName: \"kubernetes.io/projected/e9cc6192-28df-4e67-9d76-0f95f54d09a2-kube-api-access-nhwbs\") pod \"payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx\" (UID: \"e9cc6192-28df-4e67-9d76-0f95f54d09a2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 13:56:23.694575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.694526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9cc6192-28df-4e67-9d76-0f95f54d09a2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx\" (UID: \"e9cc6192-28df-4e67-9d76-0f95f54d09a2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 13:56:23.795408 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.795384    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9cc6192-28df-4e67-9d76-0f95f54d09a2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx\" (UID: \"e9cc6192-28df-4e67-9d76-0f95f54d09a2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 13:56:23.795569 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.795453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhwbs\" (UniqueName: \"kubernetes.io/projected/e9cc6192-28df-4e67-9d76-0f95f54d09a2-kube-api-access-nhwbs\") pod \"payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx\" (UID: \"e9cc6192-28df-4e67-9d76-0f95f54d09a2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 13:56:23.796165 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.796127    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9cc6192-28df-4e67-9d76-0f95f54d09a2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx\" (UID: \"e9cc6192-28df-4e67-9d76-0f95f54d09a2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 13:56:23.813270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.813244    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhwbs\" (UniqueName: \"kubernetes.io/projected/e9cc6192-28df-4e67-9d76-0f95f54d09a2-kube-api-access-nhwbs\") pod \"payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx\" (UID: \"e9cc6192-28df-4e67-9d76-0f95f54d09a2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 13:56:23.828063 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:23.828043    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 13:56:24.146388 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:24.146300    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"]
Sep 18 13:56:25.091173 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:25.091126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx" event={"ID":"e9cc6192-28df-4e67-9d76-0f95f54d09a2","Type":"ContainerStarted","Data":"0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de"}
Sep 18 13:56:25.091377 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:25.091191    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx" event={"ID":"e9cc6192-28df-4e67-9d76-0f95f54d09a2","Type":"ContainerStarted","Data":"7713c90c4a8e6858a85bf195de39719a023d2bc84480ce6b6771024549e2de7d"}
Sep 18 13:56:25.091486 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:25.091469    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 13:56:25.110729 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:25.110679    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx" podStartSLOduration=2.110659676 podStartE2EDuration="2.110659676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:56:25.110293802 +0000 UTC m=+710.946132519" watchObservedRunningTime="2026-09-18 13:56:25.110659676 +0000 UTC m=+710.946498390"
Sep 18 13:56:28.041601 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:28.041562    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 13:56:28.043583 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:28.043553    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 13:56:29.049331 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.049296    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 13:56:29.276187 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.275519    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"]
Sep 18 13:56:29.280460 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.280433    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.283671 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.283650    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b63f26-openshift-default-dockercfg-jxxk7\""
Sep 18 13:56:29.297226 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.297121    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"]
Sep 18 13:56:29.378852 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.378651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c609d637-9282-4247-9916-f1187b8f9de5-istiod-ca-cert\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.378852 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.378704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-socket\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.378852 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.378744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-envoy\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.378852 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.378820    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-credential-socket\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.378852 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.378861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-certs\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.379267 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.378904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c609d637-9282-4247-9916-f1187b8f9de5-istio-podinfo\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.379267 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.378979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qbqp\" (UniqueName: \"kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-kube-api-access-5qbqp\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.379267 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.379015    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-data\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.379267 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.379072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-istio-token\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.480057 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.480014    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-credential-socket\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.480264 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.480081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-certs\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.480264 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.480144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c609d637-9282-4247-9916-f1187b8f9de5-istio-podinfo\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.480264 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.480207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qbqp\" (UniqueName: \"kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-kube-api-access-5qbqp\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.480264 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.480242    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-data\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.480502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.480299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-istio-token\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.480502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.480380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c609d637-9282-4247-9916-f1187b8f9de5-istiod-ca-cert\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.480502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.480410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-socket\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.480502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.480449    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-envoy\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.481632 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.481279    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-certs\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.481632 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.481599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-credential-socket\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.481930 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.481854    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-socket\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.482112 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.482049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c609d637-9282-4247-9916-f1187b8f9de5-istiod-ca-cert\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.482591 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.482568    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-data\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.484525 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.484485    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c609d637-9282-4247-9916-f1187b8f9de5-istio-podinfo\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.492431 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.492377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-envoy\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.492905 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.492881    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-istio-token\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.495869 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.495826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qbqp\" (UniqueName: \"kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-kube-api-access-5qbqp\") pod \"e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") " pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.605270 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.605178    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:29.776702 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.775061    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"]
Sep 18 13:56:29.782124 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.782069    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"]
Sep 18 13:56:29.782287 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.782200    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:29.786096 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.785552    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e095dac8\""
Sep 18 13:56:29.786096 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.785866    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e095dac8-dockercfg-sjv44\""
Sep 18 13:56:29.788218 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.788199    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"]
Sep 18 13:56:29.788343 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.788239    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"]
Sep 18 13:56:29.788343 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.788327    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:29.884573 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.884465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47e2484e-784f-4db9-b9f6-370866e57ec5-plugins-config-volume\") pod \"payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx\" (UID: \"47e2484e-784f-4db9-b9f6-370866e57ec5\") " pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:29.884573 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.884561    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xszqk\" (UniqueName: \"kubernetes.io/projected/47e2484e-784f-4db9-b9f6-370866e57ec5-kube-api-access-xszqk\") pod \"payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx\" (UID: \"47e2484e-784f-4db9-b9f6-370866e57ec5\") " pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:29.884810 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.884622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbt6b\" (UniqueName: \"kubernetes.io/projected/603d546c-066a-4a85-9699-d394727f8b01-kube-api-access-vbt6b\") pod \"payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8\" (UID: \"603d546c-066a-4a85-9699-d394727f8b01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:29.884810 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.884784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/603d546c-066a-4a85-9699-d394727f8b01-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8\" (UID: \"603d546c-066a-4a85-9699-d394727f8b01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:29.949859 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.949818    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"]
Sep 18 13:56:29.976630 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:56:29.976596    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc609d637_9282_4247_9916_f1187b8f9de5.slice/crio-9a6a0d8189c37114e9d5701fa5020bbbdafa5eef9d2734f0d68d84ae0311ead7 WatchSource:0}: Error finding container 9a6a0d8189c37114e9d5701fa5020bbbdafa5eef9d2734f0d68d84ae0311ead7: Status 404 returned error can't find the container with id 9a6a0d8189c37114e9d5701fa5020bbbdafa5eef9d2734f0d68d84ae0311ead7
Sep 18 13:56:29.979225 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.979187    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:29.979310 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.979286    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:29.979378 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.979363    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:29.986100 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.986056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47e2484e-784f-4db9-b9f6-370866e57ec5-plugins-config-volume\") pod \"payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx\" (UID: \"47e2484e-784f-4db9-b9f6-370866e57ec5\") " pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:29.986240 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.986173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xszqk\" (UniqueName: \"kubernetes.io/projected/47e2484e-784f-4db9-b9f6-370866e57ec5-kube-api-access-xszqk\") pod \"payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx\" (UID: \"47e2484e-784f-4db9-b9f6-370866e57ec5\") " pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:29.986301 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.986240    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbt6b\" (UniqueName: \"kubernetes.io/projected/603d546c-066a-4a85-9699-d394727f8b01-kube-api-access-vbt6b\") pod \"payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8\" (UID: \"603d546c-066a-4a85-9699-d394727f8b01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:29.986377 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.986357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/603d546c-066a-4a85-9699-d394727f8b01-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8\" (UID: \"603d546c-066a-4a85-9699-d394727f8b01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:29.987370 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.987344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/603d546c-066a-4a85-9699-d394727f8b01-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8\" (UID: \"603d546c-066a-4a85-9699-d394727f8b01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:29.991852 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:29.988074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47e2484e-784f-4db9-b9f6-370866e57ec5-plugins-config-volume\") pod \"payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx\" (UID: \"47e2484e-784f-4db9-b9f6-370866e57ec5\") " pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:30.005587 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:30.005198    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xszqk\" (UniqueName: \"kubernetes.io/projected/47e2484e-784f-4db9-b9f6-370866e57ec5-kube-api-access-xszqk\") pod \"payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx\" (UID: \"47e2484e-784f-4db9-b9f6-370866e57ec5\") " pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:30.006645 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:30.006622    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbt6b\" (UniqueName: \"kubernetes.io/projected/603d546c-066a-4a85-9699-d394727f8b01-kube-api-access-vbt6b\") pod \"payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8\" (UID: \"603d546c-066a-4a85-9699-d394727f8b01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:30.099811 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:30.099782    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:30.106359 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:30.106326    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:30.135351 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:30.134430    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" event={"ID":"c609d637-9282-4247-9916-f1187b8f9de5","Type":"ContainerStarted","Data":"e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b"}
Sep 18 13:56:30.135351 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:30.134531    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" event={"ID":"c609d637-9282-4247-9916-f1187b8f9de5","Type":"ContainerStarted","Data":"9a6a0d8189c37114e9d5701fa5020bbbdafa5eef9d2734f0d68d84ae0311ead7"}
Sep 18 13:56:30.180019 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:30.179940    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" podStartSLOduration=1.179917565 podStartE2EDuration="1.179917565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:56:30.177390871 +0000 UTC m=+716.013229585" watchObservedRunningTime="2026-09-18 13:56:30.179917565 +0000 UTC m=+716.015756278"
Sep 18 13:56:30.449271 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:30.446187    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"]
Sep 18 13:56:30.471003 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:30.470967    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"]
Sep 18 13:56:30.605557 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:30.605390    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:31.146236 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:31.146200    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx" event={"ID":"47e2484e-784f-4db9-b9f6-370866e57ec5","Type":"ContainerStarted","Data":"7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1"}
Sep 18 13:56:31.146740 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:31.146263    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx" event={"ID":"47e2484e-784f-4db9-b9f6-370866e57ec5","Type":"ContainerStarted","Data":"04bda57deceb6c21288157d03f207c4f783dd0490468b7a0349746cf5cda9fa2"}
Sep 18 13:56:31.147117 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:31.147090    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:31.149528 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:31.149495    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8" event={"ID":"603d546c-066a-4a85-9699-d394727f8b01","Type":"ContainerStarted","Data":"f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a"}
Sep 18 13:56:31.149639 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:31.149553    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8" event={"ID":"603d546c-066a-4a85-9699-d394727f8b01","Type":"ContainerStarted","Data":"1c93cf630177b732a8c82bba616b671f222e8d0d7e76535e6108f5d02a3a30c1"}
Sep 18 13:56:31.149721 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:31.149703    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:31.165320 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:31.165253    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx" podStartSLOduration=2.165230745 podStartE2EDuration="2.165230745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:56:31.164703324 +0000 UTC m=+717.000542038" watchObservedRunningTime="2026-09-18 13:56:31.165230745 +0000 UTC m=+717.001069461"
Sep 18 13:56:31.186297 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:31.186230    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8" podStartSLOduration=2.186205911 podStartE2EDuration="2.186205911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:56:31.184127557 +0000 UTC m=+717.019966274" watchObservedRunningTime="2026-09-18 13:56:31.186205911 +0000 UTC m=+717.022044624"
Sep 18 13:56:31.610633 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:31.610600    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:32.157391 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:32.157355    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:32.158608 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:32.158586    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:56:34.171668 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:34.171633    2575 generic.go:356] "Generic (PLEG): container finished" podID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerID="96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc" exitCode=0
Sep 18 13:56:34.172204 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:34.171708    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" event={"ID":"add00ce6-a6c4-4d5f-b7c8-40f7049c735b","Type":"ContainerDied","Data":"96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc"}
Sep 18 13:56:34.172460 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:34.172440    2575 scope.go:117] "RemoveContainer" containerID="96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc"
Sep 18 13:56:34.173662 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:34.173625    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:34.173739 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:34.173697    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:34.173739 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:34.173733    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:35.178911 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:35.178822    2575 generic.go:356] "Generic (PLEG): container finished" podID="b52115b0-5068-47e8-801e-8114d9abe026" containerID="cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456" exitCode=0
Sep 18 13:56:35.179450 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:35.178903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" event={"ID":"b52115b0-5068-47e8-801e-8114d9abe026","Type":"ContainerDied","Data":"cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456"}
Sep 18 13:56:35.179570 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:35.179552    2575 scope.go:117] "RemoveContainer" containerID="cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456"
Sep 18 13:56:35.180910 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:35.180875    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:35.181018 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:35.180997    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:35.181062 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:35.181012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" event={"ID":"add00ce6-a6c4-4d5f-b7c8-40f7049c735b","Type":"ContainerStarted","Data":"5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c"}
Sep 18 13:56:35.181062 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:35.181054    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:35.963523 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:35.963475    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:35.964357 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:35.964328    2575 patch_prober.go:28] interesting pod/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 18 13:56:35.964577 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:35.964536    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 18 13:56:36.100376 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:36.100341    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 13:56:36.198411 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:36.198370    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" event={"ID":"b52115b0-5068-47e8-801e-8114d9abe026","Type":"ContainerStarted","Data":"5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7"}
Sep 18 13:56:36.963010 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:36.962944    2575 patch_prober.go:28] interesting pod/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 18 13:56:36.963240 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:36.963020    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 18 13:56:37.074381 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:37.074327    2575 patch_prober.go:28] interesting pod/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 18 13:56:37.074595 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:37.074399    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 18 13:56:37.074713 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:37.074689    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:37.963861 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:37.963817    2575 patch_prober.go:28] interesting pod/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 18 13:56:37.964414 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:37.963893    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 18 13:56:38.074326 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:38.074283    2575 patch_prober.go:28] interesting pod/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 18 13:56:38.074532 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:38.074352    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 18 13:56:38.963612 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:38.963512    2575 patch_prober.go:28] interesting pod/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 18 13:56:38.963612 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:38.963589    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 18 13:56:39.073864 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:39.073818    2575 patch_prober.go:28] interesting pod/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 18 13:56:39.074388 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:39.073899    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 18 13:56:39.963348 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:39.963304    2575 patch_prober.go:28] interesting pod/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 18 13:56:39.963564 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:39.963390    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 18 13:56:40.074649 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:40.074600    2575 patch_prober.go:28] interesting pod/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 18 13:56:40.075184 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:40.074686    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 18 13:56:40.963433 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:40.963375    2575 patch_prober.go:28] interesting pod/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 18 13:56:40.963651 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:40.963491    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 18 13:56:41.074478 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:41.074435    2575 patch_prober.go:28] interesting pod/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 18 13:56:41.074681 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:41.074509    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 18 13:56:41.967656 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:41.967620    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:41.967987 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:41.967967    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:41.968734 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:41.968716    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 13:56:42.078518 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:42.078401    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:42.078898 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:42.078687    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:42.079687 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:42.079663    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 13:56:42.164353 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:42.164321    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:43.166336 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:43.166306    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:43.768841 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:43.768637    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"]
Sep 18 13:56:43.773084 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:43.773061    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"
Sep 18 13:56:43.775758 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:43.775738    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 13:56:43.780877 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:43.780851    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"]
Sep 18 13:56:43.874535 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:43.874504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc67ec2-f8da-480f-a18c-a972989683ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc\" (UID: \"1dc67ec2-f8da-480f-a18c-a972989683ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"
Sep 18 13:56:43.976035 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:43.975990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc67ec2-f8da-480f-a18c-a972989683ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc\" (UID: \"1dc67ec2-f8da-480f-a18c-a972989683ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"
Sep 18 13:56:43.976690 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:43.976671    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc67ec2-f8da-480f-a18c-a972989683ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc\" (UID: \"1dc67ec2-f8da-480f-a18c-a972989683ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"
Sep 18 13:56:44.086399 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:44.086363    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"
Sep 18 13:56:44.393056 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:44.393029    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"]
Sep 18 13:56:44.395476 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:56:44.395446    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc67ec2_f8da_480f_a18c_a972989683ec.slice/crio-edeb688fb82126fba566e43f3255f10dae3c268d72196a4aae310b55c334e7b5 WatchSource:0}: Error finding container edeb688fb82126fba566e43f3255f10dae3c268d72196a4aae310b55c334e7b5: Status 404 returned error can't find the container with id edeb688fb82126fba566e43f3255f10dae3c268d72196a4aae310b55c334e7b5
Sep 18 13:56:44.397453 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:44.397433    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:56:45.283558 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:45.283478    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc" event={"ID":"1dc67ec2-f8da-480f-a18c-a972989683ec","Type":"ContainerStarted","Data":"edeb688fb82126fba566e43f3255f10dae3c268d72196a4aae310b55c334e7b5"}
Sep 18 13:56:47.313685 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:47.313637    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc" event={"ID":"1dc67ec2-f8da-480f-a18c-a972989683ec","Type":"ContainerStarted","Data":"7810adf7e4829b4c1a5248809b425046682f42690e460628696bc07c1d498a61"}
Sep 18 13:56:48.321573 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:48.321490    2575 generic.go:356] "Generic (PLEG): container finished" podID="4e463d94-d73d-485a-8469-7a0284ead985" containerID="bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf" exitCode=0
Sep 18 13:56:48.321573 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:48.321562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" event={"ID":"4e463d94-d73d-485a-8469-7a0284ead985","Type":"ContainerDied","Data":"bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf"}
Sep 18 13:56:48.322113 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:48.322097    2575 scope.go:117] "RemoveContainer" containerID="bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf"
Sep 18 13:56:48.323565 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:48.323538    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:48.323654 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:48.323561    2575 generic.go:356] "Generic (PLEG): container finished" podID="1dc67ec2-f8da-480f-a18c-a972989683ec" containerID="7810adf7e4829b4c1a5248809b425046682f42690e460628696bc07c1d498a61" exitCode=0
Sep 18 13:56:48.323654 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:48.323607    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc" event={"ID":"1dc67ec2-f8da-480f-a18c-a972989683ec","Type":"ContainerDied","Data":"7810adf7e4829b4c1a5248809b425046682f42690e460628696bc07c1d498a61"}
Sep 18 13:56:48.323654 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:48.323611    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:48.323654 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:48.323645    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:56:48.345893 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:48.345848    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc" podStartSLOduration=3.021647556 podStartE2EDuration="5.345825539s" totalImagesPullingTime="2.324177983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:56:47.350457747 +0000 UTC m=+733.186296461" watchObservedRunningTime="2026-09-18 13:56:48.345825539 +0000 UTC m=+734.181664318"
Sep 18 13:56:49.332017 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:49.331981    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" event={"ID":"4e463d94-d73d-485a-8469-7a0284ead985","Type":"ContainerStarted","Data":"1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190"}
Sep 18 13:56:49.480111 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:49.480083    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"
Sep 18 13:56:49.540655 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:49.540610    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc67ec2-f8da-480f-a18c-a972989683ec-maas-api-service-ca\") pod \"1dc67ec2-f8da-480f-a18c-a972989683ec\" (UID: \"1dc67ec2-f8da-480f-a18c-a972989683ec\") "
Sep 18 13:56:49.541057 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:49.541023    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dc67ec2-f8da-480f-a18c-a972989683ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1dc67ec2-f8da-480f-a18c-a972989683ec" (UID: "1dc67ec2-f8da-480f-a18c-a972989683ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:56:49.642075 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:49.641980    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc67ec2-f8da-480f-a18c-a972989683ec-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:56:49.770569 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:49.770537    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:49.771289 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:49.771265    2575 patch_prober.go:28] interesting pod/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 18 13:56:49.771347 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:49.771316    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 18 13:56:50.342256 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:50.342222    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"
Sep 18 13:56:50.342752 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:50.342670    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc" event={"ID":"1dc67ec2-f8da-480f-a18c-a972989683ec","Type":"ContainerDied","Data":"edeb688fb82126fba566e43f3255f10dae3c268d72196a4aae310b55c334e7b5"}
Sep 18 13:56:50.342752 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:50.342721    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edeb688fb82126fba566e43f3255f10dae3c268d72196a4aae310b55c334e7b5"
Sep 18 13:56:50.771387 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:50.771304    2575 patch_prober.go:28] interesting pod/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 18 13:56:50.771387 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:50.771362    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 18 13:56:51.770448 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:51.770409    2575 patch_prober.go:28] interesting pod/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 18 13:56:51.770877 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:51.770480    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 18 13:56:52.770448 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:52.770395    2575 patch_prober.go:28] interesting pod/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 18 13:56:52.771022 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:52.770493    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 18 13:56:53.078933 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:53.078892    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:56:53.771546 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:53.771511    2575 patch_prober.go:28] interesting pod/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 18 13:56:53.772174 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:53.772114    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 18 13:56:54.273049 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.273018    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"]
Sep 18 13:56:54.273554 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.273517    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx" podUID="47e2484e-784f-4db9-b9f6-370866e57ec5" containerName="payload-processing" containerID="cri-o://7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1" gracePeriod=30
Sep 18 13:56:54.335010 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.334079    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"]
Sep 18 13:56:54.335010 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.334395    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8" podUID="603d546c-066a-4a85-9699-d394727f8b01" containerName="payload-pre-processing" containerID="cri-o://f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a" gracePeriod=30
Sep 18 13:56:54.453158 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.434244    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"]
Sep 18 13:56:54.474165 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.470161    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e095dac8-hcpfc"]
Sep 18 13:56:54.594174 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.586912    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"]
Sep 18 13:56:54.594174 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.587200    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy" containerID="cri-o://1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190" gracePeriod=30
Sep 18 13:56:54.824416 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.824387    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:54.911461 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.911367    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:54.915833 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.915814    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47e2484e-784f-4db9-b9f6-370866e57ec5-plugins-config-volume\") pod \"47e2484e-784f-4db9-b9f6-370866e57ec5\" (UID: \"47e2484e-784f-4db9-b9f6-370866e57ec5\") "
Sep 18 13:56:54.915919 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.915888    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xszqk\" (UniqueName: \"kubernetes.io/projected/47e2484e-784f-4db9-b9f6-370866e57ec5-kube-api-access-xszqk\") pod \"47e2484e-784f-4db9-b9f6-370866e57ec5\" (UID: \"47e2484e-784f-4db9-b9f6-370866e57ec5\") "
Sep 18 13:56:54.916242 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.916213    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e2484e-784f-4db9-b9f6-370866e57ec5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "47e2484e-784f-4db9-b9f6-370866e57ec5" (UID: "47e2484e-784f-4db9-b9f6-370866e57ec5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:56:54.918116 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:54.918091    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e2484e-784f-4db9-b9f6-370866e57ec5-kube-api-access-xszqk" (OuterVolumeSpecName: "kube-api-access-xszqk") pod "47e2484e-784f-4db9-b9f6-370866e57ec5" (UID: "47e2484e-784f-4db9-b9f6-370866e57ec5"). InnerVolumeSpecName "kube-api-access-xszqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:56:55.016996 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.016957    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbt6b\" (UniqueName: \"kubernetes.io/projected/603d546c-066a-4a85-9699-d394727f8b01-kube-api-access-vbt6b\") pod \"603d546c-066a-4a85-9699-d394727f8b01\" (UID: \"603d546c-066a-4a85-9699-d394727f8b01\") "
Sep 18 13:56:55.016996 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.016998    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/603d546c-066a-4a85-9699-d394727f8b01-plugins-config-volume\") pod \"603d546c-066a-4a85-9699-d394727f8b01\" (UID: \"603d546c-066a-4a85-9699-d394727f8b01\") "
Sep 18 13:56:55.017543 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.017507    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47e2484e-784f-4db9-b9f6-370866e57ec5-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:56:55.017543 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.017543    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xszqk\" (UniqueName: \"kubernetes.io/projected/47e2484e-784f-4db9-b9f6-370866e57ec5-kube-api-access-xszqk\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:56:55.017714 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.017589    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/603d546c-066a-4a85-9699-d394727f8b01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "603d546c-066a-4a85-9699-d394727f8b01" (UID: "603d546c-066a-4a85-9699-d394727f8b01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:56:55.019560 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.019534    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603d546c-066a-4a85-9699-d394727f8b01-kube-api-access-vbt6b" (OuterVolumeSpecName: "kube-api-access-vbt6b") pod "603d546c-066a-4a85-9699-d394727f8b01" (UID: "603d546c-066a-4a85-9699-d394727f8b01"). InnerVolumeSpecName "kube-api-access-vbt6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:56:55.118990 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.118946    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbt6b\" (UniqueName: \"kubernetes.io/projected/603d546c-066a-4a85-9699-d394727f8b01-kube-api-access-vbt6b\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:56:55.118990 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.118983    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/603d546c-066a-4a85-9699-d394727f8b01-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:56:55.422880 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.422846    2575 generic.go:356] "Generic (PLEG): container finished" podID="47e2484e-784f-4db9-b9f6-370866e57ec5" containerID="7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1" exitCode=0
Sep 18 13:56:55.423051 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.422929    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx" event={"ID":"47e2484e-784f-4db9-b9f6-370866e57ec5","Type":"ContainerDied","Data":"7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1"}
Sep 18 13:56:55.423051 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.422967    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx" event={"ID":"47e2484e-784f-4db9-b9f6-370866e57ec5","Type":"ContainerDied","Data":"04bda57deceb6c21288157d03f207c4f783dd0490468b7a0349746cf5cda9fa2"}
Sep 18 13:56:55.423051 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.422989    2575 scope.go:117] "RemoveContainer" containerID="7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1"
Sep 18 13:56:55.423216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.423116    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"
Sep 18 13:56:55.424728 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.424697    2575 generic.go:356] "Generic (PLEG): container finished" podID="603d546c-066a-4a85-9699-d394727f8b01" containerID="f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a" exitCode=0
Sep 18 13:56:55.425036 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.424838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8" event={"ID":"603d546c-066a-4a85-9699-d394727f8b01","Type":"ContainerDied","Data":"f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a"}
Sep 18 13:56:55.425036 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.424907    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8" event={"ID":"603d546c-066a-4a85-9699-d394727f8b01","Type":"ContainerDied","Data":"1c93cf630177b732a8c82bba616b671f222e8d0d7e76535e6108f5d02a3a30c1"}
Sep 18 13:56:55.425036 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.424981    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"
Sep 18 13:56:55.438156 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.434709    2575 scope.go:117] "RemoveContainer" containerID="7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1"
Sep 18 13:56:55.438156 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:56:55.435030    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1\": container with ID starting with 7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1 not found: ID does not exist" containerID="7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1"
Sep 18 13:56:55.438156 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.435076    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1"} err="failed to get container status \"7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1\": rpc error: code = NotFound desc = could not find container \"7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1\": container with ID starting with 7d4d988a3e4950924933423bf3c52a725bfd9019c35529b51380c0c1b91817f1 not found: ID does not exist"
Sep 18 13:56:55.438156 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.435099    2575 scope.go:117] "RemoveContainer" containerID="f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a"
Sep 18 13:56:55.456332 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.456292    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"]
Sep 18 13:56:55.467158 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.464182    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx"]
Sep 18 13:56:55.467158 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.466437    2575 scope.go:117] "RemoveContainer" containerID="f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a"
Sep 18 13:56:55.471154 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:56:55.467500    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a\": container with ID starting with f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a not found: ID does not exist" containerID="f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a"
Sep 18 13:56:55.471154 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.467557    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a"} err="failed to get container status \"f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a\": rpc error: code = NotFound desc = could not find container \"f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a\": container with ID starting with f1c74d2c318b7d53548d9cb3e15f974d22ffcc88144263a5ced1fc68aa7aa86a not found: ID does not exist"
Sep 18 13:56:55.479410 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.479373    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"]
Sep 18 13:56:55.488243 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:55.488154    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8"]
Sep 18 13:56:56.293526 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:56.293494    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dc67ec2-f8da-480f-a18c-a972989683ec" path="/var/lib/kubelet/pods/1dc67ec2-f8da-480f-a18c-a972989683ec/volumes"
Sep 18 13:56:56.293901 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:56.293874    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e2484e-784f-4db9-b9f6-370866e57ec5" path="/var/lib/kubelet/pods/47e2484e-784f-4db9-b9f6-370866e57ec5/volumes"
Sep 18 13:56:56.294216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:56:56.294202    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="603d546c-066a-4a85-9699-d394727f8b01" path="/var/lib/kubelet/pods/603d546c-066a-4a85-9699-d394727f8b01/volumes"
Sep 18 13:57:00.965522 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:00.965496    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:57:01.097417 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097383    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p45r\" (UniqueName: \"kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-kube-api-access-9p45r\") pod \"4e463d94-d73d-485a-8469-7a0284ead985\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") "
Sep 18 13:57:01.097417 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097421    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-credential-socket\") pod \"4e463d94-d73d-485a-8469-7a0284ead985\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") "
Sep 18 13:57:01.097662 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097464    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-data\") pod \"4e463d94-d73d-485a-8469-7a0284ead985\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") "
Sep 18 13:57:01.097662 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097482    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-socket\") pod \"4e463d94-d73d-485a-8469-7a0284ead985\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") "
Sep 18 13:57:01.097662 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097503    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-istio-token\") pod \"4e463d94-d73d-485a-8469-7a0284ead985\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") "
Sep 18 13:57:01.097662 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097524    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-envoy\") pod \"4e463d94-d73d-485a-8469-7a0284ead985\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") "
Sep 18 13:57:01.097662 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097555    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e463d94-d73d-485a-8469-7a0284ead985-istio-podinfo\") pod \"4e463d94-d73d-485a-8469-7a0284ead985\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") "
Sep 18 13:57:01.097662 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097575    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-certs\") pod \"4e463d94-d73d-485a-8469-7a0284ead985\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") "
Sep 18 13:57:01.097662 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097607    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e463d94-d73d-485a-8469-7a0284ead985-istiod-ca-cert\") pod \"4e463d94-d73d-485a-8469-7a0284ead985\" (UID: \"4e463d94-d73d-485a-8469-7a0284ead985\") "
Sep 18 13:57:01.098022 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097810    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e463d94-d73d-485a-8469-7a0284ead985" (UID: "4e463d94-d73d-485a-8469-7a0284ead985"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:57:01.098022 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097824    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e463d94-d73d-485a-8469-7a0284ead985" (UID: "4e463d94-d73d-485a-8469-7a0284ead985"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:57:01.098022 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.097840    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e463d94-d73d-485a-8469-7a0284ead985" (UID: "4e463d94-d73d-485a-8469-7a0284ead985"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:57:01.098022 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.098013    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-credential-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:01.098251 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.098032    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-data\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:01.098251 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.098046    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:01.098251 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.098052    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e463d94-d73d-485a-8469-7a0284ead985" (UID: "4e463d94-d73d-485a-8469-7a0284ead985"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:57:01.098251 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.098103    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e463d94-d73d-485a-8469-7a0284ead985-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e463d94-d73d-485a-8469-7a0284ead985" (UID: "4e463d94-d73d-485a-8469-7a0284ead985"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:57:01.099705 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.099679    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e463d94-d73d-485a-8469-7a0284ead985" (UID: "4e463d94-d73d-485a-8469-7a0284ead985"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:57:01.099888 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.099866    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e463d94-d73d-485a-8469-7a0284ead985-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e463d94-d73d-485a-8469-7a0284ead985" (UID: "4e463d94-d73d-485a-8469-7a0284ead985"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 13:57:01.100053 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.100036    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-kube-api-access-9p45r" (OuterVolumeSpecName: "kube-api-access-9p45r") pod "4e463d94-d73d-485a-8469-7a0284ead985" (UID: "4e463d94-d73d-485a-8469-7a0284ead985"). InnerVolumeSpecName "kube-api-access-9p45r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:57:01.100103 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.100082    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e463d94-d73d-485a-8469-7a0284ead985" (UID: "4e463d94-d73d-485a-8469-7a0284ead985"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:57:01.199716 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.199663    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p45r\" (UniqueName: \"kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-kube-api-access-9p45r\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:01.199716 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.199699    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e463d94-d73d-485a-8469-7a0284ead985-istio-token\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:01.199716 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.199713    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-istio-envoy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:01.199716 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.199724    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e463d94-d73d-485a-8469-7a0284ead985-istio-podinfo\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:01.199991 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.199736    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e463d94-d73d-485a-8469-7a0284ead985-workload-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:01.199991 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.199747    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e463d94-d73d-485a-8469-7a0284ead985-istiod-ca-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:01.469398 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.469311    2575 generic.go:356] "Generic (PLEG): container finished" podID="4e463d94-d73d-485a-8469-7a0284ead985" containerID="1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190" exitCode=0
Sep 18 13:57:01.469398 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.469368    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"
Sep 18 13:57:01.469634 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.469398    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" event={"ID":"4e463d94-d73d-485a-8469-7a0284ead985","Type":"ContainerDied","Data":"1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190"}
Sep 18 13:57:01.469634 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.469459    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr" event={"ID":"4e463d94-d73d-485a-8469-7a0284ead985","Type":"ContainerDied","Data":"3009c033988729daed4fe3bf8ab651e502624b369aed67818366862b2fd63bf0"}
Sep 18 13:57:01.469634 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.469487    2575 scope.go:117] "RemoveContainer" containerID="1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190"
Sep 18 13:57:01.471234 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.471209    2575 generic.go:356] "Generic (PLEG): container finished" podID="c609d637-9282-4247-9916-f1187b8f9de5" containerID="e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b" exitCode=0
Sep 18 13:57:01.471348 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.471279    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" event={"ID":"c609d637-9282-4247-9916-f1187b8f9de5","Type":"ContainerDied","Data":"e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b"}
Sep 18 13:57:01.471671 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.471651    2575 scope.go:117] "RemoveContainer" containerID="e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b"
Sep 18 13:57:01.472958 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.472925    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:57:01.473063 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.472997    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:57:01.473063 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.473030    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:57:01.480848 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.480828    2575 scope.go:117] "RemoveContainer" containerID="bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf"
Sep 18 13:57:01.491478 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.491462    2575 scope.go:117] "RemoveContainer" containerID="1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190"
Sep 18 13:57:01.491770 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:57:01.491753    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190\": container with ID starting with 1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190 not found: ID does not exist" containerID="1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190"
Sep 18 13:57:01.491822 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.491779    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190"} err="failed to get container status \"1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190\": rpc error: code = NotFound desc = could not find container \"1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190\": container with ID starting with 1a2c127398b6da4a1bf4e7286568b83fd6de39406be47ac061b6154ce3ef7190 not found: ID does not exist"
Sep 18 13:57:01.491822 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.491795    2575 scope.go:117] "RemoveContainer" containerID="bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf"
Sep 18 13:57:01.492068 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:57:01.492049    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf\": container with ID starting with bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf not found: ID does not exist" containerID="bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf"
Sep 18 13:57:01.492146 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.492073    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf"} err="failed to get container status \"bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf\": rpc error: code = NotFound desc = could not find container \"bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf\": container with ID starting with bab29674b76a9ebedd3482e98083fed531f5cf3701383406e9903a9d84653bbf not found: ID does not exist"
Sep 18 13:57:01.519191 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.519162    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"]
Sep 18 13:57:01.523113 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.522961    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr"]
Sep 18 13:57:01.908079 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908041    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"]
Sep 18 13:57:01.908575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908560    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy"
Sep 18 13:57:01.908631 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908576    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy"
Sep 18 13:57:01.908631 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908586    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc67ec2-f8da-480f-a18c-a972989683ec" containerName="revoke-keys"
Sep 18 13:57:01.908631 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908591    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc67ec2-f8da-480f-a18c-a972989683ec" containerName="revoke-keys"
Sep 18 13:57:01.908631 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908605    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e2484e-784f-4db9-b9f6-370866e57ec5" containerName="payload-processing"
Sep 18 13:57:01.908631 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908612    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e2484e-784f-4db9-b9f6-370866e57ec5" containerName="payload-processing"
Sep 18 13:57:01.908631 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908618    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="603d546c-066a-4a85-9699-d394727f8b01" containerName="payload-pre-processing"
Sep 18 13:57:01.908631 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908623    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="603d546c-066a-4a85-9699-d394727f8b01" containerName="payload-pre-processing"
Sep 18 13:57:01.908915 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908693    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dc67ec2-f8da-480f-a18c-a972989683ec" containerName="revoke-keys"
Sep 18 13:57:01.908915 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908703    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="47e2484e-784f-4db9-b9f6-370866e57ec5" containerName="payload-processing"
Sep 18 13:57:01.908915 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908711    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy"
Sep 18 13:57:01.908915 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908718    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy"
Sep 18 13:57:01.908915 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.908725    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="603d546c-066a-4a85-9699-d394727f8b01" containerName="payload-pre-processing"
Sep 18 13:57:01.918026 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.913080    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:01.918026 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.917791    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-3675964e\""
Sep 18 13:57:01.918026 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.917912    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-3675964e-dockercfg-4bzzc\""
Sep 18 13:57:01.923049 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:01.923023    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"]
Sep 18 13:57:02.007556 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.007519    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mtpg\" (UniqueName: \"kubernetes.io/projected/e2737431-4110-482e-b951-f9588a39af8c-kube-api-access-5mtpg\") pod \"payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch\" (UID: \"e2737431-4110-482e-b951-f9588a39af8c\") " pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:02.007992 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.007716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2737431-4110-482e-b951-f9588a39af8c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch\" (UID: \"e2737431-4110-482e-b951-f9588a39af8c\") " pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:02.109348 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.109309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2737431-4110-482e-b951-f9588a39af8c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch\" (UID: \"e2737431-4110-482e-b951-f9588a39af8c\") " pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:02.109559 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.109404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mtpg\" (UniqueName: \"kubernetes.io/projected/e2737431-4110-482e-b951-f9588a39af8c-kube-api-access-5mtpg\") pod \"payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch\" (UID: \"e2737431-4110-482e-b951-f9588a39af8c\") " pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:02.110096 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.110067    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2737431-4110-482e-b951-f9588a39af8c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch\" (UID: \"e2737431-4110-482e-b951-f9588a39af8c\") " pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:02.119398 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.119373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mtpg\" (UniqueName: \"kubernetes.io/projected/e2737431-4110-482e-b951-f9588a39af8c-kube-api-access-5mtpg\") pod \"payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch\" (UID: \"e2737431-4110-482e-b951-f9588a39af8c\") " pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:02.157769 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.157730    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:57:02.232094 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.231992    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:02.298831 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.298639    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e463d94-d73d-485a-8469-7a0284ead985" path="/var/lib/kubelet/pods/4e463d94-d73d-485a-8469-7a0284ead985/volumes"
Sep 18 13:57:02.480367 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.480334    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" event={"ID":"c609d637-9282-4247-9916-f1187b8f9de5","Type":"ContainerStarted","Data":"351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12"}
Sep 18 13:57:02.507499 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.507474    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"]
Sep 18 13:57:02.509339 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:57:02.509314    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2737431_4110_482e_b951_f9588a39af8c.slice/crio-7f2fc63c7819fd6ca6bd6f6dd0a971ce7c62e70c9428c00b504fe6d70f40ff22 WatchSource:0}: Error finding container 7f2fc63c7819fd6ca6bd6f6dd0a971ce7c62e70c9428c00b504fe6d70f40ff22: Status 404 returned error can't find the container with id 7f2fc63c7819fd6ca6bd6f6dd0a971ce7c62e70c9428c00b504fe6d70f40ff22
Sep 18 13:57:02.606119 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.606086    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:57:02.607390 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.607362    2575 patch_prober.go:28] interesting pod/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 18 13:57:02.607520 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:02.607414    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 18 13:57:03.487843 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:03.487809    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch" event={"ID":"e2737431-4110-482e-b951-f9588a39af8c","Type":"ContainerStarted","Data":"d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3"}
Sep 18 13:57:03.488240 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:03.487864    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch" event={"ID":"e2737431-4110-482e-b951-f9588a39af8c","Type":"ContainerStarted","Data":"7f2fc63c7819fd6ca6bd6f6dd0a971ce7c62e70c9428c00b504fe6d70f40ff22"}
Sep 18 13:57:03.488240 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:03.487891    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:03.507421 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:03.507372    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch" podStartSLOduration=2.507356823 podStartE2EDuration="2.507356823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:57:03.504880779 +0000 UTC m=+749.340719494" watchObservedRunningTime="2026-09-18 13:57:03.507356823 +0000 UTC m=+749.343195601"
Sep 18 13:57:03.606035 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:03.606002    2575 patch_prober.go:28] interesting pod/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 18 13:57:03.606221 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:03.606061    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 18 13:57:04.606575 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:04.606539    2575 patch_prober.go:28] interesting pod/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 18 13:57:04.606977 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:04.606609    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 18 13:57:05.605919 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:05.605890    2575 patch_prober.go:28] interesting pod/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 18 13:57:05.606094 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:05.605941    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 18 13:57:06.606504 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:06.606466    2575 patch_prober.go:28] interesting pod/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 18 13:57:06.606901 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:06.606530    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 18 13:57:07.605841 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:07.605805    2575 patch_prober.go:28] interesting pod/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 18 13:57:07.606022 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:07.605860    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 18 13:57:08.610747 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:08.610716    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:57:08.611176 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:08.610982    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:57:08.611746 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:08.611730    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 13:57:14.496108 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:14.496077    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:23.336012 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:23.335975    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"]
Sep 18 13:57:23.336714 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:23.336693    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy"
Sep 18 13:57:23.336814 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:23.336717    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e463d94-d73d-485a-8469-7a0284ead985" containerName="istio-proxy"
Sep 18 13:57:23.339268 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:23.339242    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"
Sep 18 13:57:23.342336 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:23.342313    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 13:57:23.348361 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:23.348242    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"]
Sep 18 13:57:23.442097 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:23.442058    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/904af0c0-f006-4e7a-9309-953dd11f2342-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g\" (UID: \"904af0c0-f006-4e7a-9309-953dd11f2342\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"
Sep 18 13:57:23.543747 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:23.543690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/904af0c0-f006-4e7a-9309-953dd11f2342-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g\" (UID: \"904af0c0-f006-4e7a-9309-953dd11f2342\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"
Sep 18 13:57:23.544397 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:23.544371    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/904af0c0-f006-4e7a-9309-953dd11f2342-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g\" (UID: \"904af0c0-f006-4e7a-9309-953dd11f2342\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"
Sep 18 13:57:23.653215 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:23.653115    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"
Sep 18 13:57:23.927453 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:23.927430    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"]
Sep 18 13:57:23.929739 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:57:23.929712    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904af0c0_f006_4e7a_9309_953dd11f2342.slice/crio-f1c2da2dde23da4133d4567d52d0212757cdfe7ef832525d685cf3ac92113f6d WatchSource:0}: Error finding container f1c2da2dde23da4133d4567d52d0212757cdfe7ef832525d685cf3ac92113f6d: Status 404 returned error can't find the container with id f1c2da2dde23da4133d4567d52d0212757cdfe7ef832525d685cf3ac92113f6d
Sep 18 13:57:24.619492 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:24.619401    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g" event={"ID":"904af0c0-f006-4e7a-9309-953dd11f2342","Type":"ContainerStarted","Data":"c3e17095a768c732f49591447435a6e299e20028559f9be91bd8e0d7fd491e99"}
Sep 18 13:57:24.619492 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:24.619453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g" event={"ID":"904af0c0-f006-4e7a-9309-953dd11f2342","Type":"ContainerStarted","Data":"f1c2da2dde23da4133d4567d52d0212757cdfe7ef832525d685cf3ac92113f6d"}
Sep 18 13:57:24.640989 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:24.640932    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g" podStartSLOduration=1.640916304 podStartE2EDuration="1.640916304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:57:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:57:24.638249078 +0000 UTC m=+770.474087790" watchObservedRunningTime="2026-09-18 13:57:24.640916304 +0000 UTC m=+770.476755017"
Sep 18 13:57:25.626627 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:25.626591    2575 generic.go:356] "Generic (PLEG): container finished" podID="904af0c0-f006-4e7a-9309-953dd11f2342" containerID="c3e17095a768c732f49591447435a6e299e20028559f9be91bd8e0d7fd491e99" exitCode=0
Sep 18 13:57:25.626992 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:25.626674    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g" event={"ID":"904af0c0-f006-4e7a-9309-953dd11f2342","Type":"ContainerDied","Data":"c3e17095a768c732f49591447435a6e299e20028559f9be91bd8e0d7fd491e99"}
Sep 18 13:57:26.775202 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:26.775178    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"
Sep 18 13:57:26.879285 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:26.879253    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/904af0c0-f006-4e7a-9309-953dd11f2342-maas-api-service-ca\") pod \"904af0c0-f006-4e7a-9309-953dd11f2342\" (UID: \"904af0c0-f006-4e7a-9309-953dd11f2342\") "
Sep 18 13:57:26.879611 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:26.879586    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/904af0c0-f006-4e7a-9309-953dd11f2342-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "904af0c0-f006-4e7a-9309-953dd11f2342" (UID: "904af0c0-f006-4e7a-9309-953dd11f2342"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:57:26.980885 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:26.980811    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/904af0c0-f006-4e7a-9309-953dd11f2342-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:27.639837 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:27.639802    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"
Sep 18 13:57:27.639837 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:27.639829    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g" event={"ID":"904af0c0-f006-4e7a-9309-953dd11f2342","Type":"ContainerDied","Data":"f1c2da2dde23da4133d4567d52d0212757cdfe7ef832525d685cf3ac92113f6d"}
Sep 18 13:57:27.640044 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:27.639876    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1c2da2dde23da4133d4567d52d0212757cdfe7ef832525d685cf3ac92113f6d"
Sep 18 13:57:29.551614 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:29.551572    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"]
Sep 18 13:57:29.552085 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:29.551872    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch" podUID="e2737431-4110-482e-b951-f9588a39af8c" containerName="payload-processing" containerID="cri-o://d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3" gracePeriod=30
Sep 18 13:57:29.727111 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:29.727080    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"]
Sep 18 13:57:29.730373 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:29.730346    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3675964e-gjq7g"]
Sep 18 13:57:29.831020 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:29.830975    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:29.911585 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:29.911551    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2737431-4110-482e-b951-f9588a39af8c-plugins-config-volume\") pod \"e2737431-4110-482e-b951-f9588a39af8c\" (UID: \"e2737431-4110-482e-b951-f9588a39af8c\") "
Sep 18 13:57:29.911585 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:29.911592    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mtpg\" (UniqueName: \"kubernetes.io/projected/e2737431-4110-482e-b951-f9588a39af8c-kube-api-access-5mtpg\") pod \"e2737431-4110-482e-b951-f9588a39af8c\" (UID: \"e2737431-4110-482e-b951-f9588a39af8c\") "
Sep 18 13:57:29.912001 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:29.911970    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2737431-4110-482e-b951-f9588a39af8c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e2737431-4110-482e-b951-f9588a39af8c" (UID: "e2737431-4110-482e-b951-f9588a39af8c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:57:29.913829 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:29.913796    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2737431-4110-482e-b951-f9588a39af8c-kube-api-access-5mtpg" (OuterVolumeSpecName: "kube-api-access-5mtpg") pod "e2737431-4110-482e-b951-f9588a39af8c" (UID: "e2737431-4110-482e-b951-f9588a39af8c"). InnerVolumeSpecName "kube-api-access-5mtpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:57:30.012798 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.012768    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2737431-4110-482e-b951-f9588a39af8c-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:30.012798 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.012798    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mtpg\" (UniqueName: \"kubernetes.io/projected/e2737431-4110-482e-b951-f9588a39af8c-kube-api-access-5mtpg\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:57:30.294191 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.294102    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="904af0c0-f006-4e7a-9309-953dd11f2342" path="/var/lib/kubelet/pods/904af0c0-f006-4e7a-9309-953dd11f2342/volumes"
Sep 18 13:57:30.660512 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.660474    2575 generic.go:356] "Generic (PLEG): container finished" podID="e2737431-4110-482e-b951-f9588a39af8c" containerID="d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3" exitCode=0
Sep 18 13:57:30.660952 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.660547    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"
Sep 18 13:57:30.660952 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.660558    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch" event={"ID":"e2737431-4110-482e-b951-f9588a39af8c","Type":"ContainerDied","Data":"d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3"}
Sep 18 13:57:30.660952 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.660629    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch" event={"ID":"e2737431-4110-482e-b951-f9588a39af8c","Type":"ContainerDied","Data":"7f2fc63c7819fd6ca6bd6f6dd0a971ce7c62e70c9428c00b504fe6d70f40ff22"}
Sep 18 13:57:30.660952 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.660678    2575 scope.go:117] "RemoveContainer" containerID="d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3"
Sep 18 13:57:30.672632 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.672612    2575 scope.go:117] "RemoveContainer" containerID="d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3"
Sep 18 13:57:30.672977 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:57:30.672948    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3\": container with ID starting with d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3 not found: ID does not exist" containerID="d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3"
Sep 18 13:57:30.673079 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.672984    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3"} err="failed to get container status \"d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3\": rpc error: code = NotFound desc = could not find container \"d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3\": container with ID starting with d06fc2e0614084e3932c896f89cf0ace35711b121fd657e3ee3b018fa21372c3 not found: ID does not exist"
Sep 18 13:57:30.683268 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.683242    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"]
Sep 18 13:57:30.687209 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.687186    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"]
Sep 18 13:57:30.687707 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.687692    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="904af0c0-f006-4e7a-9309-953dd11f2342" containerName="revoke-keys"
Sep 18 13:57:30.687764 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.687708    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="904af0c0-f006-4e7a-9309-953dd11f2342" containerName="revoke-keys"
Sep 18 13:57:30.687764 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.687740    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2737431-4110-482e-b951-f9588a39af8c" containerName="payload-processing"
Sep 18 13:57:30.687764 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.687746    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2737431-4110-482e-b951-f9588a39af8c" containerName="payload-processing"
Sep 18 13:57:30.687868 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.687828    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="904af0c0-f006-4e7a-9309-953dd11f2342" containerName="revoke-keys"
Sep 18 13:57:30.687868 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.687839    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2737431-4110-482e-b951-f9588a39af8c" containerName="payload-processing"
Sep 18 13:57:30.689906 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.689892    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.693701 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.693683    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-feff2644-openshift-default-dockercfg-cjdrw\""
Sep 18 13:57:30.695746 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.695724    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch"]
Sep 18 13:57:30.702678 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.702659    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"]
Sep 18 13:57:30.821657 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.821612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istiod-ca-cert\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.821657 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.821656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-data\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.821896 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.821715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48jn7\" (UniqueName: \"kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-kube-api-access-48jn7\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.821896 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.821755    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-podinfo\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.821896 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.821809    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-certs\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.821896 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.821887    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-token\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.822048 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.821916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-envoy\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.822048 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.821943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-credential-socket\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.822048 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.822039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-socket\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.923636 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.923555    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-socket\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.923636 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.923611    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istiod-ca-cert\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.923636 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.923632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-data\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.923877 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.923654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48jn7\" (UniqueName: \"kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-kube-api-access-48jn7\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.923877 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.923676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-podinfo\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.923877 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.923716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-certs\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.924038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.923954    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-token\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.924038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.924012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-envoy\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.924159 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.924039    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-socket\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.924159 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.924058    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-credential-socket\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.924159 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.924113    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-data\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.924306 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.924159    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-certs\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.924401 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.924384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istiod-ca-cert\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.924499 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.924477    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-credential-socket\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.926356 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.926331    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-podinfo\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.926479 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.926342    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-envoy\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.931498 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.931470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-token\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:30.931755 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:30.931734    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48jn7\" (UniqueName: \"kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-kube-api-access-48jn7\") pod \"e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") " pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:31.001753 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:31.001728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:31.279166 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:31.279113    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"]
Sep 18 13:57:31.280705 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:57:31.280669    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f4c4fd7_6b08_4d01_bc88_b5906e2f0cb0.slice/crio-665ff9b0e3942190b09274172d912d18823bb1d381e59b69c42493a2dec3f1e3 WatchSource:0}: Error finding container 665ff9b0e3942190b09274172d912d18823bb1d381e59b69c42493a2dec3f1e3: Status 404 returned error can't find the container with id 665ff9b0e3942190b09274172d912d18823bb1d381e59b69c42493a2dec3f1e3
Sep 18 13:57:31.283459 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:31.283426    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:57:31.283535 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:31.283495    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:57:31.283571 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:31.283533    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:57:31.670334 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:31.670299    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" event={"ID":"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0","Type":"ContainerStarted","Data":"5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591"}
Sep 18 13:57:31.670821 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:31.670347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" event={"ID":"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0","Type":"ContainerStarted","Data":"665ff9b0e3942190b09274172d912d18823bb1d381e59b69c42493a2dec3f1e3"}
Sep 18 13:57:31.695236 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:31.695176    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" podStartSLOduration=1.695153278 podStartE2EDuration="1.695153278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:57:31.693091494 +0000 UTC m=+777.528930210" watchObservedRunningTime="2026-09-18 13:57:31.695153278 +0000 UTC m=+777.530991990"
Sep 18 13:57:32.002100 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:32.001998    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:32.007468 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:32.007439    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:32.294358 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:32.294276    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2737431-4110-482e-b951-f9588a39af8c" path="/var/lib/kubelet/pods/e2737431-4110-482e-b951-f9588a39af8c/volumes"
Sep 18 13:57:32.677017 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:32.676981    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:32.677780 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:32.677762    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:48.719354 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:48.719267    2575 patch_prober.go:28] interesting pod/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 13:57:48.719354 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:48.719343    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 13:57:49.789754 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:49.789719    2575 generic.go:356] "Generic (PLEG): container finished" podID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerID="5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591" exitCode=0
Sep 18 13:57:49.790392 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:49.789793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" event={"ID":"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0","Type":"ContainerDied","Data":"5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591"}
Sep 18 13:57:49.790392 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:49.790231    2575 scope.go:117] "RemoveContainer" containerID="5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591"
Sep 18 13:57:49.791581 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:49.791544    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:57:49.791656 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:49.791640    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:57:49.791717 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:49.791700    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 13:57:50.802161 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:50.801456    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" event={"ID":"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0","Type":"ContainerStarted","Data":"07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7"}
Sep 18 13:57:51.002226 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:51.002183    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:51.002482 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:51.002462    2575 patch_prober.go:28] interesting pod/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 13:57:51.002535 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:51.002511    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 13:57:52.002682 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:52.002637    2575 patch_prober.go:28] interesting pod/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 13:57:52.003075 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:52.002704    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 13:57:53.002832 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:53.002792    2575 patch_prober.go:28] interesting pod/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 13:57:53.003223 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:53.002851    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 13:57:54.002644 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:54.002599    2575 patch_prober.go:28] interesting pod/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 13:57:54.002859 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:54.002656    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 13:57:55.002386 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:55.002346    2575 patch_prober.go:28] interesting pod/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 13:57:55.002600 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:55.002421    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 13:57:56.002371 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:56.002336    2575 patch_prober.go:28] interesting pod/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 13:57:56.002882 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:56.002395    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 13:57:57.006329 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:57.006300    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:57.006754 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:57.006579    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:57.007234 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:57.007215    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:57:58.754572 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:58.754538    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"]
Sep 18 13:57:58.757661 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:58.757639    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"
Sep 18 13:57:58.760491 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:58.760472    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 13:57:58.768553 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:58.768526    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"]
Sep 18 13:57:58.859990 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:58.859959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df08bcc6-d852-4c22-91a8-f5314b2e3610-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-feff2644-rcwpb\" (UID: \"df08bcc6-d852-4c22-91a8-f5314b2e3610\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"
Sep 18 13:57:58.961269 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:58.961229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df08bcc6-d852-4c22-91a8-f5314b2e3610-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-feff2644-rcwpb\" (UID: \"df08bcc6-d852-4c22-91a8-f5314b2e3610\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"
Sep 18 13:57:58.962022 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:58.961999    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df08bcc6-d852-4c22-91a8-f5314b2e3610-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-feff2644-rcwpb\" (UID: \"df08bcc6-d852-4c22-91a8-f5314b2e3610\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"
Sep 18 13:57:59.068808 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:59.068773    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"
Sep 18 13:57:59.343996 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:59.343970    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"]
Sep 18 13:57:59.346830 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:57:59.346800    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf08bcc6_d852_4c22_91a8_f5314b2e3610.slice/crio-7288131412efc79872cd951e5caa1f4ef29de9deee0cd8f44a8f16f5b5c87885 WatchSource:0}: Error finding container 7288131412efc79872cd951e5caa1f4ef29de9deee0cd8f44a8f16f5b5c87885: Status 404 returned error can't find the container with id 7288131412efc79872cd951e5caa1f4ef29de9deee0cd8f44a8f16f5b5c87885
Sep 18 13:57:59.855418 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:59.855377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb" event={"ID":"df08bcc6-d852-4c22-91a8-f5314b2e3610","Type":"ContainerStarted","Data":"2e58473ead340610efbdc4aec3da238e476dafdf368c8ac7fd47390820cd7c76"}
Sep 18 13:57:59.855804 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:59.855435    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb" event={"ID":"df08bcc6-d852-4c22-91a8-f5314b2e3610","Type":"ContainerStarted","Data":"7288131412efc79872cd951e5caa1f4ef29de9deee0cd8f44a8f16f5b5c87885"}
Sep 18 13:57:59.873476 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:57:59.873422    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb" podStartSLOduration=1.873405904 podStartE2EDuration="1.873405904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:57:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:57:59.872361478 +0000 UTC m=+805.708200191" watchObservedRunningTime="2026-09-18 13:57:59.873405904 +0000 UTC m=+805.709244617"
Sep 18 13:58:00.863340 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:00.863302    2575 generic.go:356] "Generic (PLEG): container finished" podID="df08bcc6-d852-4c22-91a8-f5314b2e3610" containerID="2e58473ead340610efbdc4aec3da238e476dafdf368c8ac7fd47390820cd7c76" exitCode=0
Sep 18 13:58:00.863799 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:00.863389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb" event={"ID":"df08bcc6-d852-4c22-91a8-f5314b2e3610","Type":"ContainerDied","Data":"2e58473ead340610efbdc4aec3da238e476dafdf368c8ac7fd47390820cd7c76"}
Sep 18 13:58:02.008983 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:02.008954    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"
Sep 18 13:58:02.094526 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:02.094485    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df08bcc6-d852-4c22-91a8-f5314b2e3610-maas-api-service-ca\") pod \"df08bcc6-d852-4c22-91a8-f5314b2e3610\" (UID: \"df08bcc6-d852-4c22-91a8-f5314b2e3610\") "
Sep 18 13:58:02.094889 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:02.094860    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df08bcc6-d852-4c22-91a8-f5314b2e3610-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "df08bcc6-d852-4c22-91a8-f5314b2e3610" (UID: "df08bcc6-d852-4c22-91a8-f5314b2e3610"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:58:02.196038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:02.195947    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df08bcc6-d852-4c22-91a8-f5314b2e3610-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:02.876378 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:02.876353    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"
Sep 18 13:58:02.876544 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:02.876397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb" event={"ID":"df08bcc6-d852-4c22-91a8-f5314b2e3610","Type":"ContainerDied","Data":"7288131412efc79872cd951e5caa1f4ef29de9deee0cd8f44a8f16f5b5c87885"}
Sep 18 13:58:02.876544 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:02.876451    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7288131412efc79872cd951e5caa1f4ef29de9deee0cd8f44a8f16f5b5c87885"
Sep 18 13:58:04.757114 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:04.757074    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"]
Sep 18 13:58:04.764937 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:04.764905    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-feff2644-rcwpb"]
Sep 18 13:58:05.860406 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:05.860375    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"]
Sep 18 13:58:05.860822 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:05.860586    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy" containerID="cri-o://07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7" gracePeriod=30
Sep 18 13:58:06.302265 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:06.302232    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df08bcc6-d852-4c22-91a8-f5314b2e3610" path="/var/lib/kubelet/pods/df08bcc6-d852-4c22-91a8-f5314b2e3610/volumes"
Sep 18 13:58:11.163623 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.163595    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:58:11.298566 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.298523    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-envoy\") pod \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") "
Sep 18 13:58:11.298767 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.298628    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-podinfo\") pod \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") "
Sep 18 13:58:11.298767 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.298699    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-token\") pod \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") "
Sep 18 13:58:11.298767 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.298733    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istiod-ca-cert\") pod \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") "
Sep 18 13:58:11.298942 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.298770    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48jn7\" (UniqueName: \"kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-kube-api-access-48jn7\") pod \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") "
Sep 18 13:58:11.298942 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.298806    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-data\") pod \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") "
Sep 18 13:58:11.298942 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.298837    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-socket\") pod \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") "
Sep 18 13:58:11.298942 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.298887    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-certs\") pod \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") "
Sep 18 13:58:11.299177 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.298943    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-credential-socket\") pod \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\" (UID: \"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0\") "
Sep 18 13:58:11.299263 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.299222    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" (UID: "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:58:11.299329 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.299255    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" (UID: "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:58:11.299329 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.299231    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" (UID: "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:58:11.299445 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.299418    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" (UID: "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:58:11.299502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.299439    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istiod-ca-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:11.299502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.299459    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-data\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:11.299502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.299461    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" (UID: "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:58:11.299502 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.299472    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:11.300976 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.300946    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" (UID: "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 13:58:11.301083 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.301000    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-kube-api-access-48jn7" (OuterVolumeSpecName: "kube-api-access-48jn7") pod "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" (UID: "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0"). InnerVolumeSpecName "kube-api-access-48jn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:58:11.301246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.301220    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" (UID: "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:58:11.301246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.301219    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" (UID: "3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:58:11.400365 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.400286    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-workload-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:11.400365 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.400312    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-credential-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:11.400365 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.400322    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-envoy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:11.400365 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.400331    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-podinfo\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:11.400365 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.400339    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-istio-token\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:11.400365 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.400351    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48jn7\" (UniqueName: \"kubernetes.io/projected/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0-kube-api-access-48jn7\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:11.931788 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.931754    2575 generic.go:356] "Generic (PLEG): container finished" podID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerID="07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7" exitCode=0
Sep 18 13:58:11.931978 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.931804    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"
Sep 18 13:58:11.931978 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.931838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" event={"ID":"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0","Type":"ContainerDied","Data":"07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7"}
Sep 18 13:58:11.931978 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.931893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z" event={"ID":"3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0","Type":"ContainerDied","Data":"665ff9b0e3942190b09274172d912d18823bb1d381e59b69c42493a2dec3f1e3"}
Sep 18 13:58:11.931978 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.931921    2575 scope.go:117] "RemoveContainer" containerID="07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7"
Sep 18 13:58:11.942702 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.942683    2575 scope.go:117] "RemoveContainer" containerID="5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591"
Sep 18 13:58:11.951572 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.951551    2575 scope.go:117] "RemoveContainer" containerID="07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7"
Sep 18 13:58:11.951912 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:58:11.951887    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7\": container with ID starting with 07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7 not found: ID does not exist" containerID="07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7"
Sep 18 13:58:11.951981 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.951926    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7"} err="failed to get container status \"07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7\": rpc error: code = NotFound desc = could not find container \"07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7\": container with ID starting with 07cc74d396293a96a73bfe081783ccf59f39136f2eee544d0fc460773f0314e7 not found: ID does not exist"
Sep 18 13:58:11.951981 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.951952    2575 scope.go:117] "RemoveContainer" containerID="5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591"
Sep 18 13:58:11.952278 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:58:11.952254    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591\": container with ID starting with 5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591 not found: ID does not exist" containerID="5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591"
Sep 18 13:58:11.952407 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.952278    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591"} err="failed to get container status \"5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591\": rpc error: code = NotFound desc = could not find container \"5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591\": container with ID starting with 5cd58fe295ae246435861cc6e6f83d49fc709b864e6b857a5765be786d27c591 not found: ID does not exist"
Sep 18 13:58:11.955943 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.955923    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"]
Sep 18 13:58:11.959644 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:11.959620    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z"]
Sep 18 13:58:12.295507 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.295479    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" path="/var/lib/kubelet/pods/3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0/volumes"
Sep 18 13:58:12.305618 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.305588    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"]
Sep 18 13:58:12.306092 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.306076    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy"
Sep 18 13:58:12.306178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.306093    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy"
Sep 18 13:58:12.306178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.306105    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df08bcc6-d852-4c22-91a8-f5314b2e3610" containerName="revoke-keys"
Sep 18 13:58:12.306178 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.306113    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="df08bcc6-d852-4c22-91a8-f5314b2e3610" containerName="revoke-keys"
Sep 18 13:58:12.306290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.306233    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy"
Sep 18 13:58:12.306290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.306247    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy"
Sep 18 13:58:12.306290 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.306256    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="df08bcc6-d852-4c22-91a8-f5314b2e3610" containerName="revoke-keys"
Sep 18 13:58:12.309452 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.309432    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.312594 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.312572    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-df2eb8\"/\"default-dockercfg-8npfn\""
Sep 18 13:58:12.312725 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.312686    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-df2eb8\"/\"kube-root-ca.crt\""
Sep 18 13:58:12.312725 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.312701    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-df2eb8\"/\"openshift-service-ca.crt\""
Sep 18 13:58:12.312817 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.312776    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-df2eb8\"/\"test-model-df2eb8-kserve-self-signed-certs\""
Sep 18 13:58:12.318298 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.318278    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"]
Sep 18 13:58:12.410950 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.410916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-tmp-dir\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.411160 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.411028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-home\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.411160 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.411065    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-dshm\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.411160 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.411105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-model-cache\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.411160 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.411158    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452e1c4a-5257-4b8b-992b-76cf694c4c53-tls-certs\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.411314 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.411222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdsr4\" (UniqueName: \"kubernetes.io/projected/452e1c4a-5257-4b8b-992b-76cf694c4c53-kube-api-access-tdsr4\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.512669 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.512635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-home\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.512669 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.512676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-dshm\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.512920 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.512716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-model-cache\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.512920 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.512738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452e1c4a-5257-4b8b-992b-76cf694c4c53-tls-certs\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.512920 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.512755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdsr4\" (UniqueName: \"kubernetes.io/projected/452e1c4a-5257-4b8b-992b-76cf694c4c53-kube-api-access-tdsr4\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.512920 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.512795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-tmp-dir\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.513164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.513052    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-home\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.513164 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.513106    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-model-cache\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.513256 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.513211    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-tmp-dir\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.515060 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.515027    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-dshm\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.515299 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.515281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452e1c4a-5257-4b8b-992b-76cf694c4c53-tls-certs\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.521863 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.521843    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdsr4\" (UniqueName: \"kubernetes.io/projected/452e1c4a-5257-4b8b-992b-76cf694c4c53-kube-api-access-tdsr4\") pod \"test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") " pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.620111 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.620031    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:12.900775 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.900693    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"]
Sep 18 13:58:12.904016 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:58:12.903989    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod452e1c4a_5257_4b8b_992b_76cf694c4c53.slice/crio-1875e82b09c0639b3aa37a65785a32a3c02a500affcae19d3545fceae6777b63 WatchSource:0}: Error finding container 1875e82b09c0639b3aa37a65785a32a3c02a500affcae19d3545fceae6777b63: Status 404 returned error can't find the container with id 1875e82b09c0639b3aa37a65785a32a3c02a500affcae19d3545fceae6777b63
Sep 18 13:58:12.943705 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:12.943667    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv" event={"ID":"452e1c4a-5257-4b8b-992b-76cf694c4c53","Type":"ContainerStarted","Data":"1875e82b09c0639b3aa37a65785a32a3c02a500affcae19d3545fceae6777b63"}
Sep 18 13:58:13.952684 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:13.952647    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv" event={"ID":"452e1c4a-5257-4b8b-992b-76cf694c4c53","Type":"ContainerStarted","Data":"148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585"}
Sep 18 13:58:13.976661 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:13.976594    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv" podStartSLOduration=1.976571939 podStartE2EDuration="1.976571939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:13.974947201 +0000 UTC m=+819.810785931" watchObservedRunningTime="2026-09-18 13:58:13.976571939 +0000 UTC m=+819.812410652"
Sep 18 13:58:14.121982 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.121942    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"]
Sep 18 13:58:14.122672 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.122643    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy"
Sep 18 13:58:14.122672 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.122669    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f4c4fd7-6b08-4d01-bc88-b5906e2f0cb0" containerName="istio-proxy"
Sep 18 13:58:14.124965 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.124945    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:14.125481 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.125459    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"]
Sep 18 13:58:14.127755 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.127732    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-df538fee\""
Sep 18 13:58:14.127865 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.127778    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-df538fee-dockercfg-pbwqt\""
Sep 18 13:58:14.127963 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.127946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:14.139885 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.139807    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"]
Sep 18 13:58:14.143117 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.143094    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"]
Sep 18 13:58:14.232154 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.231522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w\" (UID: \"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:14.232154 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.231689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffhvt\" (UniqueName: \"kubernetes.io/projected/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-kube-api-access-ffhvt\") pod \"payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w\" (UID: \"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:14.232154 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.231766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f04d127d-d831-46be-a9ce-3f7b97de5702-plugins-config-volume\") pod \"payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll\" (UID: \"f04d127d-d831-46be-a9ce-3f7b97de5702\") " pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:14.232154 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.231858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc5bk\" (UniqueName: \"kubernetes.io/projected/f04d127d-d831-46be-a9ce-3f7b97de5702-kube-api-access-xc5bk\") pod \"payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll\" (UID: \"f04d127d-d831-46be-a9ce-3f7b97de5702\") " pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:14.333305 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.333269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w\" (UID: \"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:14.333470 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.333380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffhvt\" (UniqueName: \"kubernetes.io/projected/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-kube-api-access-ffhvt\") pod \"payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w\" (UID: \"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:14.333470 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.333456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f04d127d-d831-46be-a9ce-3f7b97de5702-plugins-config-volume\") pod \"payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll\" (UID: \"f04d127d-d831-46be-a9ce-3f7b97de5702\") " pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:14.333605 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.333547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc5bk\" (UniqueName: \"kubernetes.io/projected/f04d127d-d831-46be-a9ce-3f7b97de5702-kube-api-access-xc5bk\") pod \"payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll\" (UID: \"f04d127d-d831-46be-a9ce-3f7b97de5702\") " pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:14.334072 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.334048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w\" (UID: \"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:14.334263 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.334237    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f04d127d-d831-46be-a9ce-3f7b97de5702-plugins-config-volume\") pod \"payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll\" (UID: \"f04d127d-d831-46be-a9ce-3f7b97de5702\") " pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:14.343749 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.343725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc5bk\" (UniqueName: \"kubernetes.io/projected/f04d127d-d831-46be-a9ce-3f7b97de5702-kube-api-access-xc5bk\") pod \"payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll\" (UID: \"f04d127d-d831-46be-a9ce-3f7b97de5702\") " pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:14.343883 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.343859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffhvt\" (UniqueName: \"kubernetes.io/projected/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-kube-api-access-ffhvt\") pod \"payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w\" (UID: \"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:14.441944 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.441902    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:14.447548 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.447522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:14.730204 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.729949    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"]
Sep 18 13:58:14.737353 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.735266    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"]
Sep 18 13:58:14.961900 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.961856    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w" event={"ID":"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad","Type":"ContainerStarted","Data":"18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67"}
Sep 18 13:58:14.962349 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.961927    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w" event={"ID":"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad","Type":"ContainerStarted","Data":"f0a090bd4a352a5fe61eb883534e9267ae95fca9016d4ddb774aa97ea718068c"}
Sep 18 13:58:14.962349 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.962185    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:14.963791 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.963761    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll" event={"ID":"f04d127d-d831-46be-a9ce-3f7b97de5702","Type":"ContainerStarted","Data":"e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0"}
Sep 18 13:58:14.963948 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.963812    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll" event={"ID":"f04d127d-d831-46be-a9ce-3f7b97de5702","Type":"ContainerStarted","Data":"7a5bfd8ae52c7c43837cb471ddf5fbc3aab1416544f6bd2b73f740c6b06fc2c6"}
Sep 18 13:58:14.964169 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.964116    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:14.979381 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.979330    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w" podStartSLOduration=0.979313678 podStartE2EDuration="979.313678ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:14.978665807 +0000 UTC m=+820.814504520" watchObservedRunningTime="2026-09-18 13:58:14.979313678 +0000 UTC m=+820.815152392"
Sep 18 13:58:14.997196 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:14.997127    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll" podStartSLOduration=0.99710782 podStartE2EDuration="997.10782ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:14.995332946 +0000 UTC m=+820.831171662" watchObservedRunningTime="2026-09-18 13:58:14.99710782 +0000 UTC m=+820.832946535"
Sep 18 13:58:22.620203 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:22.620167    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:22.620669 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:22.620230    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:22.632916 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:22.632885    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:23.024097 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:23.024007    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 13:58:25.973018 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:25.972981    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:26.977899 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:26.977869    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:29.260038 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:29.259993    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"]
Sep 18 13:58:29.264066 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:29.264039    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"
Sep 18 13:58:29.266829 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:29.266806    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 13:58:29.273780 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:29.273754    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"]
Sep 18 13:58:29.396506 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:29.396460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47f844d1-b4b1-4054-bdf9-19cfd45f7851-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df538fee-w8n8r\" (UID: \"47f844d1-b4b1-4054-bdf9-19cfd45f7851\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"
Sep 18 13:58:29.497628 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:29.497586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47f844d1-b4b1-4054-bdf9-19cfd45f7851-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df538fee-w8n8r\" (UID: \"47f844d1-b4b1-4054-bdf9-19cfd45f7851\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"
Sep 18 13:58:29.498250 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:29.498226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47f844d1-b4b1-4054-bdf9-19cfd45f7851-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df538fee-w8n8r\" (UID: \"47f844d1-b4b1-4054-bdf9-19cfd45f7851\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"
Sep 18 13:58:29.577413 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:29.577373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"
Sep 18 13:58:29.858415 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:29.858382    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"]
Sep 18 13:58:29.861730 ip-10-0-136-76 kubenswrapper[2575]: W0918 13:58:29.861701    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f844d1_b4b1_4054_bdf9_19cfd45f7851.slice/crio-e807221b445f5ac1ae72628e3085e4c4513abfd82533e6b3fbeee232b61dcd72 WatchSource:0}: Error finding container e807221b445f5ac1ae72628e3085e4c4513abfd82533e6b3fbeee232b61dcd72: Status 404 returned error can't find the container with id e807221b445f5ac1ae72628e3085e4c4513abfd82533e6b3fbeee232b61dcd72
Sep 18 13:58:30.061194 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:30.061153    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r" event={"ID":"47f844d1-b4b1-4054-bdf9-19cfd45f7851","Type":"ContainerStarted","Data":"e807221b445f5ac1ae72628e3085e4c4513abfd82533e6b3fbeee232b61dcd72"}
Sep 18 13:58:31.068838 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:31.068802    2575 generic.go:356] "Generic (PLEG): container finished" podID="47f844d1-b4b1-4054-bdf9-19cfd45f7851" containerID="30921d6212b53f3b71ed1433f98a0ecc6416825ec0dcd997e0831f1c363c5b5e" exitCode=0
Sep 18 13:58:31.069246 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:31.068884    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r" event={"ID":"47f844d1-b4b1-4054-bdf9-19cfd45f7851","Type":"ContainerDied","Data":"30921d6212b53f3b71ed1433f98a0ecc6416825ec0dcd997e0831f1c363c5b5e"}
Sep 18 13:58:32.215869 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:32.215842    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"
Sep 18 13:58:32.328440 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:32.328357    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47f844d1-b4b1-4054-bdf9-19cfd45f7851-maas-api-service-ca\") pod \"47f844d1-b4b1-4054-bdf9-19cfd45f7851\" (UID: \"47f844d1-b4b1-4054-bdf9-19cfd45f7851\") "
Sep 18 13:58:32.328699 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:32.328677    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f844d1-b4b1-4054-bdf9-19cfd45f7851-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "47f844d1-b4b1-4054-bdf9-19cfd45f7851" (UID: "47f844d1-b4b1-4054-bdf9-19cfd45f7851"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:58:32.328815 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:32.328803    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47f844d1-b4b1-4054-bdf9-19cfd45f7851-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:33.082025 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:33.081989    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r" event={"ID":"47f844d1-b4b1-4054-bdf9-19cfd45f7851","Type":"ContainerDied","Data":"e807221b445f5ac1ae72628e3085e4c4513abfd82533e6b3fbeee232b61dcd72"}
Sep 18 13:58:33.082216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:33.082035    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"
Sep 18 13:58:33.082216 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:33.082039    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e807221b445f5ac1ae72628e3085e4c4513abfd82533e6b3fbeee232b61dcd72"
Sep 18 13:58:41.733334 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:41.733298    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"]
Sep 18 13:58:41.733913 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:41.733512    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll" podUID="f04d127d-d831-46be-a9ce-3f7b97de5702" containerName="payload-processing" containerID="cri-o://e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0" gracePeriod=30
Sep 18 13:58:41.744526 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:41.744455    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"]
Sep 18 13:58:41.745219 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:41.744951    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w" podUID="4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad" containerName="payload-pre-processing" containerID="cri-o://18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67" gracePeriod=30
Sep 18 13:58:41.982436 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:41.982370    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"]
Sep 18 13:58:41.984683 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:41.984609    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df538fee-w8n8r"]
Sep 18 13:58:42.018183 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.018154    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:42.078545 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.078521    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:42.136503 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.136476    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f04d127d-d831-46be-a9ce-3f7b97de5702-plugins-config-volume\") pod \"f04d127d-d831-46be-a9ce-3f7b97de5702\" (UID: \"f04d127d-d831-46be-a9ce-3f7b97de5702\") "
Sep 18 13:58:42.136693 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.136550    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc5bk\" (UniqueName: \"kubernetes.io/projected/f04d127d-d831-46be-a9ce-3f7b97de5702-kube-api-access-xc5bk\") pod \"f04d127d-d831-46be-a9ce-3f7b97de5702\" (UID: \"f04d127d-d831-46be-a9ce-3f7b97de5702\") "
Sep 18 13:58:42.136990 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.136966    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f04d127d-d831-46be-a9ce-3f7b97de5702-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f04d127d-d831-46be-a9ce-3f7b97de5702" (UID: "f04d127d-d831-46be-a9ce-3f7b97de5702"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:58:42.137110 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.137092    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f04d127d-d831-46be-a9ce-3f7b97de5702-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:42.139201 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.139170    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f04d127d-d831-46be-a9ce-3f7b97de5702-kube-api-access-xc5bk" (OuterVolumeSpecName: "kube-api-access-xc5bk") pod "f04d127d-d831-46be-a9ce-3f7b97de5702" (UID: "f04d127d-d831-46be-a9ce-3f7b97de5702"). InnerVolumeSpecName "kube-api-access-xc5bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:58:42.142440 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.142414    2575 generic.go:356] "Generic (PLEG): container finished" podID="4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad" containerID="18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67" exitCode=0
Sep 18 13:58:42.142549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.142491    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"
Sep 18 13:58:42.142549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.142498    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w" event={"ID":"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad","Type":"ContainerDied","Data":"18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67"}
Sep 18 13:58:42.142549 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.142545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w" event={"ID":"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad","Type":"ContainerDied","Data":"f0a090bd4a352a5fe61eb883534e9267ae95fca9016d4ddb774aa97ea718068c"}
Sep 18 13:58:42.142697 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.142571    2575 scope.go:117] "RemoveContainer" containerID="18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67"
Sep 18 13:58:42.144111 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.144087    2575 generic.go:356] "Generic (PLEG): container finished" podID="f04d127d-d831-46be-a9ce-3f7b97de5702" containerID="e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0" exitCode=0
Sep 18 13:58:42.144310 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.144157    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"
Sep 18 13:58:42.144310 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.144161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll" event={"ID":"f04d127d-d831-46be-a9ce-3f7b97de5702","Type":"ContainerDied","Data":"e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0"}
Sep 18 13:58:42.144310 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.144203    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll" event={"ID":"f04d127d-d831-46be-a9ce-3f7b97de5702","Type":"ContainerDied","Data":"7a5bfd8ae52c7c43837cb471ddf5fbc3aab1416544f6bd2b73f740c6b06fc2c6"}
Sep 18 13:58:42.153729 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.153703    2575 scope.go:117] "RemoveContainer" containerID="18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67"
Sep 18 13:58:42.154025 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:58:42.154001    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67\": container with ID starting with 18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67 not found: ID does not exist" containerID="18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67"
Sep 18 13:58:42.154095 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.154035    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67"} err="failed to get container status \"18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67\": rpc error: code = NotFound desc = could not find container \"18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67\": container with ID starting with 18e542f4371ec9c8ea50d7828003db33213fe77f5e0a81147ebc8b7f682b2a67 not found: ID does not exist"
Sep 18 13:58:42.154095 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.154053    2575 scope.go:117] "RemoveContainer" containerID="e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0"
Sep 18 13:58:42.162580 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.162566    2575 scope.go:117] "RemoveContainer" containerID="e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0"
Sep 18 13:58:42.162839 ip-10-0-136-76 kubenswrapper[2575]: E0918 13:58:42.162820    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0\": container with ID starting with e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0 not found: ID does not exist" containerID="e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0"
Sep 18 13:58:42.162885 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.162844    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0"} err="failed to get container status \"e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0\": rpc error: code = NotFound desc = could not find container \"e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0\": container with ID starting with e5092bcd3e1b3e323b55e4149fc3a12db6614af5b820ac69a4d26eea709c1de0 not found: ID does not exist"
Sep 18 13:58:42.179776 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.179748    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"]
Sep 18 13:58:42.192548 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.192526    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll"]
Sep 18 13:58:42.239039 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.238795    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-plugins-config-volume\") pod \"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad\" (UID: \"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad\") "
Sep 18 13:58:42.239039 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.238845    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffhvt\" (UniqueName: \"kubernetes.io/projected/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-kube-api-access-ffhvt\") pod \"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad\" (UID: \"4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad\") "
Sep 18 13:58:42.239393 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.239300    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad" (UID: "4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:58:42.239456 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.239405    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc5bk\" (UniqueName: \"kubernetes.io/projected/f04d127d-d831-46be-a9ce-3f7b97de5702-kube-api-access-xc5bk\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:42.239456 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.239428    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:42.241420 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.241395    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-kube-api-access-ffhvt" (OuterVolumeSpecName: "kube-api-access-ffhvt") pod "4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad" (UID: "4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad"). InnerVolumeSpecName "kube-api-access-ffhvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:58:42.294210 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.294178    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47f844d1-b4b1-4054-bdf9-19cfd45f7851" path="/var/lib/kubelet/pods/47f844d1-b4b1-4054-bdf9-19cfd45f7851/volumes"
Sep 18 13:58:42.294590 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.294576    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f04d127d-d831-46be-a9ce-3f7b97de5702" path="/var/lib/kubelet/pods/f04d127d-d831-46be-a9ce-3f7b97de5702/volumes"
Sep 18 13:58:42.340305 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.340278    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffhvt\" (UniqueName: \"kubernetes.io/projected/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad-kube-api-access-ffhvt\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 13:58:42.460646 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.460620    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"]
Sep 18 13:58:42.464066 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:42.464032    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w"]
Sep 18 13:58:44.294119 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:58:44.294083    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad" path="/var/lib/kubelet/pods/4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad/volumes"
Sep 18 13:59:36.278533 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:59:36.278450    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 13:59:36.279064 ip-10-0-136-76 kubenswrapper[2575]: I0918 13:59:36.278562    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 14:00:00.183307 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.183261    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd"]
Sep 18 14:00:00.184086 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.184065    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f04d127d-d831-46be-a9ce-3f7b97de5702" containerName="payload-processing"
Sep 18 14:00:00.184186 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.184089    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04d127d-d831-46be-a9ce-3f7b97de5702" containerName="payload-processing"
Sep 18 14:00:00.184186 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.184103    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f844d1-b4b1-4054-bdf9-19cfd45f7851" containerName="revoke-keys"
Sep 18 14:00:00.184186 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.184111    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f844d1-b4b1-4054-bdf9-19cfd45f7851" containerName="revoke-keys"
Sep 18 14:00:00.184186 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.184160    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad" containerName="payload-pre-processing"
Sep 18 14:00:00.184186 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.184170    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad" containerName="payload-pre-processing"
Sep 18 14:00:00.184363 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.184311    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f04d127d-d831-46be-a9ce-3f7b97de5702" containerName="payload-processing"
Sep 18 14:00:00.184363 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.184327    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="47f844d1-b4b1-4054-bdf9-19cfd45f7851" containerName="revoke-keys"
Sep 18 14:00:00.184363 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.184339    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb12d8f-76a0-4ef1-8929-ab2145ceb2ad" containerName="payload-pre-processing"
Sep 18 14:00:00.187667 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.187648    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb"]
Sep 18 14:00:00.187790 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.187770    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd"
Sep 18 14:00:00.191298 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.191278    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb"
Sep 18 14:00:00.193312 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.193291    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:00:00.195707 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.195374    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq"]
Sep 18 14:00:00.198971 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.198953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq"
Sep 18 14:00:00.199647 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.199634    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd"
Sep 18 14:00:00.208370 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.208350    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb"
Sep 18 14:00:00.225232 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.225185    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd"]
Sep 18 14:00:00.229185 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.229155    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb"]
Sep 18 14:00:00.235355 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.233241    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm"]
Sep 18 14:00:00.247417 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.247393    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq"
Sep 18 14:00:00.247619 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.247594    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm"
Sep 18 14:00:00.252256 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.250960    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq"]
Sep 18 14:00:00.258078 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.257825    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm"]
Sep 18 14:00:00.271165 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.271015    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm"
Sep 18 14:00:00.498765 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.498736    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd"]
Sep 18 14:00:00.500690 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:00:00.500658    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6c210b_ba2b_49e2_959c_487ef63c8d65.slice/crio-e20fd32abe7b3bd2a105fd31b4e9910ca6822e3e720858c54da4239adb783c44 WatchSource:0}: Error finding container e20fd32abe7b3bd2a105fd31b4e9910ca6822e3e720858c54da4239adb783c44: Status 404 returned error can't find the container with id e20fd32abe7b3bd2a105fd31b4e9910ca6822e3e720858c54da4239adb783c44
Sep 18 14:00:00.525531 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.525504    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb"]
Sep 18 14:00:00.536521 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:00:00.536483    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124b7dc7_61d6_435b_8e90_d74809c8721b.slice/crio-74a1c3ceceece39a128b8a0c0faae9f544a0abb794c65b0fac461c2064a6afc8 WatchSource:0}: Error finding container 74a1c3ceceece39a128b8a0c0faae9f544a0abb794c65b0fac461c2064a6afc8: Status 404 returned error can't find the container with id 74a1c3ceceece39a128b8a0c0faae9f544a0abb794c65b0fac461c2064a6afc8
Sep 18 14:00:00.573089 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.573061    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq"]
Sep 18 14:00:00.574484 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:00:00.574458    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b96b734_2da2_4728_884e_0d692816b397.slice/crio-bdc923ea13bba7a4f8349796487c5e8e53643bec91a429c1ad2be23c71f617c3 WatchSource:0}: Error finding container bdc923ea13bba7a4f8349796487c5e8e53643bec91a429c1ad2be23c71f617c3: Status 404 returned error can't find the container with id bdc923ea13bba7a4f8349796487c5e8e53643bec91a429c1ad2be23c71f617c3
Sep 18 14:00:00.602436 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.602405    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm"]
Sep 18 14:00:00.605362 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:00:00.605335    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63694ad_2832_4956_982e_8b8c52792bcc.slice/crio-288434302c34166b504db68854ccb2f3a2aed78e6136ef811f973d269ab9ec70 WatchSource:0}: Error finding container 288434302c34166b504db68854ccb2f3a2aed78e6136ef811f973d269ab9ec70: Status 404 returned error can't find the container with id 288434302c34166b504db68854ccb2f3a2aed78e6136ef811f973d269ab9ec70
Sep 18 14:00:00.630383 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.630350    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb" event={"ID":"124b7dc7-61d6-435b-8e90-d74809c8721b","Type":"ContainerStarted","Data":"74a1c3ceceece39a128b8a0c0faae9f544a0abb794c65b0fac461c2064a6afc8"}
Sep 18 14:00:00.631645 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.631620    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq" event={"ID":"3b96b734-2da2-4728-884e-0d692816b397","Type":"ContainerStarted","Data":"bdc923ea13bba7a4f8349796487c5e8e53643bec91a429c1ad2be23c71f617c3"}
Sep 18 14:00:00.632900 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.632880    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd" event={"ID":"cf6c210b-ba2b-49e2-959c-487ef63c8d65","Type":"ContainerStarted","Data":"e20fd32abe7b3bd2a105fd31b4e9910ca6822e3e720858c54da4239adb783c44"}
Sep 18 14:00:00.634027 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:00.634008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm" event={"ID":"e63694ad-2832-4956-982e-8b8c52792bcc","Type":"ContainerStarted","Data":"288434302c34166b504db68854ccb2f3a2aed78e6136ef811f973d269ab9ec70"}
Sep 18 14:00:01.645374 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:01.645326    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd" event={"ID":"cf6c210b-ba2b-49e2-959c-487ef63c8d65","Type":"ContainerStarted","Data":"ed3da92e70459d3239111df652d689945ec466cde2ce4bf225d9a29b481cba1c"}
Sep 18 14:00:01.647051 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:01.647022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm" event={"ID":"e63694ad-2832-4956-982e-8b8c52792bcc","Type":"ContainerStarted","Data":"622cb43ad75fc0bd877031903914a23df635dab11bbdcf65e5f1537b69902777"}
Sep 18 14:00:01.648606 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:01.648578    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb" event={"ID":"124b7dc7-61d6-435b-8e90-d74809c8721b","Type":"ContainerStarted","Data":"e33c2a1445b3a5b606b86093ef3b6fdc300927b82d68b8fbb85b49623e0ea81b"}
Sep 18 14:00:01.650172 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:01.650152    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq" event={"ID":"3b96b734-2da2-4728-884e-0d692816b397","Type":"ContainerStarted","Data":"ed0e51a3eb00757f6895d4aea57c53b5d2a1a0a606bae4a7e55fc1d5bd6ae5b1"}
Sep 18 14:00:01.661761 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:01.661709    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd" podStartSLOduration=1.66169281 podStartE2EDuration="1.66169281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:01.660407533 +0000 UTC m=+927.496246248" watchObservedRunningTime="2026-09-18 14:00:01.66169281 +0000 UTC m=+927.497531524"
Sep 18 14:00:01.677098 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:01.677043    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb" podStartSLOduration=1.6770303659999999 podStartE2EDuration="1.677030366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:01.676411878 +0000 UTC m=+927.512250592" watchObservedRunningTime="2026-09-18 14:00:01.677030366 +0000 UTC m=+927.512869079"
Sep 18 14:00:01.693293 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:01.693238    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq" podStartSLOduration=1.6932220550000001 podStartE2EDuration="1.693222055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:01.6906275 +0000 UTC m=+927.526466205" watchObservedRunningTime="2026-09-18 14:00:01.693222055 +0000 UTC m=+927.529060767"
Sep 18 14:00:01.706910 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:01.706853    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm" podStartSLOduration=1.7068373879999998 podStartE2EDuration="1.706837388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:01.705167841 +0000 UTC m=+927.541006554" watchObservedRunningTime="2026-09-18 14:00:01.706837388 +0000 UTC m=+927.542676098"
Sep 18 14:00:02.657764 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:02.657731    2575 generic.go:356] "Generic (PLEG): container finished" podID="cf6c210b-ba2b-49e2-959c-487ef63c8d65" containerID="ed3da92e70459d3239111df652d689945ec466cde2ce4bf225d9a29b481cba1c" exitCode=0
Sep 18 14:00:02.658234 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:02.657814    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd" event={"ID":"cf6c210b-ba2b-49e2-959c-487ef63c8d65","Type":"ContainerDied","Data":"ed3da92e70459d3239111df652d689945ec466cde2ce4bf225d9a29b481cba1c"}
Sep 18 14:00:02.659416 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:02.659393    2575 generic.go:356] "Generic (PLEG): container finished" podID="e63694ad-2832-4956-982e-8b8c52792bcc" containerID="622cb43ad75fc0bd877031903914a23df635dab11bbdcf65e5f1537b69902777" exitCode=0
Sep 18 14:00:02.659535 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:02.659470    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm" event={"ID":"e63694ad-2832-4956-982e-8b8c52792bcc","Type":"ContainerDied","Data":"622cb43ad75fc0bd877031903914a23df635dab11bbdcf65e5f1537b69902777"}
Sep 18 14:00:02.660948 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:02.660928    2575 generic.go:356] "Generic (PLEG): container finished" podID="124b7dc7-61d6-435b-8e90-d74809c8721b" containerID="e33c2a1445b3a5b606b86093ef3b6fdc300927b82d68b8fbb85b49623e0ea81b" exitCode=0
Sep 18 14:00:02.661067 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:02.660998    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb" event={"ID":"124b7dc7-61d6-435b-8e90-d74809c8721b","Type":"ContainerDied","Data":"e33c2a1445b3a5b606b86093ef3b6fdc300927b82d68b8fbb85b49623e0ea81b"}
Sep 18 14:00:02.662471 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:02.662451    2575 generic.go:356] "Generic (PLEG): container finished" podID="3b96b734-2da2-4728-884e-0d692816b397" containerID="ed0e51a3eb00757f6895d4aea57c53b5d2a1a0a606bae4a7e55fc1d5bd6ae5b1" exitCode=0
Sep 18 14:00:02.662536 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:02.662500    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq" event={"ID":"3b96b734-2da2-4728-884e-0d692816b397","Type":"ContainerDied","Data":"ed0e51a3eb00757f6895d4aea57c53b5d2a1a0a606bae4a7e55fc1d5bd6ae5b1"}
Sep 18 14:00:03.817219 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:03.817119    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb"
Sep 18 14:00:03.871504 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:03.871478    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq"
Sep 18 14:00:03.908813 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:03.908576    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd"
Sep 18 14:00:03.916381 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:03.916355    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm"
Sep 18 14:00:04.675319 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.675233    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd"
Sep 18 14:00:04.675319 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.675232    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd" event={"ID":"cf6c210b-ba2b-49e2-959c-487ef63c8d65","Type":"ContainerDied","Data":"e20fd32abe7b3bd2a105fd31b4e9910ca6822e3e720858c54da4239adb783c44"}
Sep 18 14:00:04.675519 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.675356    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e20fd32abe7b3bd2a105fd31b4e9910ca6822e3e720858c54da4239adb783c44"
Sep 18 14:00:04.676737 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.676713    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm"
Sep 18 14:00:04.676871 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.676727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm" event={"ID":"e63694ad-2832-4956-982e-8b8c52792bcc","Type":"ContainerDied","Data":"288434302c34166b504db68854ccb2f3a2aed78e6136ef811f973d269ab9ec70"}
Sep 18 14:00:04.676871 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.676773    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="288434302c34166b504db68854ccb2f3a2aed78e6136ef811f973d269ab9ec70"
Sep 18 14:00:04.678187 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.678166    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb" event={"ID":"124b7dc7-61d6-435b-8e90-d74809c8721b","Type":"ContainerDied","Data":"74a1c3ceceece39a128b8a0c0faae9f544a0abb794c65b0fac461c2064a6afc8"}
Sep 18 14:00:04.678187 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.678183    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb"
Sep 18 14:00:04.678352 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.678202    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74a1c3ceceece39a128b8a0c0faae9f544a0abb794c65b0fac461c2064a6afc8"
Sep 18 14:00:04.679732 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.679706    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq" event={"ID":"3b96b734-2da2-4728-884e-0d692816b397","Type":"ContainerDied","Data":"bdc923ea13bba7a4f8349796487c5e8e53643bec91a429c1ad2be23c71f617c3"}
Sep 18 14:00:04.679732 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.679725    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-nzcvq"
Sep 18 14:00:04.679868 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:04.679752    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdc923ea13bba7a4f8349796487c5e8e53643bec91a429c1ad2be23c71f617c3"
Sep 18 14:00:32.955348 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955309    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"]
Sep 18 14:00:32.955854 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955840    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63694ad-2832-4956-982e-8b8c52792bcc" containerName="cleanup"
Sep 18 14:00:32.955900 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955855    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63694ad-2832-4956-982e-8b8c52792bcc" containerName="cleanup"
Sep 18 14:00:32.955900 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955866    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6c210b-ba2b-49e2-959c-487ef63c8d65" containerName="cleanup"
Sep 18 14:00:32.955900 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955871    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6c210b-ba2b-49e2-959c-487ef63c8d65" containerName="cleanup"
Sep 18 14:00:32.955900 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955878    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b96b734-2da2-4728-884e-0d692816b397" containerName="cleanup"
Sep 18 14:00:32.955900 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955884    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b96b734-2da2-4728-884e-0d692816b397" containerName="cleanup"
Sep 18 14:00:32.956056 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955904    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="124b7dc7-61d6-435b-8e90-d74809c8721b" containerName="cleanup"
Sep 18 14:00:32.956056 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955910    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="124b7dc7-61d6-435b-8e90-d74809c8721b" containerName="cleanup"
Sep 18 14:00:32.956056 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955977    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6c210b-ba2b-49e2-959c-487ef63c8d65" containerName="cleanup"
Sep 18 14:00:32.956056 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955986    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e63694ad-2832-4956-982e-8b8c52792bcc" containerName="cleanup"
Sep 18 14:00:32.956056 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.955993    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="124b7dc7-61d6-435b-8e90-d74809c8721b" containerName="cleanup"
Sep 18 14:00:32.956056 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.956002    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b96b734-2da2-4728-884e-0d692816b397" containerName="cleanup"
Sep 18 14:00:32.959526 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.959509    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:00:32.967703 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.967683    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f1bc6110\""
Sep 18 14:00:32.968849 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.968826    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f1bc6110-dockercfg-87tzt\""
Sep 18 14:00:32.977183 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.977156    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"]
Sep 18 14:00:32.980314 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.980291    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"]
Sep 18 14:00:32.984420 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.984398    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:00:32.995958 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:32.995929    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"]
Sep 18 14:00:33.032207 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.032167    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed7c9317-1ccf-45c5-ae27-80e53d530931-plugins-config-volume\") pod \"payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq\" (UID: \"ed7c9317-1ccf-45c5-ae27-80e53d530931\") " pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:00:33.032605 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.032249    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snck5\" (UniqueName: \"kubernetes.io/projected/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-kube-api-access-snck5\") pod \"payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz\" (UID: \"6c8e256a-4bf9-4be1-b807-7f7e2499cb31\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:00:33.032605 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.032329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz\" (UID: \"6c8e256a-4bf9-4be1-b807-7f7e2499cb31\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:00:33.032605 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.032384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp7sh\" (UniqueName: \"kubernetes.io/projected/ed7c9317-1ccf-45c5-ae27-80e53d530931-kube-api-access-zp7sh\") pod \"payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq\" (UID: \"ed7c9317-1ccf-45c5-ae27-80e53d530931\") " pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:00:33.133790 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.133751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz\" (UID: \"6c8e256a-4bf9-4be1-b807-7f7e2499cb31\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:00:33.133967 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.133805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp7sh\" (UniqueName: \"kubernetes.io/projected/ed7c9317-1ccf-45c5-ae27-80e53d530931-kube-api-access-zp7sh\") pod \"payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq\" (UID: \"ed7c9317-1ccf-45c5-ae27-80e53d530931\") " pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:00:33.133967 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.133875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed7c9317-1ccf-45c5-ae27-80e53d530931-plugins-config-volume\") pod \"payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq\" (UID: \"ed7c9317-1ccf-45c5-ae27-80e53d530931\") " pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:00:33.133967 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.133903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snck5\" (UniqueName: \"kubernetes.io/projected/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-kube-api-access-snck5\") pod \"payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz\" (UID: \"6c8e256a-4bf9-4be1-b807-7f7e2499cb31\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:00:33.134791 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.134756    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed7c9317-1ccf-45c5-ae27-80e53d530931-plugins-config-volume\") pod \"payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq\" (UID: \"ed7c9317-1ccf-45c5-ae27-80e53d530931\") " pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:00:33.134928 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.134756    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz\" (UID: \"6c8e256a-4bf9-4be1-b807-7f7e2499cb31\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:00:33.144347 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.144324    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp7sh\" (UniqueName: \"kubernetes.io/projected/ed7c9317-1ccf-45c5-ae27-80e53d530931-kube-api-access-zp7sh\") pod \"payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq\" (UID: \"ed7c9317-1ccf-45c5-ae27-80e53d530931\") " pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:00:33.144476 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.144324    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snck5\" (UniqueName: \"kubernetes.io/projected/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-kube-api-access-snck5\") pod \"payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz\" (UID: \"6c8e256a-4bf9-4be1-b807-7f7e2499cb31\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:00:33.271026 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.270937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:00:33.298156 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.298113    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:00:33.553821 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.553795    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"]
Sep 18 14:00:33.555248 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:00:33.555220    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7c9317_1ccf_45c5_ae27_80e53d530931.slice/crio-51b7b6c39c2574ffb46b4697148a6bd38370e53f52f1e571fcd29bfb45b9f675 WatchSource:0}: Error finding container 51b7b6c39c2574ffb46b4697148a6bd38370e53f52f1e571fcd29bfb45b9f675: Status 404 returned error can't find the container with id 51b7b6c39c2574ffb46b4697148a6bd38370e53f52f1e571fcd29bfb45b9f675
Sep 18 14:00:33.598845 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.598820    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"]
Sep 18 14:00:33.612301 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:00:33.612277    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8e256a_4bf9_4be1_b807_7f7e2499cb31.slice/crio-c8e92e0fe23274c3d1203a20a7a1fa4e6027c01853b776b43ef1f269a54a51da WatchSource:0}: Error finding container c8e92e0fe23274c3d1203a20a7a1fa4e6027c01853b776b43ef1f269a54a51da: Status 404 returned error can't find the container with id c8e92e0fe23274c3d1203a20a7a1fa4e6027c01853b776b43ef1f269a54a51da
Sep 18 14:00:33.865780 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.865677    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq" event={"ID":"ed7c9317-1ccf-45c5-ae27-80e53d530931","Type":"ContainerStarted","Data":"49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3"}
Sep 18 14:00:33.865780 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.865740    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq" event={"ID":"ed7c9317-1ccf-45c5-ae27-80e53d530931","Type":"ContainerStarted","Data":"51b7b6c39c2574ffb46b4697148a6bd38370e53f52f1e571fcd29bfb45b9f675"}
Sep 18 14:00:33.866002 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.865881    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:00:33.867642 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.867611    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz" event={"ID":"6c8e256a-4bf9-4be1-b807-7f7e2499cb31","Type":"ContainerStarted","Data":"351e5b4f656fd5c3ef0ac73278a53de2adfe706153b6e6d9d9420ddf387e54c8"}
Sep 18 14:00:33.867762 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.867661    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz" event={"ID":"6c8e256a-4bf9-4be1-b807-7f7e2499cb31","Type":"ContainerStarted","Data":"c8e92e0fe23274c3d1203a20a7a1fa4e6027c01853b776b43ef1f269a54a51da"}
Sep 18 14:00:33.867762 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.867690    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:00:33.885748 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.885701    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq" podStartSLOduration=1.885685343 podStartE2EDuration="1.885685343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:33.884299317 +0000 UTC m=+959.720138035" watchObservedRunningTime="2026-09-18 14:00:33.885685343 +0000 UTC m=+959.721524056"
Sep 18 14:00:33.904815 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:33.904762    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz" podStartSLOduration=1.904744101 podStartE2EDuration="1.904744101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:33.903348347 +0000 UTC m=+959.739187058" watchObservedRunningTime="2026-09-18 14:00:33.904744101 +0000 UTC m=+959.740582857"
Sep 18 14:00:44.876100 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:44.876064    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:00:44.876514 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:00:44.876296    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:01:05.277641 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:05.277603    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"]
Sep 18 14:01:05.281822 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:05.281805    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"
Sep 18 14:01:05.284657 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:05.284640    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:01:05.290517 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:05.290176    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"]
Sep 18 14:01:05.398788 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:05.398746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e793a374-38ba-4035-b6ad-45fd1f2e1f9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw\" (UID: \"e793a374-38ba-4035-b6ad-45fd1f2e1f9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"
Sep 18 14:01:05.500535 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:05.500496    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e793a374-38ba-4035-b6ad-45fd1f2e1f9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw\" (UID: \"e793a374-38ba-4035-b6ad-45fd1f2e1f9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"
Sep 18 14:01:05.501206 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:05.501184    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e793a374-38ba-4035-b6ad-45fd1f2e1f9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw\" (UID: \"e793a374-38ba-4035-b6ad-45fd1f2e1f9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"
Sep 18 14:01:05.593885 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:05.593856    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"
Sep 18 14:01:05.874668 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:05.874634    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"]
Sep 18 14:01:05.876440 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:01:05.876413    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode793a374_38ba_4035_b6ad_45fd1f2e1f9d.slice/crio-bb3530bf13b9a4547418198b8413336869e6257130a485c60f2008353ae54b79 WatchSource:0}: Error finding container bb3530bf13b9a4547418198b8413336869e6257130a485c60f2008353ae54b79: Status 404 returned error can't find the container with id bb3530bf13b9a4547418198b8413336869e6257130a485c60f2008353ae54b79
Sep 18 14:01:06.072063 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:06.072016    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw" event={"ID":"e793a374-38ba-4035-b6ad-45fd1f2e1f9d","Type":"ContainerStarted","Data":"bb3530bf13b9a4547418198b8413336869e6257130a485c60f2008353ae54b79"}
Sep 18 14:01:07.080245 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:07.080207    2575 generic.go:356] "Generic (PLEG): container finished" podID="e793a374-38ba-4035-b6ad-45fd1f2e1f9d" containerID="0663ade68f92609fc19a1a27763f60c40d35cde63c6978cf19aad84f9b98f910" exitCode=0
Sep 18 14:01:07.080668 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:07.080298    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw" event={"ID":"e793a374-38ba-4035-b6ad-45fd1f2e1f9d","Type":"ContainerDied","Data":"0663ade68f92609fc19a1a27763f60c40d35cde63c6978cf19aad84f9b98f910"}
Sep 18 14:01:08.239593 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.239567    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"
Sep 18 14:01:08.337799 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.337707    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e793a374-38ba-4035-b6ad-45fd1f2e1f9d-maas-api-service-ca\") pod \"e793a374-38ba-4035-b6ad-45fd1f2e1f9d\" (UID: \"e793a374-38ba-4035-b6ad-45fd1f2e1f9d\") "
Sep 18 14:01:08.338149 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.338103    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e793a374-38ba-4035-b6ad-45fd1f2e1f9d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e793a374-38ba-4035-b6ad-45fd1f2e1f9d" (UID: "e793a374-38ba-4035-b6ad-45fd1f2e1f9d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:01:08.439022 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.438979    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e793a374-38ba-4035-b6ad-45fd1f2e1f9d-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:01:08.803517 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.803481    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"]
Sep 18 14:01:08.804097 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.804078    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e793a374-38ba-4035-b6ad-45fd1f2e1f9d" containerName="revoke-keys"
Sep 18 14:01:08.804238 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.804099    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e793a374-38ba-4035-b6ad-45fd1f2e1f9d" containerName="revoke-keys"
Sep 18 14:01:08.804298 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.804253    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e793a374-38ba-4035-b6ad-45fd1f2e1f9d" containerName="revoke-keys"
Sep 18 14:01:08.808063 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.808041    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:08.811249 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.811225    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-377ca2\"/\"kube-root-ca.crt\""
Sep 18 14:01:08.811369 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.811261    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-377ca2\"/\"default-dockercfg-zzxlh\""
Sep 18 14:01:08.812222 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.812202    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-377ca2\"/\"openshift-service-ca.crt\""
Sep 18 14:01:08.812392 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.812371    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-377ca2\"/\"e2e-conflict-a-d79684ca-kserve-self-signed-certs\""
Sep 18 14:01:08.817967 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.817945    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"]
Sep 18 14:01:08.943910 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.943865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-home\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:08.944079 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.943918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tls-certs\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:08.944079 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.943965    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-model-cache\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:08.944079 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.944057    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-dshm\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:08.944256 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.944113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tmp-dir\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:08.944256 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:08.944156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwtqf\" (UniqueName: \"kubernetes.io/projected/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-kube-api-access-cwtqf\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.045188 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.045120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-dshm\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.045188 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.045191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tmp-dir\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.045420 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.045210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwtqf\" (UniqueName: \"kubernetes.io/projected/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-kube-api-access-cwtqf\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.045420 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.045356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-home\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.045420 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.045385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tls-certs\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.045420 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.045410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-model-cache\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.045637 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.045581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tmp-dir\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.045764 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.045743    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-home\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.045843 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.045774    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-model-cache\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.047604 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.047577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-dshm\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.047966 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.047939    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tls-certs\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.054646 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.054590    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwtqf\" (UniqueName: \"kubernetes.io/projected/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-kube-api-access-cwtqf\") pod \"e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") " pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.093544 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.093519    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"
Sep 18 14:01:09.093717 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.093554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw" event={"ID":"e793a374-38ba-4035-b6ad-45fd1f2e1f9d","Type":"ContainerDied","Data":"bb3530bf13b9a4547418198b8413336869e6257130a485c60f2008353ae54b79"}
Sep 18 14:01:09.093717 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.093605    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb3530bf13b9a4547418198b8413336869e6257130a485c60f2008353ae54b79"
Sep 18 14:01:09.118380 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.118348    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:09.405796 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:09.405761    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"]
Sep 18 14:01:09.410298 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:01:09.410262    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbabc8bc3_f3d4_42e3_aee5_bbbbbf70e7f6.slice/crio-f5310f0b58ed90ea3cdde4e62283b7ccf73f4cd73b427d068b8789d3d435309c WatchSource:0}: Error finding container f5310f0b58ed90ea3cdde4e62283b7ccf73f4cd73b427d068b8789d3d435309c: Status 404 returned error can't find the container with id f5310f0b58ed90ea3cdde4e62283b7ccf73f4cd73b427d068b8789d3d435309c
Sep 18 14:01:10.102326 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:10.102292    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx" event={"ID":"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6","Type":"ContainerStarted","Data":"dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d"}
Sep 18 14:01:10.102496 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:10.102335    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx" event={"ID":"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6","Type":"ContainerStarted","Data":"f5310f0b58ed90ea3cdde4e62283b7ccf73f4cd73b427d068b8789d3d435309c"}
Sep 18 14:01:10.129244 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:10.129192    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx" podStartSLOduration=2.129176107 podStartE2EDuration="2.129176107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:01:10.127117804 +0000 UTC m=+995.962956517" watchObservedRunningTime="2026-09-18 14:01:10.129176107 +0000 UTC m=+995.965014820"
Sep 18 14:01:15.854014 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:15.853977    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"]
Sep 18 14:01:15.854534 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:15.854247    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq" podUID="ed7c9317-1ccf-45c5-ae27-80e53d530931" containerName="payload-processing" containerID="cri-o://49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3" gracePeriod=30
Sep 18 14:01:15.862301 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:15.862031    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"]
Sep 18 14:01:15.862457 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:15.862397    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz" podUID="6c8e256a-4bf9-4be1-b807-7f7e2499cb31" containerName="payload-pre-processing" containerID="cri-o://351e5b4f656fd5c3ef0ac73278a53de2adfe706153b6e6d9d9420ddf387e54c8" gracePeriod=30
Sep 18 14:01:16.015073 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.015037    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"]
Sep 18 14:01:16.018670 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.018641    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f1bc6110-x5rbw"]
Sep 18 14:01:16.120348 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.120279    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:01:16.127679 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.127656    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp7sh\" (UniqueName: \"kubernetes.io/projected/ed7c9317-1ccf-45c5-ae27-80e53d530931-kube-api-access-zp7sh\") pod \"ed7c9317-1ccf-45c5-ae27-80e53d530931\" (UID: \"ed7c9317-1ccf-45c5-ae27-80e53d530931\") "
Sep 18 14:01:16.127807 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.127707    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed7c9317-1ccf-45c5-ae27-80e53d530931-plugins-config-volume\") pod \"ed7c9317-1ccf-45c5-ae27-80e53d530931\" (UID: \"ed7c9317-1ccf-45c5-ae27-80e53d530931\") "
Sep 18 14:01:16.128082 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.128061    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed7c9317-1ccf-45c5-ae27-80e53d530931-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed7c9317-1ccf-45c5-ae27-80e53d530931" (UID: "ed7c9317-1ccf-45c5-ae27-80e53d530931"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:01:16.129881 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.129852    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed7c9317-1ccf-45c5-ae27-80e53d530931-kube-api-access-zp7sh" (OuterVolumeSpecName: "kube-api-access-zp7sh") pod "ed7c9317-1ccf-45c5-ae27-80e53d530931" (UID: "ed7c9317-1ccf-45c5-ae27-80e53d530931"). InnerVolumeSpecName "kube-api-access-zp7sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:01:16.147436 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.147400    2575 generic.go:356] "Generic (PLEG): container finished" podID="6c8e256a-4bf9-4be1-b807-7f7e2499cb31" containerID="351e5b4f656fd5c3ef0ac73278a53de2adfe706153b6e6d9d9420ddf387e54c8" exitCode=0
Sep 18 14:01:16.147580 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.147469    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz" event={"ID":"6c8e256a-4bf9-4be1-b807-7f7e2499cb31","Type":"ContainerDied","Data":"351e5b4f656fd5c3ef0ac73278a53de2adfe706153b6e6d9d9420ddf387e54c8"}
Sep 18 14:01:16.148939 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.148911    2575 generic.go:356] "Generic (PLEG): container finished" podID="ed7c9317-1ccf-45c5-ae27-80e53d530931" containerID="49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3" exitCode=0
Sep 18 14:01:16.149055 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.148953    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"
Sep 18 14:01:16.149055 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.148986    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq" event={"ID":"ed7c9317-1ccf-45c5-ae27-80e53d530931","Type":"ContainerDied","Data":"49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3"}
Sep 18 14:01:16.149055 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.149033    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq" event={"ID":"ed7c9317-1ccf-45c5-ae27-80e53d530931","Type":"ContainerDied","Data":"51b7b6c39c2574ffb46b4697148a6bd38370e53f52f1e571fcd29bfb45b9f675"}
Sep 18 14:01:16.149055 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.149056    2575 scope.go:117] "RemoveContainer" containerID="49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3"
Sep 18 14:01:16.150836 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.150814    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:01:16.160574 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.160557    2575 scope.go:117] "RemoveContainer" containerID="49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3"
Sep 18 14:01:16.160899 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:01:16.160879    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3\": container with ID starting with 49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3 not found: ID does not exist" containerID="49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3"
Sep 18 14:01:16.160963 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.160907    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3"} err="failed to get container status \"49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3\": rpc error: code = NotFound desc = could not find container \"49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3\": container with ID starting with 49711bfa37a218b7eab97dba0db7e25c525d267e9a0851fe0c432a7288a943a3 not found: ID does not exist"
Sep 18 14:01:16.190629 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.190594    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"]
Sep 18 14:01:16.195178 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.195150    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq"]
Sep 18 14:01:16.228825 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.228795    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-plugins-config-volume\") pod \"6c8e256a-4bf9-4be1-b807-7f7e2499cb31\" (UID: \"6c8e256a-4bf9-4be1-b807-7f7e2499cb31\") "
Sep 18 14:01:16.229007 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.228841    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snck5\" (UniqueName: \"kubernetes.io/projected/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-kube-api-access-snck5\") pod \"6c8e256a-4bf9-4be1-b807-7f7e2499cb31\" (UID: \"6c8e256a-4bf9-4be1-b807-7f7e2499cb31\") "
Sep 18 14:01:16.229167 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.229126    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp7sh\" (UniqueName: \"kubernetes.io/projected/ed7c9317-1ccf-45c5-ae27-80e53d530931-kube-api-access-zp7sh\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:01:16.229235 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.229168    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed7c9317-1ccf-45c5-ae27-80e53d530931-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:01:16.229235 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.229222    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6c8e256a-4bf9-4be1-b807-7f7e2499cb31" (UID: "6c8e256a-4bf9-4be1-b807-7f7e2499cb31"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:01:16.230899 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.230875    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-kube-api-access-snck5" (OuterVolumeSpecName: "kube-api-access-snck5") pod "6c8e256a-4bf9-4be1-b807-7f7e2499cb31" (UID: "6c8e256a-4bf9-4be1-b807-7f7e2499cb31"). InnerVolumeSpecName "kube-api-access-snck5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:01:16.301553 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.301521    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e793a374-38ba-4035-b6ad-45fd1f2e1f9d" path="/var/lib/kubelet/pods/e793a374-38ba-4035-b6ad-45fd1f2e1f9d/volumes"
Sep 18 14:01:16.301912 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.301898    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed7c9317-1ccf-45c5-ae27-80e53d530931" path="/var/lib/kubelet/pods/ed7c9317-1ccf-45c5-ae27-80e53d530931/volumes"
Sep 18 14:01:16.330054 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.330025    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:01:16.330054 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:16.330051    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snck5\" (UniqueName: \"kubernetes.io/projected/6c8e256a-4bf9-4be1-b807-7f7e2499cb31-kube-api-access-snck5\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:01:17.156804 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:17.156718    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"
Sep 18 14:01:17.156804 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:17.156740    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz" event={"ID":"6c8e256a-4bf9-4be1-b807-7f7e2499cb31","Type":"ContainerDied","Data":"c8e92e0fe23274c3d1203a20a7a1fa4e6027c01853b776b43ef1f269a54a51da"}
Sep 18 14:01:17.157338 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:17.156809    2575 scope.go:117] "RemoveContainer" containerID="351e5b4f656fd5c3ef0ac73278a53de2adfe706153b6e6d9d9420ddf387e54c8"
Sep 18 14:01:17.199470 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:17.199434    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"]
Sep 18 14:01:17.202674 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:17.202650    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz"]
Sep 18 14:01:18.293854 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:18.293821    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c8e256a-4bf9-4be1-b807-7f7e2499cb31" path="/var/lib/kubelet/pods/6c8e256a-4bf9-4be1-b807-7f7e2499cb31/volumes"
Sep 18 14:01:19.118701 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:19.118672    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:19.118993 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:19.118970    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:19.131683 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:19.131651    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:19.185049 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:19.185015    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:01:31.468080 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.468043    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"]
Sep 18 14:01:31.468615 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.468599    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8e256a-4bf9-4be1-b807-7f7e2499cb31" containerName="payload-pre-processing"
Sep 18 14:01:31.468662 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.468616    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8e256a-4bf9-4be1-b807-7f7e2499cb31" containerName="payload-pre-processing"
Sep 18 14:01:31.468662 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.468653    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed7c9317-1ccf-45c5-ae27-80e53d530931" containerName="payload-processing"
Sep 18 14:01:31.468662 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.468658    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed7c9317-1ccf-45c5-ae27-80e53d530931" containerName="payload-processing"
Sep 18 14:01:31.468756 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.468726    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed7c9317-1ccf-45c5-ae27-80e53d530931" containerName="payload-processing"
Sep 18 14:01:31.468756 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.468738    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c8e256a-4bf9-4be1-b807-7f7e2499cb31" containerName="payload-pre-processing"
Sep 18 14:01:31.472115 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.472100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"
Sep 18 14:01:31.475177 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.475155    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:01:31.480750 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.480724    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"]
Sep 18 14:01:31.606086 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.606050    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a88a577-7f00-4fe5-a449-f8371d324252-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr\" (UID: \"2a88a577-7f00-4fe5-a449-f8371d324252\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"
Sep 18 14:01:31.707220 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.707185    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a88a577-7f00-4fe5-a449-f8371d324252-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr\" (UID: \"2a88a577-7f00-4fe5-a449-f8371d324252\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"
Sep 18 14:01:31.707845 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.707822    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a88a577-7f00-4fe5-a449-f8371d324252-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr\" (UID: \"2a88a577-7f00-4fe5-a449-f8371d324252\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"
Sep 18 14:01:31.785096 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:31.785007    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"
Sep 18 14:01:32.071028 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:32.070994    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"]
Sep 18 14:01:32.072963 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:01:32.072932    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a88a577_7f00_4fe5_a449_f8371d324252.slice/crio-e2d32381c45b7e5b2a95c667c1c94eca62e511a4ad3d4173d8d118f41171233c WatchSource:0}: Error finding container e2d32381c45b7e5b2a95c667c1c94eca62e511a4ad3d4173d8d118f41171233c: Status 404 returned error can't find the container with id e2d32381c45b7e5b2a95c667c1c94eca62e511a4ad3d4173d8d118f41171233c
Sep 18 14:01:32.258964 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:32.258924    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr" event={"ID":"2a88a577-7f00-4fe5-a449-f8371d324252","Type":"ContainerStarted","Data":"e2d32381c45b7e5b2a95c667c1c94eca62e511a4ad3d4173d8d118f41171233c"}
Sep 18 14:01:32.899852 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:32.899815    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"]
Sep 18 14:01:32.903891 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:32.903869    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:32.906598 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:32.906574    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ed4c53\"/\"openshift-service-ca.crt\""
Sep 18 14:01:32.907755 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:32.907733    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ed4c53\"/\"default-dockercfg-ghc9c\""
Sep 18 14:01:32.907952 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:32.907920    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ed4c53\"/\"distinct-w0-ed4c53-kserve-self-signed-certs\""
Sep 18 14:01:32.908116 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:32.907989    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ed4c53\"/\"kube-root-ca.crt\""
Sep 18 14:01:32.912293 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:32.912269    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"]
Sep 18 14:01:33.030107 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.030016    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-home\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.030308 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.030119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tls-certs\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.030308 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.030200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tmp-dir\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.030308 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.030232    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvrrz\" (UniqueName: \"kubernetes.io/projected/776d4836-0ba5-4b02-8dbf-af5d30f94e06-kube-api-access-rvrrz\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.030446 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.030333    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-model-cache\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.030446 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.030394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-dshm\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.131030 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.130989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-home\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.131255 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.131068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tls-certs\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.131255 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.131108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tmp-dir\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.131255 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.131142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvrrz\" (UniqueName: \"kubernetes.io/projected/776d4836-0ba5-4b02-8dbf-af5d30f94e06-kube-api-access-rvrrz\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.131255 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.131200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-model-cache\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.131255 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.131223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-dshm\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.131545 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.131431    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-home\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.131545 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.131486    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tmp-dir\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.131545 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.131535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-model-cache\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.133441 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.133420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-dshm\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.133627 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.133610    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tls-certs\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.141531 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.141506    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvrrz\" (UniqueName: \"kubernetes.io/projected/776d4836-0ba5-4b02-8dbf-af5d30f94e06-kube-api-access-rvrrz\") pod \"distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") " pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.215547 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.215507    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:33.270327 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.270292    2575 generic.go:356] "Generic (PLEG): container finished" podID="2a88a577-7f00-4fe5-a449-f8371d324252" containerID="e2190411aa408aafd23b4b5626ece6c6c1cbc010b2e8f356dde8ac25e15b082b" exitCode=0
Sep 18 14:01:33.270496 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.270381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr" event={"ID":"2a88a577-7f00-4fe5-a449-f8371d324252","Type":"ContainerDied","Data":"e2190411aa408aafd23b4b5626ece6c6c1cbc010b2e8f356dde8ac25e15b082b"}
Sep 18 14:01:33.502762 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:33.502734    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"]
Sep 18 14:01:33.504225 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:01:33.504124    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod776d4836_0ba5_4b02_8dbf_af5d30f94e06.slice/crio-69ab8233f1315e81709ba32a6d06a1a3f8844583ec2c2690341320841db05412 WatchSource:0}: Error finding container 69ab8233f1315e81709ba32a6d06a1a3f8844583ec2c2690341320841db05412: Status 404 returned error can't find the container with id 69ab8233f1315e81709ba32a6d06a1a3f8844583ec2c2690341320841db05412
Sep 18 14:01:34.279191 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:34.279123    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv" event={"ID":"776d4836-0ba5-4b02-8dbf-af5d30f94e06","Type":"ContainerStarted","Data":"f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7"}
Sep 18 14:01:34.279577 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:34.279206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv" event={"ID":"776d4836-0ba5-4b02-8dbf-af5d30f94e06","Type":"ContainerStarted","Data":"69ab8233f1315e81709ba32a6d06a1a3f8844583ec2c2690341320841db05412"}
Sep 18 14:01:34.303439 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:34.303389    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv" podStartSLOduration=2.303370551 podStartE2EDuration="2.303370551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:01:34.300622762 +0000 UTC m=+1020.136461478" watchObservedRunningTime="2026-09-18 14:01:34.303370551 +0000 UTC m=+1020.139209377"
Sep 18 14:01:34.425558 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:34.425529    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"
Sep 18 14:01:34.548088 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:34.548051    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a88a577-7f00-4fe5-a449-f8371d324252-maas-api-service-ca\") pod \"2a88a577-7f00-4fe5-a449-f8371d324252\" (UID: \"2a88a577-7f00-4fe5-a449-f8371d324252\") "
Sep 18 14:01:34.548415 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:34.548393    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a88a577-7f00-4fe5-a449-f8371d324252-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2a88a577-7f00-4fe5-a449-f8371d324252" (UID: "2a88a577-7f00-4fe5-a449-f8371d324252"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:01:34.548611 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:34.548599    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a88a577-7f00-4fe5-a449-f8371d324252-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:01:35.286990 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:35.286960    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"
Sep 18 14:01:35.287428 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:35.287012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr" event={"ID":"2a88a577-7f00-4fe5-a449-f8371d324252","Type":"ContainerDied","Data":"e2d32381c45b7e5b2a95c667c1c94eca62e511a4ad3d4173d8d118f41171233c"}
Sep 18 14:01:35.287428 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:35.287062    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2d32381c45b7e5b2a95c667c1c94eca62e511a4ad3d4173d8d118f41171233c"
Sep 18 14:01:42.888432 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:42.888397    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm"]
Sep 18 14:01:42.892552 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:42.892523    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-0aac26-29829000-tjbtm"]
Sep 18 14:01:43.201234 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:43.201102    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"]
Sep 18 14:01:43.203642 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:43.203617    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0aac26-n5zdr"]
Sep 18 14:01:43.216006 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:43.215979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:43.216100 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:43.216025    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:43.228836 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:43.228811    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:43.351053 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:43.351023    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:01:44.293929 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:44.293896    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a88a577-7f00-4fe5-a449-f8371d324252" path="/var/lib/kubelet/pods/2a88a577-7f00-4fe5-a449-f8371d324252/volumes"
Sep 18 14:01:44.294317 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:44.294225    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e63694ad-2832-4956-982e-8b8c52792bcc" path="/var/lib/kubelet/pods/e63694ad-2832-4956-982e-8b8c52792bcc/volumes"
Sep 18 14:01:55.661843 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.661809    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"]
Sep 18 14:01:55.662348 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.662332    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a88a577-7f00-4fe5-a449-f8371d324252" containerName="revoke-keys"
Sep 18 14:01:55.662348 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.662348    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a88a577-7f00-4fe5-a449-f8371d324252" containerName="revoke-keys"
Sep 18 14:01:55.662467 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.662429    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a88a577-7f00-4fe5-a449-f8371d324252" containerName="revoke-keys"
Sep 18 14:01:55.665787 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.665763    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.672521 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.672491    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-ac71f8-openshift-default-dockercfg-v24jd\""
Sep 18 14:01:55.685234 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.685195    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"]
Sep 18 14:01:55.766496 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.766463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-certs\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.766655 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.766514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-data\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.766655 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.766586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-socket\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.766655 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.766646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-credential-socket\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.766760 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.766729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-envoy\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.766760 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.766744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-token\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.766826 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.766763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fldfm\" (UniqueName: \"kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-kube-api-access-fldfm\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.766826 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.766781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-podinfo\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.766826 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.766799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istiod-ca-cert\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.867638 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.867600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-envoy\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.867638 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.867638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-token\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.867932 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.867660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fldfm\" (UniqueName: \"kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-kube-api-access-fldfm\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.867932 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.867687    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-podinfo\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.867932 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.867713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istiod-ca-cert\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.867932 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.867744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-certs\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.867932 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.867795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-data\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.868233 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.868029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-socket\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.868233 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.868146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-credential-socket\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.868233 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.868176    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-certs\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.868233 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.868207    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-data\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.868512 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.868480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-socket\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.868637 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.868526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-credential-socket\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.868885 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.868861    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istiod-ca-cert\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.870339 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.870315    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-envoy\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.870501 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.870486    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-podinfo\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.880370 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.880350    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-token\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.881376 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.881360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fldfm\" (UniqueName: \"kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-kube-api-access-fldfm\") pod \"e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") " pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:55.981045 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:55.980949    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:56.271060 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:56.271026    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"]
Sep 18 14:01:56.272720 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:01:56.272697    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79f5b63_1b82_4f6c_a98c_bb439ed9ddd8.slice/crio-636a38878ae13bd09f3b30e902db69b86f93650ccc2e1b6379125d55571d4c33 WatchSource:0}: Error finding container 636a38878ae13bd09f3b30e902db69b86f93650ccc2e1b6379125d55571d4c33: Status 404 returned error can't find the container with id 636a38878ae13bd09f3b30e902db69b86f93650ccc2e1b6379125d55571d4c33
Sep 18 14:01:56.275115 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:56.275077    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:01:56.275197 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:56.275162    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:01:56.275197 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:56.275191    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:01:56.431288 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:56.431251    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h" event={"ID":"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8","Type":"ContainerStarted","Data":"1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318"}
Sep 18 14:01:56.431479 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:56.431308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h" event={"ID":"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8","Type":"ContainerStarted","Data":"636a38878ae13bd09f3b30e902db69b86f93650ccc2e1b6379125d55571d4c33"}
Sep 18 14:01:56.462417 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:56.462363    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h" podStartSLOduration=1.462346118 podStartE2EDuration="1.462346118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:01:56.460725086 +0000 UTC m=+1042.296563799" watchObservedRunningTime="2026-09-18 14:01:56.462346118 +0000 UTC m=+1042.298184890"
Sep 18 14:01:56.981235 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:56.981199    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:57.986650 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:57.986618    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:58.446248 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:58.446210    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:01:58.447322 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:01:58.447305    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:02:05.682288 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:05.682252    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"]
Sep 18 14:02:19.760245 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:19.760157    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"]
Sep 18 14:02:19.764208 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:19.764190    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:02:19.767374 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:19.767352    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-55bd4d\""
Sep 18 14:02:19.777169 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:19.777097    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"]
Sep 18 14:02:19.841475 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:19.841438    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls756\" (UniqueName: \"kubernetes.io/projected/88900b46-be4f-42bb-9f86-ce29436f45bf-kube-api-access-ls756\") pod \"payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn\" (UID: \"88900b46-be4f-42bb-9f86-ce29436f45bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:02:19.841651 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:19.841562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88900b46-be4f-42bb-9f86-ce29436f45bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn\" (UID: \"88900b46-be4f-42bb-9f86-ce29436f45bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:02:19.942337 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:19.942299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88900b46-be4f-42bb-9f86-ce29436f45bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn\" (UID: \"88900b46-be4f-42bb-9f86-ce29436f45bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:02:19.942520 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:19.942469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls756\" (UniqueName: \"kubernetes.io/projected/88900b46-be4f-42bb-9f86-ce29436f45bf-kube-api-access-ls756\") pod \"payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn\" (UID: \"88900b46-be4f-42bb-9f86-ce29436f45bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:02:19.943194 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:19.943172    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88900b46-be4f-42bb-9f86-ce29436f45bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn\" (UID: \"88900b46-be4f-42bb-9f86-ce29436f45bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:02:19.951073 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:19.951043    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls756\" (UniqueName: \"kubernetes.io/projected/88900b46-be4f-42bb-9f86-ce29436f45bf-kube-api-access-ls756\") pod \"payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn\" (UID: \"88900b46-be4f-42bb-9f86-ce29436f45bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:02:20.077813 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:20.077776    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:02:20.355293 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:20.355264    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"]
Sep 18 14:02:20.357331 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:02:20.357306    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88900b46_be4f_42bb_9f86_ce29436f45bf.slice/crio-8aa0a5051d55816432ad636a66e404ff972d1f1f9c6dcc2f5c7b322aaffd552f WatchSource:0}: Error finding container 8aa0a5051d55816432ad636a66e404ff972d1f1f9c6dcc2f5c7b322aaffd552f: Status 404 returned error can't find the container with id 8aa0a5051d55816432ad636a66e404ff972d1f1f9c6dcc2f5c7b322aaffd552f
Sep 18 14:02:20.590772 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:20.590724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn" event={"ID":"88900b46-be4f-42bb-9f86-ce29436f45bf","Type":"ContainerStarted","Data":"f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1"}
Sep 18 14:02:20.590975 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:20.590874    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:02:20.590975 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:20.590900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn" event={"ID":"88900b46-be4f-42bb-9f86-ce29436f45bf","Type":"ContainerStarted","Data":"8aa0a5051d55816432ad636a66e404ff972d1f1f9c6dcc2f5c7b322aaffd552f"}
Sep 18 14:02:20.609582 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:20.609486    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn" podStartSLOduration=1.609468229 podStartE2EDuration="1.609468229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:02:20.609023684 +0000 UTC m=+1066.444862398" watchObservedRunningTime="2026-09-18 14:02:20.609468229 +0000 UTC m=+1066.445306949"
Sep 18 14:02:20.701821 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:20.701772    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv" podUID="452e1c4a-5257-4b8b-992b-76cf694c4c53" containerName="main" containerID="cri-o://148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585" gracePeriod=45
Sep 18 14:02:20.953836 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:20.953807    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 14:02:21.061038 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061003    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-dshm\") pod \"452e1c4a-5257-4b8b-992b-76cf694c4c53\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") "
Sep 18 14:02:21.061232 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061052    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-tmp-dir\") pod \"452e1c4a-5257-4b8b-992b-76cf694c4c53\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") "
Sep 18 14:02:21.061232 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061080    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452e1c4a-5257-4b8b-992b-76cf694c4c53-tls-certs\") pod \"452e1c4a-5257-4b8b-992b-76cf694c4c53\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") "
Sep 18 14:02:21.061232 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061178    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdsr4\" (UniqueName: \"kubernetes.io/projected/452e1c4a-5257-4b8b-992b-76cf694c4c53-kube-api-access-tdsr4\") pod \"452e1c4a-5257-4b8b-992b-76cf694c4c53\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") "
Sep 18 14:02:21.061416 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061355    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-model-cache\") pod \"452e1c4a-5257-4b8b-992b-76cf694c4c53\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") "
Sep 18 14:02:21.061416 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061357    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "452e1c4a-5257-4b8b-992b-76cf694c4c53" (UID: "452e1c4a-5257-4b8b-992b-76cf694c4c53"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:02:21.061416 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061402    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-home\") pod \"452e1c4a-5257-4b8b-992b-76cf694c4c53\" (UID: \"452e1c4a-5257-4b8b-992b-76cf694c4c53\") "
Sep 18 14:02:21.061618 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061586    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-model-cache" (OuterVolumeSpecName: "model-cache") pod "452e1c4a-5257-4b8b-992b-76cf694c4c53" (UID: "452e1c4a-5257-4b8b-992b-76cf694c4c53"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:02:21.061755 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061713    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-home" (OuterVolumeSpecName: "home") pod "452e1c4a-5257-4b8b-992b-76cf694c4c53" (UID: "452e1c4a-5257-4b8b-992b-76cf694c4c53"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:02:21.061888 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061870    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-home\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:21.061944 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061892    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-tmp-dir\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:21.061944 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.061906    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-model-cache\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:21.063551 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.063522    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-dshm" (OuterVolumeSpecName: "dshm") pod "452e1c4a-5257-4b8b-992b-76cf694c4c53" (UID: "452e1c4a-5257-4b8b-992b-76cf694c4c53"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:02:21.063551 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.063537    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452e1c4a-5257-4b8b-992b-76cf694c4c53-kube-api-access-tdsr4" (OuterVolumeSpecName: "kube-api-access-tdsr4") pod "452e1c4a-5257-4b8b-992b-76cf694c4c53" (UID: "452e1c4a-5257-4b8b-992b-76cf694c4c53"). InnerVolumeSpecName "kube-api-access-tdsr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:02:21.063682 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.063573    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/452e1c4a-5257-4b8b-992b-76cf694c4c53-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "452e1c4a-5257-4b8b-992b-76cf694c4c53" (UID: "452e1c4a-5257-4b8b-992b-76cf694c4c53"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:02:21.162633 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.162554    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/452e1c4a-5257-4b8b-992b-76cf694c4c53-dshm\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:21.162633 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.162581    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452e1c4a-5257-4b8b-992b-76cf694c4c53-tls-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:21.162633 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.162595    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdsr4\" (UniqueName: \"kubernetes.io/projected/452e1c4a-5257-4b8b-992b-76cf694c4c53-kube-api-access-tdsr4\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:21.602113 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.602078    2575 generic.go:356] "Generic (PLEG): container finished" podID="452e1c4a-5257-4b8b-992b-76cf694c4c53" containerID="148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585" exitCode=0
Sep 18 14:02:21.602343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.602169    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"
Sep 18 14:02:21.602343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.602173    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv" event={"ID":"452e1c4a-5257-4b8b-992b-76cf694c4c53","Type":"ContainerDied","Data":"148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585"}
Sep 18 14:02:21.602343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.602219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv" event={"ID":"452e1c4a-5257-4b8b-992b-76cf694c4c53","Type":"ContainerDied","Data":"1875e82b09c0639b3aa37a65785a32a3c02a500affcae19d3545fceae6777b63"}
Sep 18 14:02:21.602343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.602237    2575 scope.go:117] "RemoveContainer" containerID="148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585"
Sep 18 14:02:21.612595 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.612574    2575 scope.go:117] "RemoveContainer" containerID="148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585"
Sep 18 14:02:21.612877 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:02:21.612855    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585\": container with ID starting with 148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585 not found: ID does not exist" containerID="148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585"
Sep 18 14:02:21.612947 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.612888    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585"} err="failed to get container status \"148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585\": rpc error: code = NotFound desc = could not find container \"148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585\": container with ID starting with 148cbec9a0579824fa4512ebbe085c5bef041d257210f6c1d313f72e23286585 not found: ID does not exist"
Sep 18 14:02:21.625570 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.625544    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"]
Sep 18 14:02:21.629186 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:21.629161    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-df2eb8/test-model-df2eb8-kserve-5fbcbbd6dc-qxmwv"]
Sep 18 14:02:22.293927 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:22.293895    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="452e1c4a-5257-4b8b-992b-76cf694c4c53" path="/var/lib/kubelet/pods/452e1c4a-5257-4b8b-992b-76cf694c4c53/volumes"
Sep 18 14:02:26.463995 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.463956    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"]
Sep 18 14:02:26.464518 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.464286    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl" podUID="bf3b6891-1ec0-49f7-8e5a-1981169b1349" containerName="payload-processing" containerID="cri-o://e0da727a09460dc0e3727d81aa1a8105f3ab637d94a0fab2402bb8936441585b" gracePeriod=30
Sep 18 14:02:26.474184 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.474106    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"]
Sep 18 14:02:26.474401 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.474372    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t" podUID="eb6177c5-9851-445c-a57d-4452f6aae807" containerName="payload-pre-processing" containerID="cri-o://cea0a4c960fca625a2918f933553a991e27b40c05cc9ea9dcbdb11265f4e409c" gracePeriod=30
Sep 18 14:02:26.651848 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.648890    2575 generic.go:356] "Generic (PLEG): container finished" podID="eb6177c5-9851-445c-a57d-4452f6aae807" containerID="cea0a4c960fca625a2918f933553a991e27b40c05cc9ea9dcbdb11265f4e409c" exitCode=0
Sep 18 14:02:26.651848 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.649027    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t" event={"ID":"eb6177c5-9851-445c-a57d-4452f6aae807","Type":"ContainerDied","Data":"cea0a4c960fca625a2918f933553a991e27b40c05cc9ea9dcbdb11265f4e409c"}
Sep 18 14:02:26.651848 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.651731    2575 generic.go:356] "Generic (PLEG): container finished" podID="bf3b6891-1ec0-49f7-8e5a-1981169b1349" containerID="e0da727a09460dc0e3727d81aa1a8105f3ab637d94a0fab2402bb8936441585b" exitCode=0
Sep 18 14:02:26.651848 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.651838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl" event={"ID":"bf3b6891-1ec0-49f7-8e5a-1981169b1349","Type":"ContainerDied","Data":"e0da727a09460dc0e3727d81aa1a8105f3ab637d94a0fab2402bb8936441585b"}
Sep 18 14:02:26.784262 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.784237    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 14:02:26.787243 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.787220    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 14:02:26.825367 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.825331    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb6177c5-9851-445c-a57d-4452f6aae807-plugins-config-volume\") pod \"eb6177c5-9851-445c-a57d-4452f6aae807\" (UID: \"eb6177c5-9851-445c-a57d-4452f6aae807\") "
Sep 18 14:02:26.825525 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.825446    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf3b6891-1ec0-49f7-8e5a-1981169b1349-plugins-config-volume\") pod \"bf3b6891-1ec0-49f7-8e5a-1981169b1349\" (UID: \"bf3b6891-1ec0-49f7-8e5a-1981169b1349\") "
Sep 18 14:02:26.825525 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.825480    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nv6b\" (UniqueName: \"kubernetes.io/projected/eb6177c5-9851-445c-a57d-4452f6aae807-kube-api-access-7nv6b\") pod \"eb6177c5-9851-445c-a57d-4452f6aae807\" (UID: \"eb6177c5-9851-445c-a57d-4452f6aae807\") "
Sep 18 14:02:26.825658 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.825627    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz6zr\" (UniqueName: \"kubernetes.io/projected/bf3b6891-1ec0-49f7-8e5a-1981169b1349-kube-api-access-mz6zr\") pod \"bf3b6891-1ec0-49f7-8e5a-1981169b1349\" (UID: \"bf3b6891-1ec0-49f7-8e5a-1981169b1349\") "
Sep 18 14:02:26.825812 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.825780    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb6177c5-9851-445c-a57d-4452f6aae807-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eb6177c5-9851-445c-a57d-4452f6aae807" (UID: "eb6177c5-9851-445c-a57d-4452f6aae807"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:02:26.825901 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.825844    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf3b6891-1ec0-49f7-8e5a-1981169b1349-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bf3b6891-1ec0-49f7-8e5a-1981169b1349" (UID: "bf3b6891-1ec0-49f7-8e5a-1981169b1349"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:02:26.826182 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.826155    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb6177c5-9851-445c-a57d-4452f6aae807-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:26.826182 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.826181    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf3b6891-1ec0-49f7-8e5a-1981169b1349-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:26.828063 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.828036    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf3b6891-1ec0-49f7-8e5a-1981169b1349-kube-api-access-mz6zr" (OuterVolumeSpecName: "kube-api-access-mz6zr") pod "bf3b6891-1ec0-49f7-8e5a-1981169b1349" (UID: "bf3b6891-1ec0-49f7-8e5a-1981169b1349"). InnerVolumeSpecName "kube-api-access-mz6zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:02:26.828268 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.828228    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb6177c5-9851-445c-a57d-4452f6aae807-kube-api-access-7nv6b" (OuterVolumeSpecName: "kube-api-access-7nv6b") pod "eb6177c5-9851-445c-a57d-4452f6aae807" (UID: "eb6177c5-9851-445c-a57d-4452f6aae807"). InnerVolumeSpecName "kube-api-access-7nv6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:02:26.926833 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.926794    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz6zr\" (UniqueName: \"kubernetes.io/projected/bf3b6891-1ec0-49f7-8e5a-1981169b1349-kube-api-access-mz6zr\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:26.926833 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:26.926827    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nv6b\" (UniqueName: \"kubernetes.io/projected/eb6177c5-9851-445c-a57d-4452f6aae807-kube-api-access-7nv6b\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:27.659365 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:27.659338    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"
Sep 18 14:02:27.659365 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:27.659357    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t" event={"ID":"eb6177c5-9851-445c-a57d-4452f6aae807","Type":"ContainerDied","Data":"0adfbe401a615a0c6a493e41731b394275a61902285b3079f9be4420ffd4f7eb"}
Sep 18 14:02:27.659892 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:27.659425    2575 scope.go:117] "RemoveContainer" containerID="cea0a4c960fca625a2918f933553a991e27b40c05cc9ea9dcbdb11265f4e409c"
Sep 18 14:02:27.660900 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:27.660885    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"
Sep 18 14:02:27.660983 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:27.660880    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl" event={"ID":"bf3b6891-1ec0-49f7-8e5a-1981169b1349","Type":"ContainerDied","Data":"4bae5465c951f0cfc9f31e72e28b9f127938c688af368789a1a5685643fb7b69"}
Sep 18 14:02:27.669915 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:27.669892    2575 scope.go:117] "RemoveContainer" containerID="e0da727a09460dc0e3727d81aa1a8105f3ab637d94a0fab2402bb8936441585b"
Sep 18 14:02:27.685226 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:27.685199    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"]
Sep 18 14:02:27.689288 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:27.689261    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t"]
Sep 18 14:02:27.700033 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:27.700009    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"]
Sep 18 14:02:27.708104 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:27.708076    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl"]
Sep 18 14:02:28.298243 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:28.298204    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf3b6891-1ec0-49f7-8e5a-1981169b1349" path="/var/lib/kubelet/pods/bf3b6891-1ec0-49f7-8e5a-1981169b1349/volumes"
Sep 18 14:02:28.298689 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:28.298670    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb6177c5-9851-445c-a57d-4452f6aae807" path="/var/lib/kubelet/pods/eb6177c5-9851-445c-a57d-4452f6aae807/volumes"
Sep 18 14:02:31.604988 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:31.604955    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:02:34.413246 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.413214    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"]
Sep 18 14:02:34.413672 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.413416    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy" containerID="cri-o://5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c" gracePeriod=30
Sep 18 14:02:34.732036 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.731952    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"]
Sep 18 14:02:34.732499 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.732486    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb6177c5-9851-445c-a57d-4452f6aae807" containerName="payload-pre-processing"
Sep 18 14:02:34.732563 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.732501    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb6177c5-9851-445c-a57d-4452f6aae807" containerName="payload-pre-processing"
Sep 18 14:02:34.732563 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.732511    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452e1c4a-5257-4b8b-992b-76cf694c4c53" containerName="main"
Sep 18 14:02:34.732563 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.732516    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="452e1c4a-5257-4b8b-992b-76cf694c4c53" containerName="main"
Sep 18 14:02:34.732563 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.732528    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3b6891-1ec0-49f7-8e5a-1981169b1349" containerName="payload-processing"
Sep 18 14:02:34.732563 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.732533    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3b6891-1ec0-49f7-8e5a-1981169b1349" containerName="payload-processing"
Sep 18 14:02:34.732717 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.732595    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb6177c5-9851-445c-a57d-4452f6aae807" containerName="payload-pre-processing"
Sep 18 14:02:34.732717 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.732602    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf3b6891-1ec0-49f7-8e5a-1981169b1349" containerName="payload-processing"
Sep 18 14:02:34.732717 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.732610    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="452e1c4a-5257-4b8b-992b-76cf694c4c53" containerName="main"
Sep 18 14:02:34.737256 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.737234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"
Sep 18 14:02:34.740781 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.740538    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:02:34.744391 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.744227    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"]
Sep 18 14:02:34.817560 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.817524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aaa0c46-572a-4ea7-b3df-db49d18de988-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl\" (UID: \"2aaa0c46-572a-4ea7-b3df-db49d18de988\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"
Sep 18 14:02:34.919621 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.919570    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aaa0c46-572a-4ea7-b3df-db49d18de988-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl\" (UID: \"2aaa0c46-572a-4ea7-b3df-db49d18de988\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"
Sep 18 14:02:34.920838 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:34.920754    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aaa0c46-572a-4ea7-b3df-db49d18de988-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl\" (UID: \"2aaa0c46-572a-4ea7-b3df-db49d18de988\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"
Sep 18 14:02:35.050662 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.050627    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"
Sep 18 14:02:35.333395 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.329238    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"]
Sep 18 14:02:35.685299 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.685265    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7624-39068a"]
Sep 18 14:02:35.689303 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.689267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-39068a"
Sep 18 14:02:35.692209 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.692187    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-knszx\""
Sep 18 14:02:35.696036 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.696013    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-39068a"]
Sep 18 14:02:35.716205 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.716174    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl" event={"ID":"2aaa0c46-572a-4ea7-b3df-db49d18de988","Type":"ContainerStarted","Data":"5a184298198da4944e198bf9c2c27f1c92fe3a93e39cb3d9a5ffa8d1213d29de"}
Sep 18 14:02:35.716334 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.716224    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl" event={"ID":"2aaa0c46-572a-4ea7-b3df-db49d18de988","Type":"ContainerStarted","Data":"07ae8789515ea29ee12df596a3dc1917eaf03c947af0f84a0db43ae1f7855dcc"}
Sep 18 14:02:35.737052 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.736984    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl" podStartSLOduration=1.736965278 podStartE2EDuration="1.736965278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:02:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:02:35.732577272 +0000 UTC m=+1081.568415984" watchObservedRunningTime="2026-09-18 14:02:35.736965278 +0000 UTC m=+1081.572803991"
Sep 18 14:02:35.830940 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.830905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-592jv\" (UniqueName: \"kubernetes.io/projected/72a707b6-9259-4574-9769-63a3a32ea8d6-kube-api-access-592jv\") pod \"test-curl-7624-39068a\" (UID: \"72a707b6-9259-4574-9769-63a3a32ea8d6\") " pod="opendatahub/test-curl-7624-39068a"
Sep 18 14:02:35.931659 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.931577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-592jv\" (UniqueName: \"kubernetes.io/projected/72a707b6-9259-4574-9769-63a3a32ea8d6-kube-api-access-592jv\") pod \"test-curl-7624-39068a\" (UID: \"72a707b6-9259-4574-9769-63a3a32ea8d6\") " pod="opendatahub/test-curl-7624-39068a"
Sep 18 14:02:35.940282 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:35.940256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-592jv\" (UniqueName: \"kubernetes.io/projected/72a707b6-9259-4574-9769-63a3a32ea8d6-kube-api-access-592jv\") pod \"test-curl-7624-39068a\" (UID: \"72a707b6-9259-4574-9769-63a3a32ea8d6\") " pod="opendatahub/test-curl-7624-39068a"
Sep 18 14:02:36.001265 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:36.001216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-39068a"
Sep 18 14:02:36.278913 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:36.278757    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-39068a"]
Sep 18 14:02:36.288321 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:02:36.288291    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72a707b6_9259_4574_9769_63a3a32ea8d6.slice/crio-c3920278e4d13d254493fcea0f293d1b84342272efba7f2c5e02050e0a4e4355 WatchSource:0}: Error finding container c3920278e4d13d254493fcea0f293d1b84342272efba7f2c5e02050e0a4e4355: Status 404 returned error can't find the container with id c3920278e4d13d254493fcea0f293d1b84342272efba7f2c5e02050e0a4e4355
Sep 18 14:02:36.291042 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:36.291003    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 14:02:36.725855 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:36.725822    2575 generic.go:356] "Generic (PLEG): container finished" podID="2aaa0c46-572a-4ea7-b3df-db49d18de988" containerID="5a184298198da4944e198bf9c2c27f1c92fe3a93e39cb3d9a5ffa8d1213d29de" exitCode=0
Sep 18 14:02:36.726287 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:36.725903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl" event={"ID":"2aaa0c46-572a-4ea7-b3df-db49d18de988","Type":"ContainerDied","Data":"5a184298198da4944e198bf9c2c27f1c92fe3a93e39cb3d9a5ffa8d1213d29de"}
Sep 18 14:02:36.727192 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:36.727167    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-39068a" event={"ID":"72a707b6-9259-4574-9769-63a3a32ea8d6","Type":"ContainerStarted","Data":"c3920278e4d13d254493fcea0f293d1b84342272efba7f2c5e02050e0a4e4355"}
Sep 18 14:02:37.736227 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:37.736119    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-39068a" event={"ID":"72a707b6-9259-4574-9769-63a3a32ea8d6","Type":"ContainerStarted","Data":"a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a"}
Sep 18 14:02:37.755171 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:37.755060    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7624-39068a" podStartSLOduration=1.63784808 podStartE2EDuration="2.755042167s" totalImagesPullingTime="1.117194087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:02:37.753049414 +0000 UTC m=+1083.588888129" watchObservedRunningTime="2026-09-18 14:02:37.755042167 +0000 UTC m=+1083.590880879"
Sep 18 14:02:37.902206 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:37.902176    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"
Sep 18 14:02:38.071356 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:38.071323    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aaa0c46-572a-4ea7-b3df-db49d18de988-maas-api-service-ca\") pod \"2aaa0c46-572a-4ea7-b3df-db49d18de988\" (UID: \"2aaa0c46-572a-4ea7-b3df-db49d18de988\") "
Sep 18 14:02:38.071698 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:38.071676    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aaa0c46-572a-4ea7-b3df-db49d18de988-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2aaa0c46-572a-4ea7-b3df-db49d18de988" (UID: "2aaa0c46-572a-4ea7-b3df-db49d18de988"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:02:38.173097 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:38.173075    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aaa0c46-572a-4ea7-b3df-db49d18de988-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:38.401377 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:38.401195    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7624-39068a"]
Sep 18 14:02:38.405878 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:38.405832    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7624-39068a"]
Sep 18 14:02:38.744574 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:38.744496    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"
Sep 18 14:02:38.744574 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:38.744527    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl" event={"ID":"2aaa0c46-572a-4ea7-b3df-db49d18de988","Type":"ContainerDied","Data":"07ae8789515ea29ee12df596a3dc1917eaf03c947af0f84a0db43ae1f7855dcc"}
Sep 18 14:02:38.744996 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:38.744604    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07ae8789515ea29ee12df596a3dc1917eaf03c947af0f84a0db43ae1f7855dcc"
Sep 18 14:02:38.744996 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:02:38.744859    2575 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7624-39068a" container="test-curl-7624-39068a"
Sep 18 14:02:39.300869 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.300837    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"]
Sep 18 14:02:39.301405 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.301389    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aaa0c46-572a-4ea7-b3df-db49d18de988" containerName="revoke-keys"
Sep 18 14:02:39.301451 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.301407    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aaa0c46-572a-4ea7-b3df-db49d18de988" containerName="revoke-keys"
Sep 18 14:02:39.301451 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.301431    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a707b6-9259-4574-9769-63a3a32ea8d6" containerName="test-curl-7624-39068a"
Sep 18 14:02:39.301451 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.301436    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a707b6-9259-4574-9769-63a3a32ea8d6" containerName="test-curl-7624-39068a"
Sep 18 14:02:39.301549 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.301526    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a707b6-9259-4574-9769-63a3a32ea8d6" containerName="test-curl-7624-39068a"
Sep 18 14:02:39.301549 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.301540    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aaa0c46-572a-4ea7-b3df-db49d18de988" containerName="revoke-keys"
Sep 18 14:02:39.304807 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.304792    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.311213 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.311187    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bfd52075-openshift-default-dockercfg-nb8cw\""
Sep 18 14:02:39.332313 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.332280    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"]
Sep 18 14:02:39.385178 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.385112    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istiod-ca-cert\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.385352 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.385201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-podinfo\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.385352 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.385258    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-socket\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.385352 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.385312    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-certs\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.385455 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.385352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-token\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.385455 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.385374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-data\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.385455 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.385397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vcnb\" (UniqueName: \"kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-kube-api-access-9vcnb\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.385559 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.385520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-credential-socket\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.385595 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.385561    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-envoy\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486127 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486086    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-certs\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486323 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-token\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486323 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-data\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486323 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vcnb\" (UniqueName: \"kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-kube-api-access-9vcnb\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486461 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486331    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-credential-socket\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486461 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486372    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-envoy\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486564 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486492    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-certs\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486564 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istiod-ca-cert\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486672 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-podinfo\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486672 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-data\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486794 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486701    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-socket\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486848 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486783    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-credential-socket\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.486976 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.486957    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-socket\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.487239 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.487214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istiod-ca-cert\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.488848 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.488825    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-envoy\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.489145 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.489115    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-podinfo\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.495798 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.495766    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vcnb\" (UniqueName: \"kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-kube-api-access-9vcnb\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.495976 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.495955    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-token\") pod \"e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") " pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.615941 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.615913    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:39.684942 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.684909    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 14:02:39.688653 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.688631    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-token\") pod \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") "
Sep 18 14:02:39.688769 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.688695    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-podinfo\") pod \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") "
Sep 18 14:02:39.688769 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.688753    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-socket\") pod \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") "
Sep 18 14:02:39.688881 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.688808    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8588\" (UniqueName: \"kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-kube-api-access-n8588\") pod \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") "
Sep 18 14:02:39.688881 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.688864    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-envoy\") pod \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") "
Sep 18 14:02:39.688988 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.688896    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-data\") pod \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") "
Sep 18 14:02:39.688988 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.688937    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-certs\") pod \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") "
Sep 18 14:02:39.688988 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.688960    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istiod-ca-cert\") pod \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") "
Sep 18 14:02:39.689170 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.689018    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-credential-socket\") pod \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\" (UID: \"add00ce6-a6c4-4d5f-b7c8-40f7049c735b\") "
Sep 18 14:02:39.689809 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.689680    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "add00ce6-a6c4-4d5f-b7c8-40f7049c735b" (UID: "add00ce6-a6c4-4d5f-b7c8-40f7049c735b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:02:39.690035 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.689929    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "add00ce6-a6c4-4d5f-b7c8-40f7049c735b" (UID: "add00ce6-a6c4-4d5f-b7c8-40f7049c735b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:02:39.690035 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.689978    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "add00ce6-a6c4-4d5f-b7c8-40f7049c735b" (UID: "add00ce6-a6c4-4d5f-b7c8-40f7049c735b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:02:39.690304 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.690283    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "add00ce6-a6c4-4d5f-b7c8-40f7049c735b" (UID: "add00ce6-a6c4-4d5f-b7c8-40f7049c735b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:02:39.690635 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.690544    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-data" (OuterVolumeSpecName: "istio-data") pod "add00ce6-a6c4-4d5f-b7c8-40f7049c735b" (UID: "add00ce6-a6c4-4d5f-b7c8-40f7049c735b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:02:39.693538 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.693516    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "add00ce6-a6c4-4d5f-b7c8-40f7049c735b" (UID: "add00ce6-a6c4-4d5f-b7c8-40f7049c735b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:02:39.694480 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.694446    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "add00ce6-a6c4-4d5f-b7c8-40f7049c735b" (UID: "add00ce6-a6c4-4d5f-b7c8-40f7049c735b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:02:39.694614 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.694482    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-token" (OuterVolumeSpecName: "istio-token") pod "add00ce6-a6c4-4d5f-b7c8-40f7049c735b" (UID: "add00ce6-a6c4-4d5f-b7c8-40f7049c735b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:02:39.695708 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.695680    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-kube-api-access-n8588" (OuterVolumeSpecName: "kube-api-access-n8588") pod "add00ce6-a6c4-4d5f-b7c8-40f7049c735b" (UID: "add00ce6-a6c4-4d5f-b7c8-40f7049c735b"). InnerVolumeSpecName "kube-api-access-n8588". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:02:39.755711 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.755676    2575 generic.go:356] "Generic (PLEG): container finished" podID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerID="5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c" exitCode=0
Sep 18 14:02:39.756201 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.755727    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"
Sep 18 14:02:39.756201 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.755763    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" event={"ID":"add00ce6-a6c4-4d5f-b7c8-40f7049c735b","Type":"ContainerDied","Data":"5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c"}
Sep 18 14:02:39.756201 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.755817    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n" event={"ID":"add00ce6-a6c4-4d5f-b7c8-40f7049c735b","Type":"ContainerDied","Data":"06214f9bd7d2aa1db7cf59177f270b7e2151ce9ce149ef1580643c5317f74b00"}
Sep 18 14:02:39.756201 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.755840    2575 scope.go:117] "RemoveContainer" containerID="5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c"
Sep 18 14:02:39.756201 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.756046    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7624-39068a" podUID="72a707b6-9259-4574-9769-63a3a32ea8d6" containerName="test-curl-7624-39068a" containerID="cri-o://a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a" gracePeriod=2
Sep 18 14:02:39.766413 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.766390    2575 scope.go:117] "RemoveContainer" containerID="96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc"
Sep 18 14:02:39.767423 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:02:39.767095    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7624-39068a\" is forbidden: User \"system:node:ip-10-0-136-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-76.ec2.internal' and this object" podUID="72a707b6-9259-4574-9769-63a3a32ea8d6" pod="opendatahub/test-curl-7624-39068a"
Sep 18 14:02:39.769585 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:02:39.769557    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7624-39068a\" is forbidden: User \"system:node:ip-10-0-136-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-76.ec2.internal' and this object" podUID="72a707b6-9259-4574-9769-63a3a32ea8d6" pod="opendatahub/test-curl-7624-39068a"
Sep 18 14:02:39.775415 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.775398    2575 scope.go:117] "RemoveContainer" containerID="5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c"
Sep 18 14:02:39.775683 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:02:39.775665    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c\": container with ID starting with 5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c not found: ID does not exist" containerID="5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c"
Sep 18 14:02:39.775725 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.775693    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c"} err="failed to get container status \"5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c\": rpc error: code = NotFound desc = could not find container \"5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c\": container with ID starting with 5d72d7be0de6475cbb8066b254cf0672ef761925db6529b879d631fe7da65d5c not found: ID does not exist"
Sep 18 14:02:39.775725 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.775711    2575 scope.go:117] "RemoveContainer" containerID="96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc"
Sep 18 14:02:39.775953 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:02:39.775939    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc\": container with ID starting with 96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc not found: ID does not exist" containerID="96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc"
Sep 18 14:02:39.775991 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.775957    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc"} err="failed to get container status \"96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc\": rpc error: code = NotFound desc = could not find container \"96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc\": container with ID starting with 96fbaa260c83ef7ad876d48c65b2987f63f72a2802bdb1acb6f4728b36133bbc not found: ID does not exist"
Sep 18 14:02:39.790270 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.790247    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:39.790270 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.790269    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istiod-ca-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:39.790270 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.790279    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-credential-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:39.790504 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.790288    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-token\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:39.790504 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.790297    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-podinfo\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:39.790504 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.790306    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-workload-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:39.790504 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.790313    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8588\" (UniqueName: \"kubernetes.io/projected/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-kube-api-access-n8588\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:39.790504 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.790322    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-envoy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:39.790504 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.790330    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/add00ce6-a6c4-4d5f-b7c8-40f7049c735b-istio-data\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:39.792520 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.792498    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"]
Sep 18 14:02:39.802793 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.802762    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n"]
Sep 18 14:02:39.916866 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:02:39.916834    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0b489d_b64b_44d8_a5d0_639e90b22c86.slice/crio-219e4a05f06fb658b155e8ef552be644541856c2b2c94c961b660b009280774c WatchSource:0}: Error finding container 219e4a05f06fb658b155e8ef552be644541856c2b2c94c961b660b009280774c: Status 404 returned error can't find the container with id 219e4a05f06fb658b155e8ef552be644541856c2b2c94c961b660b009280774c
Sep 18 14:02:39.916866 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.916852    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"]
Sep 18 14:02:39.919362 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.919324    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:02:39.919491 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.919409    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:02:39.919491 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:39.919459    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:02:40.294149 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:40.294051    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" path="/var/lib/kubelet/pods/add00ce6-a6c4-4d5f-b7c8-40f7049c735b/volumes"
Sep 18 14:02:40.763642 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:40.763607    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" event={"ID":"5a0b489d-b64b-44d8-a5d0-639e90b22c86","Type":"ContainerStarted","Data":"2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1"}
Sep 18 14:02:40.764080 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:40.763673    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" event={"ID":"5a0b489d-b64b-44d8-a5d0-639e90b22c86","Type":"ContainerStarted","Data":"219e4a05f06fb658b155e8ef552be644541856c2b2c94c961b660b009280774c"}
Sep 18 14:02:40.788390 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:40.788346    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" podStartSLOduration=1.788331906 podStartE2EDuration="1.788331906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:02:40.787430598 +0000 UTC m=+1086.623269312" watchObservedRunningTime="2026-09-18 14:02:40.788331906 +0000 UTC m=+1086.624170620"
Sep 18 14:02:41.616950 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:41.616909    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:41.622315 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:41.622287    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:41.773198 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:41.773175    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:41.774306 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:41.774285    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:02:41.951408 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:41.951382    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-39068a"
Sep 18 14:02:42.015060 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:42.015028    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-592jv\" (UniqueName: \"kubernetes.io/projected/72a707b6-9259-4574-9769-63a3a32ea8d6-kube-api-access-592jv\") pod \"72a707b6-9259-4574-9769-63a3a32ea8d6\" (UID: \"72a707b6-9259-4574-9769-63a3a32ea8d6\") "
Sep 18 14:02:42.017204 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:42.017183    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72a707b6-9259-4574-9769-63a3a32ea8d6-kube-api-access-592jv" (OuterVolumeSpecName: "kube-api-access-592jv") pod "72a707b6-9259-4574-9769-63a3a32ea8d6" (UID: "72a707b6-9259-4574-9769-63a3a32ea8d6"). InnerVolumeSpecName "kube-api-access-592jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:02:42.116267 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:42.116234    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-592jv\" (UniqueName: \"kubernetes.io/projected/72a707b6-9259-4574-9769-63a3a32ea8d6-kube-api-access-592jv\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:02:42.293541 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:42.293457    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72a707b6-9259-4574-9769-63a3a32ea8d6" path="/var/lib/kubelet/pods/72a707b6-9259-4574-9769-63a3a32ea8d6/volumes"
Sep 18 14:02:42.780574 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:42.780542    2575 generic.go:356] "Generic (PLEG): container finished" podID="72a707b6-9259-4574-9769-63a3a32ea8d6" containerID="a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a" exitCode=137
Sep 18 14:02:42.781074 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:42.780596    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-39068a"
Sep 18 14:02:42.781074 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:42.780651    2575 scope.go:117] "RemoveContainer" containerID="a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a"
Sep 18 14:02:42.790147 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:42.790109    2575 scope.go:117] "RemoveContainer" containerID="a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a"
Sep 18 14:02:42.790429 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:02:42.790408    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a\": container with ID starting with a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a not found: ID does not exist" containerID="a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a"
Sep 18 14:02:42.790479 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:42.790438    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a"} err="failed to get container status \"a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a\": rpc error: code = NotFound desc = could not find container \"a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a\": container with ID starting with a18bcd93ba593603f1c590eb2050100cbda9ebe1c029e867f374b01630eb814a not found: ID does not exist"
Sep 18 14:02:47.820894 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.820857    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"]
Sep 18 14:02:47.821494 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.821384    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy"
Sep 18 14:02:47.821494 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.821397    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy"
Sep 18 14:02:47.821494 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.821486    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy"
Sep 18 14:02:47.821494 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.821494    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy"
Sep 18 14:02:47.826233 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.826208    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:02:47.829170 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.829114    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-bfd52075-dockercfg-hlsd7\""
Sep 18 14:02:47.829322 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.829166    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-bfd52075\""
Sep 18 14:02:47.830029 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.830005    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"]
Sep 18 14:02:47.830921 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.830610    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy"
Sep 18 14:02:47.830921 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.830634    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="add00ce6-a6c4-4d5f-b7c8-40f7049c735b" containerName="istio-proxy"
Sep 18 14:02:47.834597 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.834577    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:02:47.837095 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.837071    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"]
Sep 18 14:02:47.847031 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.845888    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"]
Sep 18 14:02:47.876656 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.876624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9pvp\" (UniqueName: \"kubernetes.io/projected/7d169ef0-4616-4b5b-bf0e-077bffbf3002-kube-api-access-h9pvp\") pod \"payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt\" (UID: \"7d169ef0-4616-4b5b-bf0e-077bffbf3002\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:02:47.876821 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.876749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58af98e8-eb63-425d-ad32-7658ff838d4e-plugins-config-volume\") pod \"payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz\" (UID: \"58af98e8-eb63-425d-ad32-7658ff838d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:02:47.876821 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.876812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d169ef0-4616-4b5b-bf0e-077bffbf3002-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt\" (UID: \"7d169ef0-4616-4b5b-bf0e-077bffbf3002\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:02:47.876907 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.876835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgw2t\" (UniqueName: \"kubernetes.io/projected/58af98e8-eb63-425d-ad32-7658ff838d4e-kube-api-access-kgw2t\") pod \"payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz\" (UID: \"58af98e8-eb63-425d-ad32-7658ff838d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:02:47.977692 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.977649    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9pvp\" (UniqueName: \"kubernetes.io/projected/7d169ef0-4616-4b5b-bf0e-077bffbf3002-kube-api-access-h9pvp\") pod \"payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt\" (UID: \"7d169ef0-4616-4b5b-bf0e-077bffbf3002\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:02:47.977889 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.977780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58af98e8-eb63-425d-ad32-7658ff838d4e-plugins-config-volume\") pod \"payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz\" (UID: \"58af98e8-eb63-425d-ad32-7658ff838d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:02:47.977889 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.977847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d169ef0-4616-4b5b-bf0e-077bffbf3002-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt\" (UID: \"7d169ef0-4616-4b5b-bf0e-077bffbf3002\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:02:47.977889 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.977874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgw2t\" (UniqueName: \"kubernetes.io/projected/58af98e8-eb63-425d-ad32-7658ff838d4e-kube-api-access-kgw2t\") pod \"payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz\" (UID: \"58af98e8-eb63-425d-ad32-7658ff838d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:02:47.978684 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.978658    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58af98e8-eb63-425d-ad32-7658ff838d4e-plugins-config-volume\") pod \"payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz\" (UID: \"58af98e8-eb63-425d-ad32-7658ff838d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:02:47.978921 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.978899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d169ef0-4616-4b5b-bf0e-077bffbf3002-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt\" (UID: \"7d169ef0-4616-4b5b-bf0e-077bffbf3002\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:02:47.988949 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.988908    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgw2t\" (UniqueName: \"kubernetes.io/projected/58af98e8-eb63-425d-ad32-7658ff838d4e-kube-api-access-kgw2t\") pod \"payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz\" (UID: \"58af98e8-eb63-425d-ad32-7658ff838d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:02:47.989709 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:47.989685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9pvp\" (UniqueName: \"kubernetes.io/projected/7d169ef0-4616-4b5b-bf0e-077bffbf3002-kube-api-access-h9pvp\") pod \"payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt\" (UID: \"7d169ef0-4616-4b5b-bf0e-077bffbf3002\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:02:48.029054 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.029015    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd"]
Sep 18 14:02:48.031515 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.031486    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b63f26-29829000-jgmkd"]
Sep 18 14:02:48.145124 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.145038    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:02:48.157682 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.157572    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:02:48.297556 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.297524    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf6c210b-ba2b-49e2-959c-487ef63c8d65" path="/var/lib/kubelet/pods/cf6c210b-ba2b-49e2-959c-487ef63c8d65/volumes"
Sep 18 14:02:48.297804 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.297790    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"]
Sep 18 14:02:48.307605 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.307569    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b63f26-xxwdl"]
Sep 18 14:02:48.452180 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:02:48.452150    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d169ef0_4616_4b5b_bf0e_077bffbf3002.slice/crio-41c5e3b7987a6f371bdf7b10cd744026d5e4f2592272ff774b5e81a194e263b8 WatchSource:0}: Error finding container 41c5e3b7987a6f371bdf7b10cd744026d5e4f2592272ff774b5e81a194e263b8: Status 404 returned error can't find the container with id 41c5e3b7987a6f371bdf7b10cd744026d5e4f2592272ff774b5e81a194e263b8
Sep 18 14:02:48.452566 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:02:48.452543    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58af98e8_eb63_425d_ad32_7658ff838d4e.slice/crio-5e5ddda7efae43f42ed42e4840d24375bc78352bac2bff0254ab6cf744da7693 WatchSource:0}: Error finding container 5e5ddda7efae43f42ed42e4840d24375bc78352bac2bff0254ab6cf744da7693: Status 404 returned error can't find the container with id 5e5ddda7efae43f42ed42e4840d24375bc78352bac2bff0254ab6cf744da7693
Sep 18 14:02:48.454203 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.454179    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"]
Sep 18 14:02:48.456937 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.456914    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"]
Sep 18 14:02:48.824046 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.824008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt" event={"ID":"7d169ef0-4616-4b5b-bf0e-077bffbf3002","Type":"ContainerStarted","Data":"b219e153bb3df68d3f66e41ee74471319d89e76a12be1fb5f0dbbf8789fd66a0"}
Sep 18 14:02:48.824599 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.824076    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt" event={"ID":"7d169ef0-4616-4b5b-bf0e-077bffbf3002","Type":"ContainerStarted","Data":"41c5e3b7987a6f371bdf7b10cd744026d5e4f2592272ff774b5e81a194e263b8"}
Sep 18 14:02:48.824599 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.824222    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:02:48.825893 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.825868    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz" event={"ID":"58af98e8-eb63-425d-ad32-7658ff838d4e","Type":"ContainerStarted","Data":"cbe6ea42bd1033b510d7cd4e488eef4429ff625e419af6bc3665bd2bbf56a4ff"}
Sep 18 14:02:48.826023 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.825914    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz" event={"ID":"58af98e8-eb63-425d-ad32-7658ff838d4e","Type":"ContainerStarted","Data":"5e5ddda7efae43f42ed42e4840d24375bc78352bac2bff0254ab6cf744da7693"}
Sep 18 14:02:48.826023 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.825974    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:02:48.844605 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.844540    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt" podStartSLOduration=1.8445187010000001 podStartE2EDuration="1.844518701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:02:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:02:48.844180615 +0000 UTC m=+1094.680019328" watchObservedRunningTime="2026-09-18 14:02:48.844518701 +0000 UTC m=+1094.680357415"
Sep 18 14:02:48.866640 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:48.866487    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz" podStartSLOduration=1.866470646 podStartE2EDuration="1.866470646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:02:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:02:48.864491358 +0000 UTC m=+1094.700330073" watchObservedRunningTime="2026-09-18 14:02:48.866470646 +0000 UTC m=+1094.702309359"
Sep 18 14:02:50.294804 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:50.294770    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aaa0c46-572a-4ea7-b3df-db49d18de988" path="/var/lib/kubelet/pods/2aaa0c46-572a-4ea7-b3df-db49d18de988/volumes"
Sep 18 14:02:55.497868 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:55.497832    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"]
Sep 18 14:02:55.498382 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:55.498113    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy" containerID="cri-o://351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12" gracePeriod=30
Sep 18 14:02:59.834780 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:59.834747    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:02:59.835320 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:02:59.834827    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:03:00.769853 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.769782    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 14:03:00.831567 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.831534    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-istio-token\") pod \"c609d637-9282-4247-9916-f1187b8f9de5\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") "
Sep 18 14:03:00.831763 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.831616    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-socket\") pod \"c609d637-9282-4247-9916-f1187b8f9de5\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") "
Sep 18 14:03:00.831763 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.831671    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c609d637-9282-4247-9916-f1187b8f9de5-istiod-ca-cert\") pod \"c609d637-9282-4247-9916-f1187b8f9de5\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") "
Sep 18 14:03:00.831763 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.831709    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-envoy\") pod \"c609d637-9282-4247-9916-f1187b8f9de5\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") "
Sep 18 14:03:00.831763 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.831754    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c609d637-9282-4247-9916-f1187b8f9de5-istio-podinfo\") pod \"c609d637-9282-4247-9916-f1187b8f9de5\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") "
Sep 18 14:03:00.831989 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.831838    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-credential-socket\") pod \"c609d637-9282-4247-9916-f1187b8f9de5\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") "
Sep 18 14:03:00.831989 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.831917    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-data\") pod \"c609d637-9282-4247-9916-f1187b8f9de5\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") "
Sep 18 14:03:00.831989 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.831968    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qbqp\" (UniqueName: \"kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-kube-api-access-5qbqp\") pod \"c609d637-9282-4247-9916-f1187b8f9de5\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") "
Sep 18 14:03:00.831989 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.831975    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c609d637-9282-4247-9916-f1187b8f9de5" (UID: "c609d637-9282-4247-9916-f1187b8f9de5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:03:00.832228 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.831997    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-certs\") pod \"c609d637-9282-4247-9916-f1187b8f9de5\" (UID: \"c609d637-9282-4247-9916-f1187b8f9de5\") "
Sep 18 14:03:00.832286 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.832240    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-data" (OuterVolumeSpecName: "istio-data") pod "c609d637-9282-4247-9916-f1187b8f9de5" (UID: "c609d637-9282-4247-9916-f1187b8f9de5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:03:00.832699 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.832274    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c609d637-9282-4247-9916-f1187b8f9de5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c609d637-9282-4247-9916-f1187b8f9de5" (UID: "c609d637-9282-4247-9916-f1187b8f9de5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:03:00.832699 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.832449    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c609d637-9282-4247-9916-f1187b8f9de5" (UID: "c609d637-9282-4247-9916-f1187b8f9de5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:03:00.832699 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.832461    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c609d637-9282-4247-9916-f1187b8f9de5" (UID: "c609d637-9282-4247-9916-f1187b8f9de5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:03:00.832699 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.832585    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:00.832699 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.832603    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-workload-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:00.832699 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.832617    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c609d637-9282-4247-9916-f1187b8f9de5-istiod-ca-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:00.832699 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.832630    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-credential-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:00.832699 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.832644    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-data\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:00.834550 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.834516    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-istio-token" (OuterVolumeSpecName: "istio-token") pod "c609d637-9282-4247-9916-f1187b8f9de5" (UID: "c609d637-9282-4247-9916-f1187b8f9de5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:03:00.834764 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.834731    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c609d637-9282-4247-9916-f1187b8f9de5" (UID: "c609d637-9282-4247-9916-f1187b8f9de5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:03:00.835193 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.835165    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-kube-api-access-5qbqp" (OuterVolumeSpecName: "kube-api-access-5qbqp") pod "c609d637-9282-4247-9916-f1187b8f9de5" (UID: "c609d637-9282-4247-9916-f1187b8f9de5"). InnerVolumeSpecName "kube-api-access-5qbqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:03:00.836069 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.836006    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c609d637-9282-4247-9916-f1187b8f9de5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c609d637-9282-4247-9916-f1187b8f9de5" (UID: "c609d637-9282-4247-9916-f1187b8f9de5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:03:00.916912 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.916880    2575 generic.go:356] "Generic (PLEG): container finished" podID="c609d637-9282-4247-9916-f1187b8f9de5" containerID="351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12" exitCode=0
Sep 18 14:03:00.917091 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.916933    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"
Sep 18 14:03:00.917091 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.916962    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" event={"ID":"c609d637-9282-4247-9916-f1187b8f9de5","Type":"ContainerDied","Data":"351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12"}
Sep 18 14:03:00.917091 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.917015    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd" event={"ID":"c609d637-9282-4247-9916-f1187b8f9de5","Type":"ContainerDied","Data":"9a6a0d8189c37114e9d5701fa5020bbbdafa5eef9d2734f0d68d84ae0311ead7"}
Sep 18 14:03:00.917091 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.917037    2575 scope.go:117] "RemoveContainer" containerID="351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12"
Sep 18 14:03:00.928000 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.927979    2575 scope.go:117] "RemoveContainer" containerID="e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b"
Sep 18 14:03:00.934182 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.934123    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c609d637-9282-4247-9916-f1187b8f9de5-istio-envoy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:00.934308 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.934186    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c609d637-9282-4247-9916-f1187b8f9de5-istio-podinfo\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:00.934308 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.934200    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qbqp\" (UniqueName: \"kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-kube-api-access-5qbqp\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:00.934308 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.934213    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c609d637-9282-4247-9916-f1187b8f9de5-istio-token\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:00.938520 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.938498    2575 scope.go:117] "RemoveContainer" containerID="351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12"
Sep 18 14:03:00.938887 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:03:00.938860    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12\": container with ID starting with 351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12 not found: ID does not exist" containerID="351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12"
Sep 18 14:03:00.938997 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.938899    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12"} err="failed to get container status \"351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12\": rpc error: code = NotFound desc = could not find container \"351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12\": container with ID starting with 351f5923084da843507eb9e53669295ec7f043add657714dc02d4f7f1d121d12 not found: ID does not exist"
Sep 18 14:03:00.938997 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.938942    2575 scope.go:117] "RemoveContainer" containerID="e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b"
Sep 18 14:03:00.939328 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:03:00.939300    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b\": container with ID starting with e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b not found: ID does not exist" containerID="e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b"
Sep 18 14:03:00.939430 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.939338    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b"} err="failed to get container status \"e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b\": rpc error: code = NotFound desc = could not find container \"e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b\": container with ID starting with e66c158abc3f10562280b9eab75d99e846018d2883c71ca963e90fc0bdad5a5b not found: ID does not exist"
Sep 18 14:03:00.944738 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.944713    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"]
Sep 18 14:03:00.948826 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:00.948799    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd"]
Sep 18 14:03:02.294668 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:02.294629    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c609d637-9282-4247-9916-f1187b8f9de5" path="/var/lib/kubelet/pods/c609d637-9282-4247-9916-f1187b8f9de5/volumes"
Sep 18 14:03:04.092835 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.092799    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"]
Sep 18 14:03:04.093415 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.093384    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy"
Sep 18 14:03:04.093415 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.093403    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy"
Sep 18 14:03:04.093552 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.093540    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy"
Sep 18 14:03:04.093595 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.093554    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy"
Sep 18 14:03:04.098322 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.098302    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:03:04.102390 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.102362    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-783872\""
Sep 18 14:03:04.112231 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.112194    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"]
Sep 18 14:03:04.173980 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.173948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1334736e-7765-41bb-8968-02faa606f66c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv\" (UID: \"1334736e-7765-41bb-8968-02faa606f66c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:03:04.174161 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.174017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dpqz\" (UniqueName: \"kubernetes.io/projected/1334736e-7765-41bb-8968-02faa606f66c-kube-api-access-8dpqz\") pod \"payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv\" (UID: \"1334736e-7765-41bb-8968-02faa606f66c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:03:04.275072 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.275031    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1334736e-7765-41bb-8968-02faa606f66c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv\" (UID: \"1334736e-7765-41bb-8968-02faa606f66c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:03:04.275282 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.275179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dpqz\" (UniqueName: \"kubernetes.io/projected/1334736e-7765-41bb-8968-02faa606f66c-kube-api-access-8dpqz\") pod \"payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv\" (UID: \"1334736e-7765-41bb-8968-02faa606f66c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:03:04.275780 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.275758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1334736e-7765-41bb-8968-02faa606f66c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv\" (UID: \"1334736e-7765-41bb-8968-02faa606f66c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:03:04.284938 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.284911    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dpqz\" (UniqueName: \"kubernetes.io/projected/1334736e-7765-41bb-8968-02faa606f66c-kube-api-access-8dpqz\") pod \"payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv\" (UID: \"1334736e-7765-41bb-8968-02faa606f66c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:03:04.412529 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.412438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:03:04.693225 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.693191    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"]
Sep 18 14:03:04.694512 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:03:04.694486    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1334736e_7765_41bb_8968_02faa606f66c.slice/crio-4c23024c6f800daa58604b46b7cac2ba8b3f04976bd3cffe8db9dead38e6764c WatchSource:0}: Error finding container 4c23024c6f800daa58604b46b7cac2ba8b3f04976bd3cffe8db9dead38e6764c: Status 404 returned error can't find the container with id 4c23024c6f800daa58604b46b7cac2ba8b3f04976bd3cffe8db9dead38e6764c
Sep 18 14:03:04.955951 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.955843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv" event={"ID":"1334736e-7765-41bb-8968-02faa606f66c","Type":"ContainerStarted","Data":"6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94"}
Sep 18 14:03:04.956127 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.955987    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:03:04.956127 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.956016    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv" event={"ID":"1334736e-7765-41bb-8968-02faa606f66c","Type":"ContainerStarted","Data":"4c23024c6f800daa58604b46b7cac2ba8b3f04976bd3cffe8db9dead38e6764c"}
Sep 18 14:03:04.976528 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:04.976472    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv" podStartSLOduration=0.976454936 podStartE2EDuration="976.454936ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:03:04.97520046 +0000 UTC m=+1110.811039175" watchObservedRunningTime="2026-09-18 14:03:04.976454936 +0000 UTC m=+1110.812293675"
Sep 18 14:03:12.814340 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:12.814291    2575 patch_prober.go:28] interesting pod/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 14:03:12.814842 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:12.814371    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 14:03:15.023468 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:15.023435    2575 generic.go:356] "Generic (PLEG): container finished" podID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerID="2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1" exitCode=0
Sep 18 14:03:15.023991 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:15.023509    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" event={"ID":"5a0b489d-b64b-44d8-a5d0-639e90b22c86","Type":"ContainerDied","Data":"2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1"}
Sep 18 14:03:15.023991 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:15.023961    2575 scope.go:117] "RemoveContainer" containerID="2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1"
Sep 18 14:03:15.025148 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:15.025099    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:03:15.025264 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:15.025212    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:03:15.025312 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:15.025263    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:03:15.968291 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:15.968260    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:03:16.032070 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:16.032038    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" event={"ID":"5a0b489d-b64b-44d8-a5d0-639e90b22c86","Type":"ContainerStarted","Data":"1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9"}
Sep 18 14:03:16.616525 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:16.616491    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:03:16.616729 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:16.616676    2575 patch_prober.go:28] interesting pod/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 18 14:03:16.616783 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:16.616723    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 18 14:03:17.617216 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:17.617179    2575 patch_prober.go:28] interesting pod/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 18 14:03:17.617587 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:17.617246    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 18 14:03:18.616749 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:18.616715    2575 patch_prober.go:28] interesting pod/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 18 14:03:18.616947 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:18.616781    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 18 14:03:19.616758 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:19.616721    2575 patch_prober.go:28] interesting pod/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 18 14:03:19.617279 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:19.616794    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 18 14:03:19.722627 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:19.722594    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"]
Sep 18 14:03:19.723063 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:19.723031    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h" podUID="c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" containerName="istio-proxy" containerID="cri-o://1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318" gracePeriod=30
Sep 18 14:03:20.616611 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:20.616569    2575 patch_prober.go:28] interesting pod/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 18 14:03:20.616800 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:20.616684    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 18 14:03:21.616803 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:21.616765    2575 patch_prober.go:28] interesting pod/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 18 14:03:21.617366 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:21.616820    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 18 14:03:22.620029 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:22.619994    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:03:22.620413 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:22.620373    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:03:22.621146 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:22.621116    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:03:24.988264 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:24.988207    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:03:25.100601 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.100566    2575 generic.go:356] "Generic (PLEG): container finished" podID="c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" containerID="1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318" exitCode=0
Sep 18 14:03:25.100782 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.100615    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"
Sep 18 14:03:25.100782 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.100646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h" event={"ID":"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8","Type":"ContainerDied","Data":"1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318"}
Sep 18 14:03:25.100782 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.100711    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h" event={"ID":"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8","Type":"ContainerDied","Data":"636a38878ae13bd09f3b30e902db69b86f93650ccc2e1b6379125d55571d4c33"}
Sep 18 14:03:25.100782 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.100735    2575 scope.go:117] "RemoveContainer" containerID="1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318"
Sep 18 14:03:25.111528 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.111512    2575 scope.go:117] "RemoveContainer" containerID="1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318"
Sep 18 14:03:25.111803 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:03:25.111785    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318\": container with ID starting with 1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318 not found: ID does not exist" containerID="1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318"
Sep 18 14:03:25.111856 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.111808    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318"} err="failed to get container status \"1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318\": rpc error: code = NotFound desc = could not find container \"1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318\": container with ID starting with 1aa99852699449bf222f85ddd66b006d47429c01791d723c035976f8c2b73318 not found: ID does not exist"
Sep 18 14:03:25.113085 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113067    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-podinfo\") pod \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") "
Sep 18 14:03:25.113162 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113117    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fldfm\" (UniqueName: \"kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-kube-api-access-fldfm\") pod \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") "
Sep 18 14:03:25.113248 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113234    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-envoy\") pod \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") "
Sep 18 14:03:25.113302 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113276    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-certs\") pod \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") "
Sep 18 14:03:25.113348 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113334    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-socket\") pod \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") "
Sep 18 14:03:25.113396 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113378    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-credential-socket\") pod \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") "
Sep 18 14:03:25.113441 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113420    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istiod-ca-cert\") pod \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") "
Sep 18 14:03:25.113553 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113533    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-token\") pod \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") "
Sep 18 14:03:25.113793 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113777    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-data\") pod \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\" (UID: \"c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8\") "
Sep 18 14:03:25.114089 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113580    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" (UID: "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:03:25.114089 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113655    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" (UID: "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:03:25.114293 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.113913    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" (UID: "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:03:25.114293 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.114024    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" (UID: "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:03:25.114293 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.114033    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-data" (OuterVolumeSpecName: "istio-data") pod "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" (UID: "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:03:25.114478 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.114450    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-data\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:25.114478 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.114469    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:25.114595 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.114482    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-workload-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:25.114595 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.114495    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-credential-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:25.114595 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.114508    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istiod-ca-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:25.115343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.115320    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" (UID: "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:03:25.115441 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.115393    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-kube-api-access-fldfm" (OuterVolumeSpecName: "kube-api-access-fldfm") pod "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" (UID: "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8"). InnerVolumeSpecName "kube-api-access-fldfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:03:25.115506 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.115443    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" (UID: "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:03:25.115739 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.115724    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-token" (OuterVolumeSpecName: "istio-token") pod "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" (UID: "c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:03:25.215209 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.215173    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-podinfo\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:25.215209 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.215205    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fldfm\" (UniqueName: \"kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-kube-api-access-fldfm\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:25.215209 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.215216    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-envoy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:25.215458 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.215229    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8-istio-token\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:03:25.426442 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.426406    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"]
Sep 18 14:03:25.428758 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:25.428735    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h"]
Sep 18 14:03:26.294535 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:26.294498    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" path="/var/lib/kubelet/pods/c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8/volumes"
Sep 18 14:03:29.879922 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.879873    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"]
Sep 18 14:03:29.880681 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.880662    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" containerName="istio-proxy"
Sep 18 14:03:29.880744 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.880685    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" containerName="istio-proxy"
Sep 18 14:03:29.880744 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.880714    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy"
Sep 18 14:03:29.880744 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.880723    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c609d637-9282-4247-9916-f1187b8f9de5" containerName="istio-proxy"
Sep 18 14:03:29.880848 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.880830    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c79f5b63-1b82-4f6c-a98c-bb439ed9ddd8" containerName="istio-proxy"
Sep 18 14:03:29.884534 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.884514    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:29.887935 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.887911    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-1a4b6d-openshift-default-dockercfg-jhlvd\""
Sep 18 14:03:29.920891 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.920858    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"]
Sep 18 14:03:29.966041 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.966008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-envoy\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:29.966274 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.966110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-data\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:29.966274 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.966177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa6322e8-c07b-4962-b302-37bbada56363-istiod-ca-cert\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:29.966274 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.966251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-socket\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:29.966453 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.966273    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdj8w\" (UniqueName: \"kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-kube-api-access-rdj8w\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:29.966453 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.966307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-istio-token\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:29.966453 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.966380    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa6322e8-c07b-4962-b302-37bbada56363-istio-podinfo\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:29.966453 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.966439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-credential-socket\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:29.966654 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:29.966493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-certs\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067299 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-envoy\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067299 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067304    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-data\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067551 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa6322e8-c07b-4962-b302-37bbada56363-istiod-ca-cert\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067551 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-socket\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067551 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdj8w\" (UniqueName: \"kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-kube-api-access-rdj8w\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067551 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-istio-token\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067551 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa6322e8-c07b-4962-b302-37bbada56363-istio-podinfo\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067800 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-credential-socket\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067800 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-certs\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067800 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-data\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067958 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067855    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-socket\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.067958 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.067937    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-certs\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.068207 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.068172    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-credential-socket\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.068346 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.068205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa6322e8-c07b-4962-b302-37bbada56363-istiod-ca-cert\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.070076 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.070057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-envoy\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.070221 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.070205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa6322e8-c07b-4962-b302-37bbada56363-istio-podinfo\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.078661 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.078636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-istio-token\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.079879 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.079857    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdj8w\" (UniqueName: \"kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-kube-api-access-rdj8w\") pod \"e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") " pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.195890 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.195798    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:30.476737 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.476708    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"]
Sep 18 14:03:30.478759 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:03:30.478734    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6322e8_c07b_4962_b302_37bbada56363.slice/crio-79c67c17fe63234986efc22fd03c18ec6cf337caa405289f75c85889724a8d24 WatchSource:0}: Error finding container 79c67c17fe63234986efc22fd03c18ec6cf337caa405289f75c85889724a8d24: Status 404 returned error can't find the container with id 79c67c17fe63234986efc22fd03c18ec6cf337caa405289f75c85889724a8d24
Sep 18 14:03:30.481486 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.481455    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:03:30.481554 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.481522    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:03:30.481554 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:30.481551    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:03:31.142463 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:31.142409    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" event={"ID":"aa6322e8-c07b-4962-b302-37bbada56363","Type":"ContainerStarted","Data":"6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d"}
Sep 18 14:03:31.142911 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:31.142486    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" event={"ID":"aa6322e8-c07b-4962-b302-37bbada56363","Type":"ContainerStarted","Data":"79c67c17fe63234986efc22fd03c18ec6cf337caa405289f75c85889724a8d24"}
Sep 18 14:03:31.169281 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:31.169228    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" podStartSLOduration=2.169210454 podStartE2EDuration="2.169210454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:03:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:03:31.16724141 +0000 UTC m=+1137.003080123" watchObservedRunningTime="2026-09-18 14:03:31.169210454 +0000 UTC m=+1137.005049167"
Sep 18 14:03:31.196303 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:31.196270    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:31.201605 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:31.201575    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:32.150200 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:32.150166    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:32.151280 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:32.151257    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:03:36.427954 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:36.427921    2575 scope.go:117] "RemoveContainer" containerID="c3e17095a768c732f49591447435a6e299e20028559f9be91bd8e0d7fd491e99"
Sep 18 14:03:36.438730 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:36.438702    2575 scope.go:117] "RemoveContainer" containerID="7810adf7e4829b4c1a5248809b425046682f42690e460628696bc07c1d498a61"
Sep 18 14:03:39.197352 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.197314    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"]
Sep 18 14:03:39.201582 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.201559    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:03:39.205176 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.205156    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-1a4b6d-dockercfg-cdph2\""
Sep 18 14:03:39.205507 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.205489    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-1a4b6d\""
Sep 18 14:03:39.214456 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.214429    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"]
Sep 18 14:03:39.377282 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.377245    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csnst\" (UniqueName: \"kubernetes.io/projected/98c99c70-06ea-4074-9184-914eaca4ea8b-kube-api-access-csnst\") pod \"payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv\" (UID: \"98c99c70-06ea-4074-9184-914eaca4ea8b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:03:39.377473 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.377443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c99c70-06ea-4074-9184-914eaca4ea8b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv\" (UID: \"98c99c70-06ea-4074-9184-914eaca4ea8b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:03:39.478200 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.478081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c99c70-06ea-4074-9184-914eaca4ea8b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv\" (UID: \"98c99c70-06ea-4074-9184-914eaca4ea8b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:03:39.478375 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.478245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csnst\" (UniqueName: \"kubernetes.io/projected/98c99c70-06ea-4074-9184-914eaca4ea8b-kube-api-access-csnst\") pod \"payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv\" (UID: \"98c99c70-06ea-4074-9184-914eaca4ea8b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:03:39.479026 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.479000    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c99c70-06ea-4074-9184-914eaca4ea8b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv\" (UID: \"98c99c70-06ea-4074-9184-914eaca4ea8b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:03:39.486660 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.486637    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csnst\" (UniqueName: \"kubernetes.io/projected/98c99c70-06ea-4074-9184-914eaca4ea8b-kube-api-access-csnst\") pod \"payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv\" (UID: \"98c99c70-06ea-4074-9184-914eaca4ea8b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:03:39.512585 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.512553    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:03:39.791634 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:39.791604    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"]
Sep 18 14:03:39.792934 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:03:39.792901    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c99c70_06ea_4074_9184_914eaca4ea8b.slice/crio-93b855e9df489994c1288b9846ecff86e0f40c6b987e716a121f7000dc74727f WatchSource:0}: Error finding container 93b855e9df489994c1288b9846ecff86e0f40c6b987e716a121f7000dc74727f: Status 404 returned error can't find the container with id 93b855e9df489994c1288b9846ecff86e0f40c6b987e716a121f7000dc74727f
Sep 18 14:03:40.209920 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:40.209886    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv" event={"ID":"98c99c70-06ea-4074-9184-914eaca4ea8b","Type":"ContainerStarted","Data":"618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e"}
Sep 18 14:03:40.210323 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:40.209937    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv" event={"ID":"98c99c70-06ea-4074-9184-914eaca4ea8b","Type":"ContainerStarted","Data":"93b855e9df489994c1288b9846ecff86e0f40c6b987e716a121f7000dc74727f"}
Sep 18 14:03:40.210323 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:40.209961    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:03:40.231308 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:40.231258    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv" podStartSLOduration=1.231239281 podStartE2EDuration="1.231239281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:03:40.230264033 +0000 UTC m=+1146.066102748" watchObservedRunningTime="2026-09-18 14:03:40.231239281 +0000 UTC m=+1146.067077993"
Sep 18 14:03:51.219025 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:03:51.218930    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:04:03.192343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:03.192298    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 14:04:03.192781 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:03.192383    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 14:04:05.371098 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:05.371056    2575 generic.go:356] "Generic (PLEG): container finished" podID="aa6322e8-c07b-4962-b302-37bbada56363" containerID="6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d" exitCode=0
Sep 18 14:04:05.371517 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:05.371145    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" event={"ID":"aa6322e8-c07b-4962-b302-37bbada56363","Type":"ContainerDied","Data":"6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d"}
Sep 18 14:04:05.371517 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:05.371511    2575 scope.go:117] "RemoveContainer" containerID="6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d"
Sep 18 14:04:05.372623 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:05.372593    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:04:05.372683 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:05.372659    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:04:05.372718 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:05.372689    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:04:06.379272 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:06.379235    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" event={"ID":"aa6322e8-c07b-4962-b302-37bbada56363","Type":"ContainerStarted","Data":"02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb"}
Sep 18 14:04:07.196793 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:07.196760    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:04:07.196979 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:07.196943    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 18 14:04:07.197028 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:07.196987    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 18 14:04:08.196436 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:08.196394    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 18 14:04:08.196859 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:08.196453    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 18 14:04:09.196741 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:09.196705    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 18 14:04:09.197175 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:09.196760    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 18 14:04:10.196649 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:10.196614    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 18 14:04:10.196832 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:10.196681    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 18 14:04:11.197209 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:11.197171    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 18 14:04:11.197596 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:11.197243    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 18 14:04:12.200505 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:12.200476    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:04:12.200906 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:12.200743    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:04:12.201471 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:12.201451    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:04:36.327326 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:36.327296    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 14:04:36.328052 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:36.328026    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 14:04:36.486887 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:36.486852    2575 scope.go:117] "RemoveContainer" containerID="2e58473ead340610efbdc4aec3da238e476dafdf368c8ac7fd47390820cd7c76"
Sep 18 14:04:36.496336 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:36.496316    2575 scope.go:117] "RemoveContainer" containerID="30921d6212b53f3b71ed1433f98a0ecc6416825ec0dcd997e0831f1c363c5b5e"
Sep 18 14:04:47.785257 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.785224    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"]
Sep 18 14:04:47.788078 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.788061    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.790851 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.790829    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-783872\"/\"openshift-service-ca.crt\""
Sep 18 14:04:47.792074 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.792052    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-783872\"/\"default-dockercfg-cwdxt\""
Sep 18 14:04:47.792196 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.792124    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-783872\"/\"kube-root-ca.crt\""
Sep 18 14:04:47.792196 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.792126    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-783872\"/\"auth-test-model-783872-kserve-self-signed-certs\""
Sep 18 14:04:47.799793 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.799769    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"]
Sep 18 14:04:47.840661 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.840621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-dshm\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.840838 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.840734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23fc7689-aa84-49d2-b919-bd8369b03740-tls-certs\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.840838 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.840812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-home\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.840970 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.840912    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-model-cache\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.840970 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.840943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvc9l\" (UniqueName: \"kubernetes.io/projected/23fc7689-aa84-49d2-b919-bd8369b03740-kube-api-access-zvc9l\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.841084 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.840980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-tmp-dir\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.941883 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.941848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-home\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.942089 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.941939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-model-cache\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.942089 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.941961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvc9l\" (UniqueName: \"kubernetes.io/projected/23fc7689-aa84-49d2-b919-bd8369b03740-kube-api-access-zvc9l\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.942089 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.942007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-tmp-dir\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.942294 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.942098    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-dshm\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.942294 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.942176    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23fc7689-aa84-49d2-b919-bd8369b03740-tls-certs\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.942415 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.942338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-home\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.942523 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.942499    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-model-cache\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.942809 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.942786    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-tmp-dir\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.944511 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.944487    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-dshm\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.944951 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.944924    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23fc7689-aa84-49d2-b919-bd8369b03740-tls-certs\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:47.951711 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:47.951679    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvc9l\" (UniqueName: \"kubernetes.io/projected/23fc7689-aa84-49d2-b919-bd8369b03740-kube-api-access-zvc9l\") pod \"auth-test-model-783872-kserve-66478d868c-w4pbt\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") " pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:48.099032 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:48.098993    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:48.383351 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:48.383323    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"]
Sep 18 14:04:48.385104 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:04:48.385078    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23fc7689_aa84_49d2_b919_bd8369b03740.slice/crio-d339a26399b733a2adf0176f81879c6cea6177577a30400e513a3bbebae631bc WatchSource:0}: Error finding container d339a26399b733a2adf0176f81879c6cea6177577a30400e513a3bbebae631bc: Status 404 returned error can't find the container with id d339a26399b733a2adf0176f81879c6cea6177577a30400e513a3bbebae631bc
Sep 18 14:04:48.657665 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:48.657560    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt" event={"ID":"23fc7689-aa84-49d2-b919-bd8369b03740","Type":"ContainerStarted","Data":"c61a24ccc922ef18f2bdbafa873ee0afe41038e9583ff9606ae64141e111be75"}
Sep 18 14:04:48.657665 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:48.657605    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt" event={"ID":"23fc7689-aa84-49d2-b919-bd8369b03740","Type":"ContainerStarted","Data":"d339a26399b733a2adf0176f81879c6cea6177577a30400e513a3bbebae631bc"}
Sep 18 14:04:48.677389 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:48.677332    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt" podStartSLOduration=1.6773145999999999 podStartE2EDuration="1.6773146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:04:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:04:48.675835843 +0000 UTC m=+1214.511674559" watchObservedRunningTime="2026-09-18 14:04:48.6773146 +0000 UTC m=+1214.513153371"
Sep 18 14:04:58.099406 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:58.099361    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:58.099781 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:58.099419    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:58.111927 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:58.111900    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:04:58.735505 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:04:58.735474    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:05:32.223674 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:32.223587    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"]
Sep 18 14:05:45.375178 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:45.375145    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"]
Sep 18 14:05:45.378007 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:45.377989    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"
Sep 18 14:05:45.380636 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:45.380612    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:05:45.386345 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:45.386315    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"]
Sep 18 14:05:45.418259 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:45.418221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9a18406-7b22-4e68-97e3-e166e88e8980-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq\" (UID: \"a9a18406-7b22-4e68-97e3-e166e88e8980\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"
Sep 18 14:05:45.520155 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:45.520101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9a18406-7b22-4e68-97e3-e166e88e8980-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq\" (UID: \"a9a18406-7b22-4e68-97e3-e166e88e8980\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"
Sep 18 14:05:45.520769 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:45.520747    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9a18406-7b22-4e68-97e3-e166e88e8980-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq\" (UID: \"a9a18406-7b22-4e68-97e3-e166e88e8980\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"
Sep 18 14:05:45.691309 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:45.691206    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"
Sep 18 14:05:45.967116 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:45.967074    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"]
Sep 18 14:05:45.968808 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:05:45.968783    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a18406_7b22_4e68_97e3_e166e88e8980.slice/crio-7588ef6414658d8e95b02499aac463cd1895762eb7b3df58b1e92ecf631f62b1 WatchSource:0}: Error finding container 7588ef6414658d8e95b02499aac463cd1895762eb7b3df58b1e92ecf631f62b1: Status 404 returned error can't find the container with id 7588ef6414658d8e95b02499aac463cd1895762eb7b3df58b1e92ecf631f62b1
Sep 18 14:05:46.026195 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:46.026160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq" event={"ID":"a9a18406-7b22-4e68-97e3-e166e88e8980","Type":"ContainerStarted","Data":"7588ef6414658d8e95b02499aac463cd1895762eb7b3df58b1e92ecf631f62b1"}
Sep 18 14:05:47.034266 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.034173    2575 generic.go:356] "Generic (PLEG): container finished" podID="a9a18406-7b22-4e68-97e3-e166e88e8980" containerID="4fff6a8c680a78460833547ad4f2ad1c195b54d90fb9e736ccd2e18a7b3a6ed5" exitCode=0
Sep 18 14:05:47.034628 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.034260    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq" event={"ID":"a9a18406-7b22-4e68-97e3-e166e88e8980","Type":"ContainerDied","Data":"4fff6a8c680a78460833547ad4f2ad1c195b54d90fb9e736ccd2e18a7b3a6ed5"}
Sep 18 14:05:47.243898 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.243852    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx" podUID="babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" containerName="main" containerID="cri-o://dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d" gracePeriod=45
Sep 18 14:05:47.500495 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.500470    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:05:47.644523 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.644430    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-dshm\") pod \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") "
Sep 18 14:05:47.644523 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.644481    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwtqf\" (UniqueName: \"kubernetes.io/projected/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-kube-api-access-cwtqf\") pod \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") "
Sep 18 14:05:47.644523 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.644524    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tls-certs\") pod \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") "
Sep 18 14:05:47.644821 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.644540    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tmp-dir\") pod \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") "
Sep 18 14:05:47.644821 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.644556    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-home\") pod \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") "
Sep 18 14:05:47.644821 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.644578    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-model-cache\") pod \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\" (UID: \"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6\") "
Sep 18 14:05:47.644821 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.644807    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" (UID: "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:47.645036 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.644858    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-home" (OuterVolumeSpecName: "home") pod "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" (UID: "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:47.645036 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.644945    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" (UID: "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:47.645189 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.645165    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tmp-dir\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:05:47.645189 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.645184    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-home\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:05:47.645274 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.645196    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-model-cache\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:05:47.646947 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.646915    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-kube-api-access-cwtqf" (OuterVolumeSpecName: "kube-api-access-cwtqf") pod "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" (UID: "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6"). InnerVolumeSpecName "kube-api-access-cwtqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:05:47.647077 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.646959    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-dshm" (OuterVolumeSpecName: "dshm") pod "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" (UID: "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:47.647077 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.647034    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" (UID: "babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:05:47.746778 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.746731    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-dshm\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:05:47.746778 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.746777    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwtqf\" (UniqueName: \"kubernetes.io/projected/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-kube-api-access-cwtqf\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:05:47.746986 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:47.746792    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6-tls-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:05:48.044414 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.044314    2575 generic.go:356] "Generic (PLEG): container finished" podID="babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" containerID="dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d" exitCode=0
Sep 18 14:05:48.044414 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.044354    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"
Sep 18 14:05:48.044972 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.044405    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx" event={"ID":"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6","Type":"ContainerDied","Data":"dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d"}
Sep 18 14:05:48.044972 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.044448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx" event={"ID":"babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6","Type":"ContainerDied","Data":"f5310f0b58ed90ea3cdde4e62283b7ccf73f4cd73b427d068b8789d3d435309c"}
Sep 18 14:05:48.044972 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.044465    2575 scope.go:117] "RemoveContainer" containerID="dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d"
Sep 18 14:05:48.056561 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.056441    2575 scope.go:117] "RemoveContainer" containerID="dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d"
Sep 18 14:05:48.056862 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:05:48.056841    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d\": container with ID starting with dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d not found: ID does not exist" containerID="dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d"
Sep 18 14:05:48.056953 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.056871    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d"} err="failed to get container status \"dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d\": rpc error: code = NotFound desc = could not find container \"dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d\": container with ID starting with dfb2d4d1d40dc590c254e5a74b2cddc019d327f92f4711b473d404800533d67d not found: ID does not exist"
Sep 18 14:05:48.074173 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.072106    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"]
Sep 18 14:05:48.077820 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.077783    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/e2e-conflict-a-d79684ca-kserve-9bc88fd5f-7cpwx"]
Sep 18 14:05:48.182660 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.182636    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"
Sep 18 14:05:48.251510 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.251460    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9a18406-7b22-4e68-97e3-e166e88e8980-maas-api-service-ca\") pod \"a9a18406-7b22-4e68-97e3-e166e88e8980\" (UID: \"a9a18406-7b22-4e68-97e3-e166e88e8980\") "
Sep 18 14:05:48.251902 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.251875    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9a18406-7b22-4e68-97e3-e166e88e8980-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a9a18406-7b22-4e68-97e3-e166e88e8980" (UID: "a9a18406-7b22-4e68-97e3-e166e88e8980"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:05:48.252013 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.252000    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9a18406-7b22-4e68-97e3-e166e88e8980-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:05:48.293683 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:48.293650    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" path="/var/lib/kubelet/pods/babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6/volumes"
Sep 18 14:05:49.053192 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:49.053158    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"
Sep 18 14:05:49.053192 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:49.053172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq" event={"ID":"a9a18406-7b22-4e68-97e3-e166e88e8980","Type":"ContainerDied","Data":"7588ef6414658d8e95b02499aac463cd1895762eb7b3df58b1e92ecf631f62b1"}
Sep 18 14:05:49.053783 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:05:49.053234    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7588ef6414658d8e95b02499aac463cd1895762eb7b3df58b1e92ecf631f62b1"
Sep 18 14:06:00.922180 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:00.922114    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"]
Sep 18 14:06:00.924304 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:00.922373    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz" podUID="58af98e8-eb63-425d-ad32-7658ff838d4e" containerName="payload-processing" containerID="cri-o://cbe6ea42bd1033b510d7cd4e488eef4429ff625e419af6bc3665bd2bbf56a4ff" gracePeriod=30
Sep 18 14:06:00.929058 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:00.929031    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"]
Sep 18 14:06:00.929448 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:00.929403    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt" podUID="7d169ef0-4616-4b5b-bf0e-077bffbf3002" containerName="payload-pre-processing" containerID="cri-o://b219e153bb3df68d3f66e41ee74471319d89e76a12be1fb5f0dbbf8789fd66a0" gracePeriod=30
Sep 18 14:06:01.136103 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.136071    2575 generic.go:356] "Generic (PLEG): container finished" podID="7d169ef0-4616-4b5b-bf0e-077bffbf3002" containerID="b219e153bb3df68d3f66e41ee74471319d89e76a12be1fb5f0dbbf8789fd66a0" exitCode=0
Sep 18 14:06:01.136361 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.136166    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt" event={"ID":"7d169ef0-4616-4b5b-bf0e-077bffbf3002","Type":"ContainerDied","Data":"b219e153bb3df68d3f66e41ee74471319d89e76a12be1fb5f0dbbf8789fd66a0"}
Sep 18 14:06:01.143700 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.143666    2575 generic.go:356] "Generic (PLEG): container finished" podID="58af98e8-eb63-425d-ad32-7658ff838d4e" containerID="cbe6ea42bd1033b510d7cd4e488eef4429ff625e419af6bc3665bd2bbf56a4ff" exitCode=0
Sep 18 14:06:01.143872 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.143842    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz" event={"ID":"58af98e8-eb63-425d-ad32-7658ff838d4e","Type":"ContainerDied","Data":"cbe6ea42bd1033b510d7cd4e488eef4429ff625e419af6bc3665bd2bbf56a4ff"}
Sep 18 14:06:01.202367 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.202339    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:06:01.233299 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.233270    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:06:01.273705 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.273663    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"]
Sep 18 14:06:01.276167 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.276123    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfd52075-bcrpq"]
Sep 18 14:06:01.303752 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.303714    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgw2t\" (UniqueName: \"kubernetes.io/projected/58af98e8-eb63-425d-ad32-7658ff838d4e-kube-api-access-kgw2t\") pod \"58af98e8-eb63-425d-ad32-7658ff838d4e\" (UID: \"58af98e8-eb63-425d-ad32-7658ff838d4e\") "
Sep 18 14:06:01.303960 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.303831    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58af98e8-eb63-425d-ad32-7658ff838d4e-plugins-config-volume\") pod \"58af98e8-eb63-425d-ad32-7658ff838d4e\" (UID: \"58af98e8-eb63-425d-ad32-7658ff838d4e\") "
Sep 18 14:06:01.303960 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.303893    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9pvp\" (UniqueName: \"kubernetes.io/projected/7d169ef0-4616-4b5b-bf0e-077bffbf3002-kube-api-access-h9pvp\") pod \"7d169ef0-4616-4b5b-bf0e-077bffbf3002\" (UID: \"7d169ef0-4616-4b5b-bf0e-077bffbf3002\") "
Sep 18 14:06:01.303960 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.303916    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d169ef0-4616-4b5b-bf0e-077bffbf3002-plugins-config-volume\") pod \"7d169ef0-4616-4b5b-bf0e-077bffbf3002\" (UID: \"7d169ef0-4616-4b5b-bf0e-077bffbf3002\") "
Sep 18 14:06:01.306805 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.304560    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58af98e8-eb63-425d-ad32-7658ff838d4e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "58af98e8-eb63-425d-ad32-7658ff838d4e" (UID: "58af98e8-eb63-425d-ad32-7658ff838d4e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:06:01.306805 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.305290    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d169ef0-4616-4b5b-bf0e-077bffbf3002-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d169ef0-4616-4b5b-bf0e-077bffbf3002" (UID: "7d169ef0-4616-4b5b-bf0e-077bffbf3002"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:06:01.308734 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.308706    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58af98e8-eb63-425d-ad32-7658ff838d4e-kube-api-access-kgw2t" (OuterVolumeSpecName: "kube-api-access-kgw2t") pod "58af98e8-eb63-425d-ad32-7658ff838d4e" (UID: "58af98e8-eb63-425d-ad32-7658ff838d4e"). InnerVolumeSpecName "kube-api-access-kgw2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:06:01.308954 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.308927    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d169ef0-4616-4b5b-bf0e-077bffbf3002-kube-api-access-h9pvp" (OuterVolumeSpecName: "kube-api-access-h9pvp") pod "7d169ef0-4616-4b5b-bf0e-077bffbf3002" (UID: "7d169ef0-4616-4b5b-bf0e-077bffbf3002"). InnerVolumeSpecName "kube-api-access-h9pvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:06:01.405754 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.405717    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58af98e8-eb63-425d-ad32-7658ff838d4e-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:06:01.405754 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.405747    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9pvp\" (UniqueName: \"kubernetes.io/projected/7d169ef0-4616-4b5b-bf0e-077bffbf3002-kube-api-access-h9pvp\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:06:01.405754 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.405757    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d169ef0-4616-4b5b-bf0e-077bffbf3002-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:06:01.405754 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:01.405765    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgw2t\" (UniqueName: \"kubernetes.io/projected/58af98e8-eb63-425d-ad32-7658ff838d4e-kube-api-access-kgw2t\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:06:02.152852 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.152816    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"
Sep 18 14:06:02.152852 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.152848    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt" event={"ID":"7d169ef0-4616-4b5b-bf0e-077bffbf3002","Type":"ContainerDied","Data":"41c5e3b7987a6f371bdf7b10cd744026d5e4f2592272ff774b5e81a194e263b8"}
Sep 18 14:06:02.153400 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.152917    2575 scope.go:117] "RemoveContainer" containerID="b219e153bb3df68d3f66e41ee74471319d89e76a12be1fb5f0dbbf8789fd66a0"
Sep 18 14:06:02.154574 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.154554    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"
Sep 18 14:06:02.154672 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.154570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz" event={"ID":"58af98e8-eb63-425d-ad32-7658ff838d4e","Type":"ContainerDied","Data":"5e5ddda7efae43f42ed42e4840d24375bc78352bac2bff0254ab6cf744da7693"}
Sep 18 14:06:02.163224 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.163200    2575 scope.go:117] "RemoveContainer" containerID="cbe6ea42bd1033b510d7cd4e488eef4429ff625e419af6bc3665bd2bbf56a4ff"
Sep 18 14:06:02.186535 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.186497    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"]
Sep 18 14:06:02.192148 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.192104    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt"]
Sep 18 14:06:02.208071 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.207987    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"]
Sep 18 14:06:02.212146 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.212092    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz"]
Sep 18 14:06:02.294569 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.294535    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58af98e8-eb63-425d-ad32-7658ff838d4e" path="/var/lib/kubelet/pods/58af98e8-eb63-425d-ad32-7658ff838d4e/volumes"
Sep 18 14:06:02.294944 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.294930    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d169ef0-4616-4b5b-bf0e-077bffbf3002" path="/var/lib/kubelet/pods/7d169ef0-4616-4b5b-bf0e-077bffbf3002/volumes"
Sep 18 14:06:02.295285 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:02.295271    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9a18406-7b22-4e68-97e3-e166e88e8980" path="/var/lib/kubelet/pods/a9a18406-7b22-4e68-97e3-e166e88e8980/volumes"
Sep 18 14:06:36.535509 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:36.535471    2575 scope.go:117] "RemoveContainer" containerID="ed3da92e70459d3239111df652d689945ec466cde2ce4bf225d9a29b481cba1c"
Sep 18 14:06:36.545561 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:36.545541    2575 scope.go:117] "RemoveContainer" containerID="622cb43ad75fc0bd877031903914a23df635dab11bbdcf65e5f1537b69902777"
Sep 18 14:06:39.605265 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.605230    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"]
Sep 18 14:06:39.606034 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606017    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d169ef0-4616-4b5b-bf0e-077bffbf3002" containerName="payload-pre-processing"
Sep 18 14:06:39.606105 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606037    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d169ef0-4616-4b5b-bf0e-077bffbf3002" containerName="payload-pre-processing"
Sep 18 14:06:39.606105 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606074    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58af98e8-eb63-425d-ad32-7658ff838d4e" containerName="payload-processing"
Sep 18 14:06:39.606105 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606084    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="58af98e8-eb63-425d-ad32-7658ff838d4e" containerName="payload-processing"
Sep 18 14:06:39.606105 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606103    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" containerName="main"
Sep 18 14:06:39.606278 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606112    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" containerName="main"
Sep 18 14:06:39.606278 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606123    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9a18406-7b22-4e68-97e3-e166e88e8980" containerName="revoke-keys"
Sep 18 14:06:39.606278 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606146    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9a18406-7b22-4e68-97e3-e166e88e8980" containerName="revoke-keys"
Sep 18 14:06:39.606278 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606268    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9a18406-7b22-4e68-97e3-e166e88e8980" containerName="revoke-keys"
Sep 18 14:06:39.606399 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606283    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="babc8bc3-f3d4-42e3-aee5-bbbbbf70e7f6" containerName="main"
Sep 18 14:06:39.606399 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606297    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d169ef0-4616-4b5b-bf0e-077bffbf3002" containerName="payload-pre-processing"
Sep 18 14:06:39.606399 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.606308    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="58af98e8-eb63-425d-ad32-7658ff838d4e" containerName="payload-processing"
Sep 18 14:06:39.610230 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.610211    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.614380 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.614310    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-377ca2\"/\"default-dockercfg-zzxlh\""
Sep 18 14:06:39.614552 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.614338    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-377ca2\"/\"distinct-2-w4-377ca2-kserve-self-signed-certs\""
Sep 18 14:06:39.614667 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.614339    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-377ca2\"/\"openshift-service-ca.crt\""
Sep 18 14:06:39.614756 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.614347    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-377ca2\"/\"kube-root-ca.crt\""
Sep 18 14:06:39.621160 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.621124    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"]
Sep 18 14:06:39.731642 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.731606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-home\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.731819 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.731653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-dshm\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.731819 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.731690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-model-cache\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.731819 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.731729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tmp-dir\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.731939 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.731827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tls-certs\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.731939 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.731863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m55gx\" (UniqueName: \"kubernetes.io/projected/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-kube-api-access-m55gx\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.832648 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.832605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-home\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.832648 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.832654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-dshm\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.832875 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.832683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-model-cache\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.832875 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.832699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tmp-dir\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.832875 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.832769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tls-certs\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.832875 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.832809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m55gx\" (UniqueName: \"kubernetes.io/projected/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-kube-api-access-m55gx\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.833102 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.833077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-home\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.833234 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.833211    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-model-cache\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.833285 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.833219    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tmp-dir\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.835332 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.835301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-dshm\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.835511 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.835491    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tls-certs\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.841696 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.841664    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m55gx\" (UniqueName: \"kubernetes.io/projected/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-kube-api-access-m55gx\") pod \"distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") " pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:39.922897 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:39.922804    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:40.197253 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:40.197227    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"]
Sep 18 14:06:40.199357 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:06:40.199327    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d6b44e5_ae6d_4382_a015_88c24edfc2bd.slice/crio-9bf7f1f33f153de0bbb737427044f7b3d7993b83db25b4798481cd77442c3bdb WatchSource:0}: Error finding container 9bf7f1f33f153de0bbb737427044f7b3d7993b83db25b4798481cd77442c3bdb: Status 404 returned error can't find the container with id 9bf7f1f33f153de0bbb737427044f7b3d7993b83db25b4798481cd77442c3bdb
Sep 18 14:06:40.401383 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:40.401342    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v" event={"ID":"0d6b44e5-ae6d-4382-a015-88c24edfc2bd","Type":"ContainerStarted","Data":"cedcd146a2045a15d58ab45bbf3b48da233d90acd5b3912156ba5b26fb979032"}
Sep 18 14:06:40.401560 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:40.401395    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v" event={"ID":"0d6b44e5-ae6d-4382-a015-88c24edfc2bd","Type":"ContainerStarted","Data":"9bf7f1f33f153de0bbb737427044f7b3d7993b83db25b4798481cd77442c3bdb"}
Sep 18 14:06:40.422164 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:40.422100    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v" podStartSLOduration=1.422079956 podStartE2EDuration="1.422079956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:06:40.42062582 +0000 UTC m=+1326.256464530" watchObservedRunningTime="2026-09-18 14:06:40.422079956 +0000 UTC m=+1326.257918669"
Sep 18 14:06:49.924033 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:49.923941    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:49.924033 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:49.923998    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:49.937183 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:49.937156    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:06:50.476831 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:06:50.476805    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:07:16.584678 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.584645    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"]
Sep 18 14:07:16.588517 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.588497    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.591416 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.591398    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ed4c53\"/\"embedding-w0-ed4c53-kserve-self-signed-certs\""
Sep 18 14:07:16.600252 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.600229    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"]
Sep 18 14:07:16.734718 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.734672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-home\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.734897 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.734726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b99b0ec9-e29c-48af-969e-8439f4810556-tls-certs\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.734897 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.734850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-tmp-dir\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.734995 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.734918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-dshm\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.734995 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.734957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-model-cache\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.734995 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.734979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46q5x\" (UniqueName: \"kubernetes.io/projected/b99b0ec9-e29c-48af-969e-8439f4810556-kube-api-access-46q5x\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.836545 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.836458    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-home\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.836545 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.836498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b99b0ec9-e29c-48af-969e-8439f4810556-tls-certs\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.836545 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.836545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-tmp-dir\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.836841 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.836598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-dshm\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.836841 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.836634    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-model-cache\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.836841 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.836658    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46q5x\" (UniqueName: \"kubernetes.io/projected/b99b0ec9-e29c-48af-969e-8439f4810556-kube-api-access-46q5x\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.837065 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.836990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-home\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.837280 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.837256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-model-cache\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.837561 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.837541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-tmp-dir\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.839123 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.839093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b99b0ec9-e29c-48af-969e-8439f4810556-tls-certs\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.839541 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.839507    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-dshm\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.845737 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.845715    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46q5x\" (UniqueName: \"kubernetes.io/projected/b99b0ec9-e29c-48af-969e-8439f4810556-kube-api-access-46q5x\") pod \"embedding-w0-ed4c53-kserve-f84cf58dd-twcs5\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") " pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:16.899097 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:16.899066    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:17.179409 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:17.179381    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"]
Sep 18 14:07:17.181446 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:07:17.181419    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb99b0ec9_e29c_48af_969e_8439f4810556.slice/crio-8de85f932b216501b4fb02ea59b1aed407d4dfa5e33e6e9db7e598d49fb323e9 WatchSource:0}: Error finding container 8de85f932b216501b4fb02ea59b1aed407d4dfa5e33e6e9db7e598d49fb323e9: Status 404 returned error can't find the container with id 8de85f932b216501b4fb02ea59b1aed407d4dfa5e33e6e9db7e598d49fb323e9
Sep 18 14:07:17.634114 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:17.634083    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5" event={"ID":"b99b0ec9-e29c-48af-969e-8439f4810556","Type":"ContainerStarted","Data":"0453f77424da400df7f6dafb73fcdd76c920a2a064b9cc63b438458106b360f9"}
Sep 18 14:07:17.634562 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:17.634152    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5" event={"ID":"b99b0ec9-e29c-48af-969e-8439f4810556","Type":"ContainerStarted","Data":"8de85f932b216501b4fb02ea59b1aed407d4dfa5e33e6e9db7e598d49fb323e9"}
Sep 18 14:07:17.654768 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:17.654711    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5" podStartSLOduration=1.6546938629999999 podStartE2EDuration="1.654693863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:07:17.653233159 +0000 UTC m=+1363.489071872" watchObservedRunningTime="2026-09-18 14:07:17.654693863 +0000 UTC m=+1363.490532616"
Sep 18 14:07:26.367729 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:26.367693    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"]
Sep 18 14:07:26.368248 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:26.367915    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy" containerID="cri-o://1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9" gracePeriod=30
Sep 18 14:07:26.899989 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:26.899952    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:26.900199 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:26.900030    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:26.912618 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:26.912590    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:27.707064 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:27.707028    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:07:31.634473 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.634394    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:07:31.705826 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.705787    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-credential-socket\") pod \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") "
Sep 18 14:07:31.706027 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.705848    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vcnb\" (UniqueName: \"kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-kube-api-access-9vcnb\") pod \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") "
Sep 18 14:07:31.706027 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.705870    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-token\") pod \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") "
Sep 18 14:07:31.706027 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.705929    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-podinfo\") pod \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") "
Sep 18 14:07:31.706236 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706108    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-certs\") pod \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") "
Sep 18 14:07:31.706236 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706169    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a0b489d-b64b-44d8-a5d0-639e90b22c86" (UID: "5a0b489d-b64b-44d8-a5d0-639e90b22c86"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:07:31.706308 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706276    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istiod-ca-cert\") pod \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") "
Sep 18 14:07:31.706364 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706344    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-data\") pod \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") "
Sep 18 14:07:31.706419 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706372    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-envoy\") pod \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") "
Sep 18 14:07:31.706419 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706386    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a0b489d-b64b-44d8-a5d0-639e90b22c86" (UID: "5a0b489d-b64b-44d8-a5d0-639e90b22c86"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:07:31.706527 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706418    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-socket\") pod \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\" (UID: \"5a0b489d-b64b-44d8-a5d0-639e90b22c86\") "
Sep 18 14:07:31.706644 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706620    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a0b489d-b64b-44d8-a5d0-639e90b22c86" (UID: "5a0b489d-b64b-44d8-a5d0-639e90b22c86"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:07:31.706753 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706724    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a0b489d-b64b-44d8-a5d0-639e90b22c86" (UID: "5a0b489d-b64b-44d8-a5d0-639e90b22c86"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:07:31.706820 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706744    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a0b489d-b64b-44d8-a5d0-639e90b22c86" (UID: "5a0b489d-b64b-44d8-a5d0-639e90b22c86"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:07:31.706970 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706949    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:07:31.707024 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706976    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-credential-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:07:31.707024 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.706990    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-workload-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:07:31.707024 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.707004    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istiod-ca-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:07:31.707024 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.707016    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-data\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:07:31.708280 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.708245    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a0b489d-b64b-44d8-a5d0-639e90b22c86" (UID: "5a0b489d-b64b-44d8-a5d0-639e90b22c86"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:07:31.708582 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.708558    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a0b489d-b64b-44d8-a5d0-639e90b22c86" (UID: "5a0b489d-b64b-44d8-a5d0-639e90b22c86"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:07:31.708582 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.708563    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-kube-api-access-9vcnb" (OuterVolumeSpecName: "kube-api-access-9vcnb") pod "5a0b489d-b64b-44d8-a5d0-639e90b22c86" (UID: "5a0b489d-b64b-44d8-a5d0-639e90b22c86"). InnerVolumeSpecName "kube-api-access-9vcnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:07:31.708718 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.708602    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a0b489d-b64b-44d8-a5d0-639e90b22c86" (UID: "5a0b489d-b64b-44d8-a5d0-639e90b22c86"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:07:31.722928 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.722901    2575 generic.go:356] "Generic (PLEG): container finished" podID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerID="1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9" exitCode=0
Sep 18 14:07:31.723067 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.722967    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"
Sep 18 14:07:31.723067 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.723006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" event={"ID":"5a0b489d-b64b-44d8-a5d0-639e90b22c86","Type":"ContainerDied","Data":"1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9"}
Sep 18 14:07:31.723216 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.723079    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h" event={"ID":"5a0b489d-b64b-44d8-a5d0-639e90b22c86","Type":"ContainerDied","Data":"219e4a05f06fb658b155e8ef552be644541856c2b2c94c961b660b009280774c"}
Sep 18 14:07:31.723216 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.723121    2575 scope.go:117] "RemoveContainer" containerID="1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9"
Sep 18 14:07:31.733981 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.733958    2575 scope.go:117] "RemoveContainer" containerID="2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1"
Sep 18 14:07:31.743349 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.743329    2575 scope.go:117] "RemoveContainer" containerID="1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9"
Sep 18 14:07:31.743703 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:07:31.743683    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9\": container with ID starting with 1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9 not found: ID does not exist" containerID="1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9"
Sep 18 14:07:31.743801 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.743708    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9"} err="failed to get container status \"1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9\": rpc error: code = NotFound desc = could not find container \"1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9\": container with ID starting with 1be81af69d64baaed6c1e299f1b962ecebd9756e78d3b9184de535bf41fdd6c9 not found: ID does not exist"
Sep 18 14:07:31.743801 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.743726    2575 scope.go:117] "RemoveContainer" containerID="2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1"
Sep 18 14:07:31.744023 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:07:31.744002    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1\": container with ID starting with 2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1 not found: ID does not exist" containerID="2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1"
Sep 18 14:07:31.744064 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.744029    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1"} err="failed to get container status \"2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1\": rpc error: code = NotFound desc = could not find container \"2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1\": container with ID starting with 2c6b844e43a11e19f9eb86ec12f67555e1f7fcfd928a1dbd992b84e416b32fd1 not found: ID does not exist"
Sep 18 14:07:31.747586 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.747562    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"]
Sep 18 14:07:31.752338 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.752314    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h"]
Sep 18 14:07:31.808280 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.808245    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-envoy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:07:31.808280 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.808277    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vcnb\" (UniqueName: \"kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-kube-api-access-9vcnb\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:07:31.808280 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.808288    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-token\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:07:31.808554 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:31.808298    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a0b489d-b64b-44d8-a5d0-639e90b22c86-istio-podinfo\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:07:32.295237 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:32.295198    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" path="/var/lib/kubelet/pods/5a0b489d-b64b-44d8-a5d0-639e90b22c86/volumes"
Sep 18 14:07:36.584295 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:36.584262    2575 scope.go:117] "RemoveContainer" containerID="0663ade68f92609fc19a1a27763f60c40d35cde63c6978cf19aad84f9b98f910"
Sep 18 14:07:36.593251 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:07:36.593232    2575 scope.go:117] "RemoveContainer" containerID="e2190411aa408aafd23b4b5626ece6c6c1cbc010b2e8f356dde8ac25e15b082b"
Sep 18 14:08:05.857352 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:05.857312    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"]
Sep 18 14:08:05.857835 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:05.857805    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy"
Sep 18 14:08:05.857835 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:05.857816    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy"
Sep 18 14:08:05.857835 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:05.857825    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy"
Sep 18 14:08:05.857835 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:05.857831    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy"
Sep 18 14:08:05.857977 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:05.857922    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy"
Sep 18 14:08:05.857977 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:05.857931    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a0b489d-b64b-44d8-a5d0-639e90b22c86" containerName="istio-proxy"
Sep 18 14:08:05.861087 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:05.861072    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"
Sep 18 14:08:05.864610 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:05.864588    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:08:05.873246 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:05.873221    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"]
Sep 18 14:08:05.988497 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:05.988465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e65135d-0769-4533-a79f-30e46e46afe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs\" (UID: \"1e65135d-0769-4533-a79f-30e46e46afe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"
Sep 18 14:08:06.090334 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:06.090292    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e65135d-0769-4533-a79f-30e46e46afe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs\" (UID: \"1e65135d-0769-4533-a79f-30e46e46afe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"
Sep 18 14:08:06.090924 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:06.090903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e65135d-0769-4533-a79f-30e46e46afe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs\" (UID: \"1e65135d-0769-4533-a79f-30e46e46afe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"
Sep 18 14:08:06.172935 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:06.172854    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"
Sep 18 14:08:06.448297 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:06.448207    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"]
Sep 18 14:08:06.451966 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:08:06.451938    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e65135d_0769_4533_a79f_30e46e46afe9.slice/crio-ab1fc65dfa6217fd8bf2cc21647108dcddc472d20a21ac067a0ba3afe1e318a1 WatchSource:0}: Error finding container ab1fc65dfa6217fd8bf2cc21647108dcddc472d20a21ac067a0ba3afe1e318a1: Status 404 returned error can't find the container with id ab1fc65dfa6217fd8bf2cc21647108dcddc472d20a21ac067a0ba3afe1e318a1
Sep 18 14:08:06.942259 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:06.942221    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs" event={"ID":"1e65135d-0769-4533-a79f-30e46e46afe9","Type":"ContainerStarted","Data":"6a920c780dec15b0f28c9bf842ba15c06feeb675b8fca70975652e24b0ef244a"}
Sep 18 14:08:06.942703 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:06.942286    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs" event={"ID":"1e65135d-0769-4533-a79f-30e46e46afe9","Type":"ContainerStarted","Data":"ab1fc65dfa6217fd8bf2cc21647108dcddc472d20a21ac067a0ba3afe1e318a1"}
Sep 18 14:08:06.963413 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:06.963341    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs" podStartSLOduration=1.963318908 podStartE2EDuration="1.963318908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:08:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:08:06.958501365 +0000 UTC m=+1412.794340082" watchObservedRunningTime="2026-09-18 14:08:06.963318908 +0000 UTC m=+1412.799157622"
Sep 18 14:08:07.949691 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:07.949654    2575 generic.go:356] "Generic (PLEG): container finished" podID="1e65135d-0769-4533-a79f-30e46e46afe9" containerID="6a920c780dec15b0f28c9bf842ba15c06feeb675b8fca70975652e24b0ef244a" exitCode=0
Sep 18 14:08:07.950113 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:07.949741    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs" event={"ID":"1e65135d-0769-4533-a79f-30e46e46afe9","Type":"ContainerDied","Data":"6a920c780dec15b0f28c9bf842ba15c06feeb675b8fca70975652e24b0ef244a"}
Sep 18 14:08:09.104077 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:09.104054    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"
Sep 18 14:08:09.225622 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:09.225527    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e65135d-0769-4533-a79f-30e46e46afe9-maas-api-service-ca\") pod \"1e65135d-0769-4533-a79f-30e46e46afe9\" (UID: \"1e65135d-0769-4533-a79f-30e46e46afe9\") "
Sep 18 14:08:09.225877 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:09.225853    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e65135d-0769-4533-a79f-30e46e46afe9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e65135d-0769-4533-a79f-30e46e46afe9" (UID: "1e65135d-0769-4533-a79f-30e46e46afe9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:08:09.226020 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:09.226007    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e65135d-0769-4533-a79f-30e46e46afe9-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:09.963327 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:09.963291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs" event={"ID":"1e65135d-0769-4533-a79f-30e46e46afe9","Type":"ContainerDied","Data":"ab1fc65dfa6217fd8bf2cc21647108dcddc472d20a21ac067a0ba3afe1e318a1"}
Sep 18 14:08:09.963518 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:09.963335    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"
Sep 18 14:08:09.963518 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:09.963341    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab1fc65dfa6217fd8bf2cc21647108dcddc472d20a21ac067a0ba3afe1e318a1"
Sep 18 14:08:10.747964 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:10.747929    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"]
Sep 18 14:08:10.769316 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:10.769264    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"]
Sep 18 14:08:21.521913 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.521826    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb"]
Sep 18 14:08:21.524364 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.524339    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ed4c53-29829000-lpljb"]
Sep 18 14:08:21.572542 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.572494    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"]
Sep 18 14:08:21.573682 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.573648    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx" podUID="e9cc6192-28df-4e67-9d76-0f95f54d09a2" containerName="payload-processing" containerID="cri-o://0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de" gracePeriod=30
Sep 18 14:08:21.709532 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.708993    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"]
Sep 18 14:08:21.709771 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.709746    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e65135d-0769-4533-a79f-30e46e46afe9" containerName="revoke-keys"
Sep 18 14:08:21.709856 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.709778    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e65135d-0769-4533-a79f-30e46e46afe9" containerName="revoke-keys"
Sep 18 14:08:21.709959 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.709943    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e65135d-0769-4533-a79f-30e46e46afe9" containerName="revoke-keys"
Sep 18 14:08:21.713783 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.713759    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.717278 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.717254    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ca1331-openshift-default-dockercfg-rvmpd\""
Sep 18 14:08:21.727238 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.727213    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"]
Sep 18 14:08:21.777413 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.777330    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"]
Sep 18 14:08:21.779716 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.779678    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ed4c53-92cjs"]
Sep 18 14:08:21.867192 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.867158    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-socket\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.867343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.867231    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-podinfo\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.867343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.867263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-credential-socket\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.867343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.867295    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-data\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.867343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.867326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-certs\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.867502 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.867418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q96bs\" (UniqueName: \"kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-kube-api-access-q96bs\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.867502 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.867460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-envoy\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.867502 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.867485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d10805f-2250-4f05-97d5-57a8ef96ca75-istiod-ca-cert\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.867625 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.867513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-token\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.873895 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.873873    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 14:08:21.968559 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.968525    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9cc6192-28df-4e67-9d76-0f95f54d09a2-plugins-config-volume\") pod \"e9cc6192-28df-4e67-9d76-0f95f54d09a2\" (UID: \"e9cc6192-28df-4e67-9d76-0f95f54d09a2\") "
Sep 18 14:08:21.968747 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.968719    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhwbs\" (UniqueName: \"kubernetes.io/projected/e9cc6192-28df-4e67-9d76-0f95f54d09a2-kube-api-access-nhwbs\") pod \"e9cc6192-28df-4e67-9d76-0f95f54d09a2\" (UID: \"e9cc6192-28df-4e67-9d76-0f95f54d09a2\") "
Sep 18 14:08:21.968876 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.968853    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9cc6192-28df-4e67-9d76-0f95f54d09a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e9cc6192-28df-4e67-9d76-0f95f54d09a2" (UID: "e9cc6192-28df-4e67-9d76-0f95f54d09a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:08:21.968995 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.968977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-socket\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.969063 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.969038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-podinfo\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.969126 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.969070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-credential-socket\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.969126 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.969105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-data\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.969281 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.969169    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-certs\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.969281 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.969257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q96bs\" (UniqueName: \"kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-kube-api-access-q96bs\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.969390 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.969301    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-envoy\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.969390 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.969330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d10805f-2250-4f05-97d5-57a8ef96ca75-istiod-ca-cert\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.969390 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.969361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-token\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.969541 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.969418    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-socket\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.969596 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.969560    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9cc6192-28df-4e67-9d76-0f95f54d09a2-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:21.969936 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.969912    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-data\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.970050 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.970031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-credential-socket\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.970105 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.970047    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-certs\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.970405 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.970385    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d10805f-2250-4f05-97d5-57a8ef96ca75-istiod-ca-cert\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.971038 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.971015    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9cc6192-28df-4e67-9d76-0f95f54d09a2-kube-api-access-nhwbs" (OuterVolumeSpecName: "kube-api-access-nhwbs") pod "e9cc6192-28df-4e67-9d76-0f95f54d09a2" (UID: "e9cc6192-28df-4e67-9d76-0f95f54d09a2"). InnerVolumeSpecName "kube-api-access-nhwbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:08:21.971677 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.971660    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-podinfo\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.971917 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.971898    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-envoy\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.977467 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.977443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-token\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:21.977754 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:21.977736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q96bs\" (UniqueName: \"kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-kube-api-access-q96bs\") pod \"e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") " pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:22.027942 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.027874    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:22.043207 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.043179    2575 generic.go:356] "Generic (PLEG): container finished" podID="e9cc6192-28df-4e67-9d76-0f95f54d09a2" containerID="0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de" exitCode=0
Sep 18 14:08:22.043333 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.043229    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx" event={"ID":"e9cc6192-28df-4e67-9d76-0f95f54d09a2","Type":"ContainerDied","Data":"0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de"}
Sep 18 14:08:22.043333 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.043239    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"
Sep 18 14:08:22.043333 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.043303    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx" event={"ID":"e9cc6192-28df-4e67-9d76-0f95f54d09a2","Type":"ContainerDied","Data":"7713c90c4a8e6858a85bf195de39719a023d2bc84480ce6b6771024549e2de7d"}
Sep 18 14:08:22.043333 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.043328    2575 scope.go:117] "RemoveContainer" containerID="0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de"
Sep 18 14:08:22.053210 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.053102    2575 scope.go:117] "RemoveContainer" containerID="0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de"
Sep 18 14:08:22.053538 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:08:22.053508    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de\": container with ID starting with 0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de not found: ID does not exist" containerID="0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de"
Sep 18 14:08:22.053632 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.053549    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de"} err="failed to get container status \"0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de\": rpc error: code = NotFound desc = could not find container \"0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de\": container with ID starting with 0373192c912f37dbaf6e8f2cd8faaf5903ee2c4dbf6022d8217982a7644647de not found: ID does not exist"
Sep 18 14:08:22.070657 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.070624    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhwbs\" (UniqueName: \"kubernetes.io/projected/e9cc6192-28df-4e67-9d76-0f95f54d09a2-kube-api-access-nhwbs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:22.071846 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.071826    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"]
Sep 18 14:08:22.078549 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.078522    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx"]
Sep 18 14:08:22.293531 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.293454    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="124b7dc7-61d6-435b-8e90-d74809c8721b" path="/var/lib/kubelet/pods/124b7dc7-61d6-435b-8e90-d74809c8721b/volumes"
Sep 18 14:08:22.293835 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.293820    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e65135d-0769-4533-a79f-30e46e46afe9" path="/var/lib/kubelet/pods/1e65135d-0769-4533-a79f-30e46e46afe9/volumes"
Sep 18 14:08:22.294254 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.294238    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9cc6192-28df-4e67-9d76-0f95f54d09a2" path="/var/lib/kubelet/pods/e9cc6192-28df-4e67-9d76-0f95f54d09a2/volumes"
Sep 18 14:08:22.315637 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.315614    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"]
Sep 18 14:08:22.317084 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:08:22.317061    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d10805f_2250_4f05_97d5_57a8ef96ca75.slice/crio-17317cb6e6b0fde640e6076cb80e350abc069d7d9e539db321def6fef867bfb7 WatchSource:0}: Error finding container 17317cb6e6b0fde640e6076cb80e350abc069d7d9e539db321def6fef867bfb7: Status 404 returned error can't find the container with id 17317cb6e6b0fde640e6076cb80e350abc069d7d9e539db321def6fef867bfb7
Sep 18 14:08:22.319905 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.319862    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:08:22.320035 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.319954    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:08:22.320035 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:22.320007    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:08:23.052438 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:23.052397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" event={"ID":"0d10805f-2250-4f05-97d5-57a8ef96ca75","Type":"ContainerStarted","Data":"be20aa9aafaf9bb82f75d266e07e6292ab00e7496bb19d82cc624e9d55dff292"}
Sep 18 14:08:23.052974 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:23.052459    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" event={"ID":"0d10805f-2250-4f05-97d5-57a8ef96ca75","Type":"ContainerStarted","Data":"17317cb6e6b0fde640e6076cb80e350abc069d7d9e539db321def6fef867bfb7"}
Sep 18 14:08:23.072820 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:23.072775    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" podStartSLOduration=2.072758298 podStartE2EDuration="2.072758298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:08:23.071414448 +0000 UTC m=+1428.907253171" watchObservedRunningTime="2026-09-18 14:08:23.072758298 +0000 UTC m=+1428.908597009"
Sep 18 14:08:24.028967 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:24.028930    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:24.034539 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:24.034508    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:24.060162 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:24.060123    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:24.061066 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:24.061047    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:25.773411 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:25.773368    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv" podUID="776d4836-0ba5-4b02-8dbf-af5d30f94e06" containerName="main" containerID="cri-o://f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7" gracePeriod=45
Sep 18 14:08:25.792126 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:25.792088    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5" podUID="b99b0ec9-e29c-48af-969e-8439f4810556" containerName="main" containerID="cri-o://0453f77424da400df7f6dafb73fcdd76c920a2a064b9cc63b438458106b360f9" gracePeriod=45
Sep 18 14:08:26.052176 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.052151    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:08:26.075091 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.074954    2575 generic.go:356] "Generic (PLEG): container finished" podID="b99b0ec9-e29c-48af-969e-8439f4810556" containerID="0453f77424da400df7f6dafb73fcdd76c920a2a064b9cc63b438458106b360f9" exitCode=0
Sep 18 14:08:26.075091 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.075013    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5" event={"ID":"b99b0ec9-e29c-48af-969e-8439f4810556","Type":"ContainerDied","Data":"0453f77424da400df7f6dafb73fcdd76c920a2a064b9cc63b438458106b360f9"}
Sep 18 14:08:26.075479 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.075177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5" event={"ID":"b99b0ec9-e29c-48af-969e-8439f4810556","Type":"ContainerDied","Data":"8de85f932b216501b4fb02ea59b1aed407d4dfa5e33e6e9db7e598d49fb323e9"}
Sep 18 14:08:26.075479 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.075209    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8de85f932b216501b4fb02ea59b1aed407d4dfa5e33e6e9db7e598d49fb323e9"
Sep 18 14:08:26.081488 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.077772    2575 generic.go:356] "Generic (PLEG): container finished" podID="776d4836-0ba5-4b02-8dbf-af5d30f94e06" containerID="f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7" exitCode=0
Sep 18 14:08:26.081488 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.077960    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv" event={"ID":"776d4836-0ba5-4b02-8dbf-af5d30f94e06","Type":"ContainerDied","Data":"f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7"}
Sep 18 14:08:26.081488 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.078194    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv" event={"ID":"776d4836-0ba5-4b02-8dbf-af5d30f94e06","Type":"ContainerDied","Data":"69ab8233f1315e81709ba32a6d06a1a3f8844583ec2c2690341320841db05412"}
Sep 18 14:08:26.081488 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.078226    2575 scope.go:117] "RemoveContainer" containerID="f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7"
Sep 18 14:08:26.081488 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.078393    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"
Sep 18 14:08:26.088171 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.088146    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:08:26.095501 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.095479    2575 scope.go:117] "RemoveContainer" containerID="f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7"
Sep 18 14:08:26.097321 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:08:26.097249    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7\": container with ID starting with f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7 not found: ID does not exist" containerID="f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7"
Sep 18 14:08:26.097321 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.097286    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7"} err="failed to get container status \"f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7\": rpc error: code = NotFound desc = could not find container \"f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7\": container with ID starting with f420e17b8b6aac445198969e531bd4cf5c92d2840730daf40bb730bea5ff35d7 not found: ID does not exist"
Sep 18 14:08:26.115673 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.115639    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-dshm\") pod \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") "
Sep 18 14:08:26.115944 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.115708    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-model-cache\") pod \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") "
Sep 18 14:08:26.116463 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.116389    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-model-cache" (OuterVolumeSpecName: "model-cache") pod "776d4836-0ba5-4b02-8dbf-af5d30f94e06" (UID: "776d4836-0ba5-4b02-8dbf-af5d30f94e06"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:26.116882 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.116602    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tls-certs\") pod \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") "
Sep 18 14:08:26.116882 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.116715    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b99b0ec9-e29c-48af-969e-8439f4810556-tls-certs\") pod \"b99b0ec9-e29c-48af-969e-8439f4810556\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") "
Sep 18 14:08:26.116882 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.116777    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-home\") pod \"b99b0ec9-e29c-48af-969e-8439f4810556\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") "
Sep 18 14:08:26.116882 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.116802    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-dshm\") pod \"b99b0ec9-e29c-48af-969e-8439f4810556\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") "
Sep 18 14:08:26.116882 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.116855    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-tmp-dir\") pod \"b99b0ec9-e29c-48af-969e-8439f4810556\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") "
Sep 18 14:08:26.117330 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.116919    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-home\") pod \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") "
Sep 18 14:08:26.117330 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.116957    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvrrz\" (UniqueName: \"kubernetes.io/projected/776d4836-0ba5-4b02-8dbf-af5d30f94e06-kube-api-access-rvrrz\") pod \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") "
Sep 18 14:08:26.117330 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.117004    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-model-cache\") pod \"b99b0ec9-e29c-48af-969e-8439f4810556\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") "
Sep 18 14:08:26.117330 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.117063    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46q5x\" (UniqueName: \"kubernetes.io/projected/b99b0ec9-e29c-48af-969e-8439f4810556-kube-api-access-46q5x\") pod \"b99b0ec9-e29c-48af-969e-8439f4810556\" (UID: \"b99b0ec9-e29c-48af-969e-8439f4810556\") "
Sep 18 14:08:26.117330 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.117109    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tmp-dir\") pod \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\" (UID: \"776d4836-0ba5-4b02-8dbf-af5d30f94e06\") "
Sep 18 14:08:26.117748 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.117729    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-model-cache\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.118452 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.118397    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-model-cache" (OuterVolumeSpecName: "model-cache") pod "b99b0ec9-e29c-48af-969e-8439f4810556" (UID: "b99b0ec9-e29c-48af-969e-8439f4810556"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:26.119280 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.119185    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "776d4836-0ba5-4b02-8dbf-af5d30f94e06" (UID: "776d4836-0ba5-4b02-8dbf-af5d30f94e06"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:26.119724 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.119683    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b99b0ec9-e29c-48af-969e-8439f4810556" (UID: "b99b0ec9-e29c-48af-969e-8439f4810556"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:26.120045 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.119815    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-dshm" (OuterVolumeSpecName: "dshm") pod "776d4836-0ba5-4b02-8dbf-af5d30f94e06" (UID: "776d4836-0ba5-4b02-8dbf-af5d30f94e06"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:26.120045 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.119935    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-home" (OuterVolumeSpecName: "home") pod "b99b0ec9-e29c-48af-969e-8439f4810556" (UID: "b99b0ec9-e29c-48af-969e-8439f4810556"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:26.120045 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.120020    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-home" (OuterVolumeSpecName: "home") pod "776d4836-0ba5-4b02-8dbf-af5d30f94e06" (UID: "776d4836-0ba5-4b02-8dbf-af5d30f94e06"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:26.122713 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.122676    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "776d4836-0ba5-4b02-8dbf-af5d30f94e06" (UID: "776d4836-0ba5-4b02-8dbf-af5d30f94e06"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:08:26.122952 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.122927    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-dshm" (OuterVolumeSpecName: "dshm") pod "b99b0ec9-e29c-48af-969e-8439f4810556" (UID: "b99b0ec9-e29c-48af-969e-8439f4810556"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:26.123173 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.123118    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99b0ec9-e29c-48af-969e-8439f4810556-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b99b0ec9-e29c-48af-969e-8439f4810556" (UID: "b99b0ec9-e29c-48af-969e-8439f4810556"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:08:26.123342 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.123321    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b99b0ec9-e29c-48af-969e-8439f4810556-kube-api-access-46q5x" (OuterVolumeSpecName: "kube-api-access-46q5x") pod "b99b0ec9-e29c-48af-969e-8439f4810556" (UID: "b99b0ec9-e29c-48af-969e-8439f4810556"). InnerVolumeSpecName "kube-api-access-46q5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:08:26.124782 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.124757    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/776d4836-0ba5-4b02-8dbf-af5d30f94e06-kube-api-access-rvrrz" (OuterVolumeSpecName: "kube-api-access-rvrrz") pod "776d4836-0ba5-4b02-8dbf-af5d30f94e06" (UID: "776d4836-0ba5-4b02-8dbf-af5d30f94e06"). InnerVolumeSpecName "kube-api-access-rvrrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:08:26.218780 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.218745    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-tmp-dir\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.218780 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.218777    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-home\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.219043 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.218792    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvrrz\" (UniqueName: \"kubernetes.io/projected/776d4836-0ba5-4b02-8dbf-af5d30f94e06-kube-api-access-rvrrz\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.219043 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.218804    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-model-cache\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.219043 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.218813    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46q5x\" (UniqueName: \"kubernetes.io/projected/b99b0ec9-e29c-48af-969e-8439f4810556-kube-api-access-46q5x\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.219043 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.218822    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tmp-dir\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.219043 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.218830    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/776d4836-0ba5-4b02-8dbf-af5d30f94e06-dshm\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.219043 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.218837    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/776d4836-0ba5-4b02-8dbf-af5d30f94e06-tls-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.219043 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.218844    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b99b0ec9-e29c-48af-969e-8439f4810556-tls-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.219043 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.218850    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-home\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.219043 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.218857    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b99b0ec9-e29c-48af-969e-8439f4810556-dshm\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:08:26.396716 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.396676    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"]
Sep 18 14:08:26.398949 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:26.398929    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/distinct-w0-ed4c53-kserve-8755c4d7f-6qxgv"]
Sep 18 14:08:27.085028 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:27.085001    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"
Sep 18 14:08:27.112440 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:27.112405    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"]
Sep 18 14:08:27.116717 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:27.116691    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-ed4c53/embedding-w0-ed4c53-kserve-f84cf58dd-twcs5"]
Sep 18 14:08:28.033543 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.033512    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"]
Sep 18 14:08:28.033998 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.033986    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99b0ec9-e29c-48af-969e-8439f4810556" containerName="main"
Sep 18 14:08:28.034046 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.034000    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99b0ec9-e29c-48af-969e-8439f4810556" containerName="main"
Sep 18 14:08:28.034046 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.034010    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cc6192-28df-4e67-9d76-0f95f54d09a2" containerName="payload-processing"
Sep 18 14:08:28.034046 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.034016    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cc6192-28df-4e67-9d76-0f95f54d09a2" containerName="payload-processing"
Sep 18 14:08:28.034046 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.034042    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="776d4836-0ba5-4b02-8dbf-af5d30f94e06" containerName="main"
Sep 18 14:08:28.034046 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.034048    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="776d4836-0ba5-4b02-8dbf-af5d30f94e06" containerName="main"
Sep 18 14:08:28.034306 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.034117    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b99b0ec9-e29c-48af-969e-8439f4810556" containerName="main"
Sep 18 14:08:28.034306 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.034156    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="776d4836-0ba5-4b02-8dbf-af5d30f94e06" containerName="main"
Sep 18 14:08:28.034306 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.034169    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9cc6192-28df-4e67-9d76-0f95f54d09a2" containerName="payload-processing"
Sep 18 14:08:28.039482 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.039459    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:08:28.042143 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.042110    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-ca1331\""
Sep 18 14:08:28.042332 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.042304    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-ca1331-dockercfg-zfxd4\""
Sep 18 14:08:28.050528 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.050504    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"]
Sep 18 14:08:28.141482 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.141440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd787bbc-245b-48a1-a328-6cb739578cc8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk\" (UID: \"cd787bbc-245b-48a1-a328-6cb739578cc8\") " pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:08:28.142396 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.141513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gc82\" (UniqueName: \"kubernetes.io/projected/cd787bbc-245b-48a1-a328-6cb739578cc8-kube-api-access-4gc82\") pod \"payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk\" (UID: \"cd787bbc-245b-48a1-a328-6cb739578cc8\") " pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:08:28.242417 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.242375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd787bbc-245b-48a1-a328-6cb739578cc8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk\" (UID: \"cd787bbc-245b-48a1-a328-6cb739578cc8\") " pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:08:28.242598 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.242432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gc82\" (UniqueName: \"kubernetes.io/projected/cd787bbc-245b-48a1-a328-6cb739578cc8-kube-api-access-4gc82\") pod \"payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk\" (UID: \"cd787bbc-245b-48a1-a328-6cb739578cc8\") " pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:08:28.243077 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.243055    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd787bbc-245b-48a1-a328-6cb739578cc8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk\" (UID: \"cd787bbc-245b-48a1-a328-6cb739578cc8\") " pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:08:28.252448 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.252416    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gc82\" (UniqueName: \"kubernetes.io/projected/cd787bbc-245b-48a1-a328-6cb739578cc8-kube-api-access-4gc82\") pod \"payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk\" (UID: \"cd787bbc-245b-48a1-a328-6cb739578cc8\") " pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:08:28.294142 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.294036    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="776d4836-0ba5-4b02-8dbf-af5d30f94e06" path="/var/lib/kubelet/pods/776d4836-0ba5-4b02-8dbf-af5d30f94e06/volumes"
Sep 18 14:08:28.294613 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.294590    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b99b0ec9-e29c-48af-969e-8439f4810556" path="/var/lib/kubelet/pods/b99b0ec9-e29c-48af-969e-8439f4810556/volumes"
Sep 18 14:08:28.352799 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.352768    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:08:28.640801 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:28.640774    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"]
Sep 18 14:08:28.643271 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:08:28.643246    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd787bbc_245b_48a1_a328_6cb739578cc8.slice/crio-8edba8b3b724af3edbc5e0addef84e8680f7ad10c2a07aae91ddabfcb6f1e6e3 WatchSource:0}: Error finding container 8edba8b3b724af3edbc5e0addef84e8680f7ad10c2a07aae91ddabfcb6f1e6e3: Status 404 returned error can't find the container with id 8edba8b3b724af3edbc5e0addef84e8680f7ad10c2a07aae91ddabfcb6f1e6e3
Sep 18 14:08:29.100314 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:29.100280    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk" event={"ID":"cd787bbc-245b-48a1-a328-6cb739578cc8","Type":"ContainerStarted","Data":"d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5"}
Sep 18 14:08:29.100509 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:29.100338    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk" event={"ID":"cd787bbc-245b-48a1-a328-6cb739578cc8","Type":"ContainerStarted","Data":"8edba8b3b724af3edbc5e0addef84e8680f7ad10c2a07aae91ddabfcb6f1e6e3"}
Sep 18 14:08:29.100509 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:29.100364    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:08:29.156887 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:29.156829    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk" podStartSLOduration=1.156812173 podStartE2EDuration="1.156812173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:08:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:08:29.153643198 +0000 UTC m=+1434.989481917" watchObservedRunningTime="2026-09-18 14:08:29.156812173 +0000 UTC m=+1434.992650887"
Sep 18 14:08:36.623745 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:36.623703    2575 scope.go:117] "RemoveContainer" containerID="5a184298198da4944e198bf9c2c27f1c92fe3a93e39cb3d9a5ffa8d1213d29de"
Sep 18 14:08:36.632952 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:36.632929    2575 scope.go:117] "RemoveContainer" containerID="e33c2a1445b3a5b606b86093ef3b6fdc300927b82d68b8fbb85b49623e0ea81b"
Sep 18 14:08:40.110294 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:40.110261    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:08:48.246179 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:48.246120    2575 generic.go:356] "Generic (PLEG): container finished" podID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerID="be20aa9aafaf9bb82f75d266e07e6292ab00e7496bb19d82cc624e9d55dff292" exitCode=0
Sep 18 14:08:48.246599 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:48.246205    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" event={"ID":"0d10805f-2250-4f05-97d5-57a8ef96ca75","Type":"ContainerDied","Data":"be20aa9aafaf9bb82f75d266e07e6292ab00e7496bb19d82cc624e9d55dff292"}
Sep 18 14:08:48.246847 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:48.246829    2575 scope.go:117] "RemoveContainer" containerID="be20aa9aafaf9bb82f75d266e07e6292ab00e7496bb19d82cc624e9d55dff292"
Sep 18 14:08:48.248365 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:48.248335    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:08:48.248472 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:48.248407    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:08:48.248472 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:48.248441    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:08:49.259377 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:49.259342    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" event={"ID":"0d10805f-2250-4f05-97d5-57a8ef96ca75","Type":"ContainerStarted","Data":"7aaa1cc2858da7c10bed1203c30484b542a76f8400e985dd61960520518490c8"}
Sep 18 14:08:50.028832 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:50.028805    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:50.030051 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:50.030022    2575 patch_prober.go:28] interesting pod/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 18 14:08:50.030204 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:50.030084    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 18 14:08:51.028833 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:51.028801    2575 patch_prober.go:28] interesting pod/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 18 14:08:51.029277 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:51.029232    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 18 14:08:52.028793 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:52.028751    2575 patch_prober.go:28] interesting pod/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 18 14:08:52.029018 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:52.028830    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 18 14:08:53.029000 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:53.028963    2575 patch_prober.go:28] interesting pod/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 18 14:08:53.029231 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:53.029038    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 18 14:08:54.028793 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:54.028752    2575 patch_prober.go:28] interesting pod/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 18 14:08:54.028971 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:54.028829    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 18 14:08:54.061143 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:54.061094    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:55.032729 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:55.032697    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:55.033916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:55.033894    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:08:55.876748 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:55.876711    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"]
Sep 18 14:08:55.893810 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:55.893398    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:08:55.896702 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:55.896672    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-eb3054\""
Sep 18 14:08:55.896890 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:55.896796    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-eb3054-dockercfg-wrqlm\""
Sep 18 14:08:55.897449 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:55.897428    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"]
Sep 18 14:08:55.955698 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:55.955642    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eda5f6-4213-4b71-a4fe-5e4e81045564-plugins-config-volume\") pod \"payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp\" (UID: \"97eda5f6-4213-4b71-a4fe-5e4e81045564\") " pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:08:55.955698 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:55.955690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr8d5\" (UniqueName: \"kubernetes.io/projected/97eda5f6-4213-4b71-a4fe-5e4e81045564-kube-api-access-tr8d5\") pod \"payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp\" (UID: \"97eda5f6-4213-4b71-a4fe-5e4e81045564\") " pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:08:56.056800 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:56.056764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eda5f6-4213-4b71-a4fe-5e4e81045564-plugins-config-volume\") pod \"payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp\" (UID: \"97eda5f6-4213-4b71-a4fe-5e4e81045564\") " pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:08:56.056800 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:56.056804    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr8d5\" (UniqueName: \"kubernetes.io/projected/97eda5f6-4213-4b71-a4fe-5e4e81045564-kube-api-access-tr8d5\") pod \"payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp\" (UID: \"97eda5f6-4213-4b71-a4fe-5e4e81045564\") " pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:08:56.057587 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:56.057568    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eda5f6-4213-4b71-a4fe-5e4e81045564-plugins-config-volume\") pod \"payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp\" (UID: \"97eda5f6-4213-4b71-a4fe-5e4e81045564\") " pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:08:56.065347 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:56.065317    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr8d5\" (UniqueName: \"kubernetes.io/projected/97eda5f6-4213-4b71-a4fe-5e4e81045564-kube-api-access-tr8d5\") pod \"payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp\" (UID: \"97eda5f6-4213-4b71-a4fe-5e4e81045564\") " pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:08:56.206535 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:56.206430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:08:56.488016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:56.487989    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"]
Sep 18 14:08:56.489487 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:08:56.489456    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97eda5f6_4213_4b71_a4fe_5e4e81045564.slice/crio-39963895bf97cc7cbee1767d3cba09503bcabe847e4403ba3036b76b565242b0 WatchSource:0}: Error finding container 39963895bf97cc7cbee1767d3cba09503bcabe847e4403ba3036b76b565242b0: Status 404 returned error can't find the container with id 39963895bf97cc7cbee1767d3cba09503bcabe847e4403ba3036b76b565242b0
Sep 18 14:08:57.313043 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:57.313002    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp" event={"ID":"97eda5f6-4213-4b71-a4fe-5e4e81045564","Type":"ContainerStarted","Data":"1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4"}
Sep 18 14:08:57.313491 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:57.313055    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp" event={"ID":"97eda5f6-4213-4b71-a4fe-5e4e81045564","Type":"ContainerStarted","Data":"39963895bf97cc7cbee1767d3cba09503bcabe847e4403ba3036b76b565242b0"}
Sep 18 14:08:57.313491 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:57.313119    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:08:57.331417 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:08:57.331368    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp" podStartSLOduration=2.331352806 podStartE2EDuration="2.331352806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:08:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:08:57.329986465 +0000 UTC m=+1463.165825179" watchObservedRunningTime="2026-09-18 14:08:57.331352806 +0000 UTC m=+1463.167191518"
Sep 18 14:09:08.322635 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:08.322600    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:09:21.233529 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:21.233483    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"]
Sep 18 14:09:21.238101 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:21.238069    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"
Sep 18 14:09:21.242085 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:21.242052    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:09:21.244269 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:21.244240    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"]
Sep 18 14:09:21.343503 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:21.343462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffeba8d9-ca8b-4902-b40a-8d251bff7920-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h\" (UID: \"ffeba8d9-ca8b-4902-b40a-8d251bff7920\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"
Sep 18 14:09:21.444545 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:21.444509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffeba8d9-ca8b-4902-b40a-8d251bff7920-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h\" (UID: \"ffeba8d9-ca8b-4902-b40a-8d251bff7920\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"
Sep 18 14:09:21.445157 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:21.445121    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffeba8d9-ca8b-4902-b40a-8d251bff7920-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h\" (UID: \"ffeba8d9-ca8b-4902-b40a-8d251bff7920\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"
Sep 18 14:09:21.553607 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:21.553565    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"
Sep 18 14:09:21.829758 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:21.829734    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"]
Sep 18 14:09:21.831582 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:09:21.831557    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffeba8d9_ca8b_4902_b40a_8d251bff7920.slice/crio-3c718d6084bc209f419948cde21d51feb9f938688e34b443655f47d587220a5b WatchSource:0}: Error finding container 3c718d6084bc209f419948cde21d51feb9f938688e34b443655f47d587220a5b: Status 404 returned error can't find the container with id 3c718d6084bc209f419948cde21d51feb9f938688e34b443655f47d587220a5b
Sep 18 14:09:22.474904 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:22.474806    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h" event={"ID":"ffeba8d9-ca8b-4902-b40a-8d251bff7920","Type":"ContainerStarted","Data":"f03efa44b1b209ce2cd5c132f81e75da22982fa7447fb942e85859b1509fb625"}
Sep 18 14:09:22.474904 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:22.474867    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h" event={"ID":"ffeba8d9-ca8b-4902-b40a-8d251bff7920","Type":"ContainerStarted","Data":"3c718d6084bc209f419948cde21d51feb9f938688e34b443655f47d587220a5b"}
Sep 18 14:09:22.494222 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:22.494166    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h" podStartSLOduration=1.494150897 podStartE2EDuration="1.494150897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:09:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:09:22.491810766 +0000 UTC m=+1488.327649480" watchObservedRunningTime="2026-09-18 14:09:22.494150897 +0000 UTC m=+1488.329989604"
Sep 18 14:09:23.482879 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:23.482843    2575 generic.go:356] "Generic (PLEG): container finished" podID="ffeba8d9-ca8b-4902-b40a-8d251bff7920" containerID="f03efa44b1b209ce2cd5c132f81e75da22982fa7447fb942e85859b1509fb625" exitCode=0
Sep 18 14:09:23.483403 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:23.482921    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h" event={"ID":"ffeba8d9-ca8b-4902-b40a-8d251bff7920","Type":"ContainerDied","Data":"f03efa44b1b209ce2cd5c132f81e75da22982fa7447fb942e85859b1509fb625"}
Sep 18 14:09:24.629658 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:24.629629    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"
Sep 18 14:09:24.686804 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:24.686768    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffeba8d9-ca8b-4902-b40a-8d251bff7920-maas-api-service-ca\") pod \"ffeba8d9-ca8b-4902-b40a-8d251bff7920\" (UID: \"ffeba8d9-ca8b-4902-b40a-8d251bff7920\") "
Sep 18 14:09:24.687198 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:24.687170    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffeba8d9-ca8b-4902-b40a-8d251bff7920-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ffeba8d9-ca8b-4902-b40a-8d251bff7920" (UID: "ffeba8d9-ca8b-4902-b40a-8d251bff7920"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:09:24.788381 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:24.788288    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffeba8d9-ca8b-4902-b40a-8d251bff7920-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:25.504779 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:25.504742    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h" event={"ID":"ffeba8d9-ca8b-4902-b40a-8d251bff7920","Type":"ContainerDied","Data":"3c718d6084bc209f419948cde21d51feb9f938688e34b443655f47d587220a5b"}
Sep 18 14:09:25.504958 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:25.504821    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c718d6084bc209f419948cde21d51feb9f938688e34b443655f47d587220a5b"
Sep 18 14:09:25.504958 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:25.504760    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"
Sep 18 14:09:36.372269 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.372238    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 14:09:36.374061 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.374035    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 14:09:36.677346 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.677265    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"]
Sep 18 14:09:36.677817 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.677804    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffeba8d9-ca8b-4902-b40a-8d251bff7920" containerName="revoke-keys"
Sep 18 14:09:36.677857 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.677820    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffeba8d9-ca8b-4902-b40a-8d251bff7920" containerName="revoke-keys"
Sep 18 14:09:36.677915 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.677906    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffeba8d9-ca8b-4902-b40a-8d251bff7920" containerName="revoke-keys"
Sep 18 14:09:36.680329 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.680312    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"
Sep 18 14:09:36.683258 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.683238    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:09:36.688251 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.688231    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"]
Sep 18 14:09:36.822595 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.822553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc14f83f-340f-4c72-ab76-c5fe459eaa2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx\" (UID: \"bc14f83f-340f-4c72-ab76-c5fe459eaa2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"
Sep 18 14:09:36.923682 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.923643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc14f83f-340f-4c72-ab76-c5fe459eaa2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx\" (UID: \"bc14f83f-340f-4c72-ab76-c5fe459eaa2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"
Sep 18 14:09:36.924305 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.924284    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc14f83f-340f-4c72-ab76-c5fe459eaa2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx\" (UID: \"bc14f83f-340f-4c72-ab76-c5fe459eaa2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"
Sep 18 14:09:36.993834 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:36.993760    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"
Sep 18 14:09:37.268115 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:37.268088    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"]
Sep 18 14:09:37.270168 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:09:37.270141    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc14f83f_340f_4c72_ab76_c5fe459eaa2c.slice/crio-db69c1c3420901ca696d3e58b780d05da84152296a159277065a311fff3375ad WatchSource:0}: Error finding container db69c1c3420901ca696d3e58b780d05da84152296a159277065a311fff3375ad: Status 404 returned error can't find the container with id db69c1c3420901ca696d3e58b780d05da84152296a159277065a311fff3375ad
Sep 18 14:09:37.579502 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:37.579463    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx" event={"ID":"bc14f83f-340f-4c72-ab76-c5fe459eaa2c","Type":"ContainerStarted","Data":"436eb3478ba56f52fd76fcd70c106337494d8647663629747811fa117a1c3917"}
Sep 18 14:09:37.579861 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:37.579531    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx" event={"ID":"bc14f83f-340f-4c72-ab76-c5fe459eaa2c","Type":"ContainerStarted","Data":"db69c1c3420901ca696d3e58b780d05da84152296a159277065a311fff3375ad"}
Sep 18 14:09:37.597049 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:37.596999    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx" podStartSLOduration=1.59698267 podStartE2EDuration="1.59698267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:09:37.594359541 +0000 UTC m=+1503.430198267" watchObservedRunningTime="2026-09-18 14:09:37.59698267 +0000 UTC m=+1503.432821384"
Sep 18 14:09:37.805622 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:37.805112    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"]
Sep 18 14:09:37.805622 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:37.805351    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk" podUID="cd787bbc-245b-48a1-a328-6cb739578cc8" containerName="payload-processing" containerID="cri-o://d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5" gracePeriod=30
Sep 18 14:09:38.068078 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.068005    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:09:38.138690 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.138469    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gc82\" (UniqueName: \"kubernetes.io/projected/cd787bbc-245b-48a1-a328-6cb739578cc8-kube-api-access-4gc82\") pod \"cd787bbc-245b-48a1-a328-6cb739578cc8\" (UID: \"cd787bbc-245b-48a1-a328-6cb739578cc8\") "
Sep 18 14:09:38.138690 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.138569    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd787bbc-245b-48a1-a328-6cb739578cc8-plugins-config-volume\") pod \"cd787bbc-245b-48a1-a328-6cb739578cc8\" (UID: \"cd787bbc-245b-48a1-a328-6cb739578cc8\") "
Sep 18 14:09:38.139431 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.139401    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd787bbc-245b-48a1-a328-6cb739578cc8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd787bbc-245b-48a1-a328-6cb739578cc8" (UID: "cd787bbc-245b-48a1-a328-6cb739578cc8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:09:38.141424 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.141392    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd787bbc-245b-48a1-a328-6cb739578cc8-kube-api-access-4gc82" (OuterVolumeSpecName: "kube-api-access-4gc82") pod "cd787bbc-245b-48a1-a328-6cb739578cc8" (UID: "cd787bbc-245b-48a1-a328-6cb739578cc8"). InnerVolumeSpecName "kube-api-access-4gc82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:09:38.158113 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.158088    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"]
Sep 18 14:09:38.162168 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.162120    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ca1331-bhb4h"]
Sep 18 14:09:38.240168 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.240095    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gc82\" (UniqueName: \"kubernetes.io/projected/cd787bbc-245b-48a1-a328-6cb739578cc8-kube-api-access-4gc82\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:38.240168 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.240168    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd787bbc-245b-48a1-a328-6cb739578cc8-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:38.294164 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.294116    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffeba8d9-ca8b-4902-b40a-8d251bff7920" path="/var/lib/kubelet/pods/ffeba8d9-ca8b-4902-b40a-8d251bff7920/volumes"
Sep 18 14:09:38.587505 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.587471    2575 generic.go:356] "Generic (PLEG): container finished" podID="cd787bbc-245b-48a1-a328-6cb739578cc8" containerID="d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5" exitCode=0
Sep 18 14:09:38.588014 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.587520    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"
Sep 18 14:09:38.588014 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.587560    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk" event={"ID":"cd787bbc-245b-48a1-a328-6cb739578cc8","Type":"ContainerDied","Data":"d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5"}
Sep 18 14:09:38.588014 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.587616    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk" event={"ID":"cd787bbc-245b-48a1-a328-6cb739578cc8","Type":"ContainerDied","Data":"8edba8b3b724af3edbc5e0addef84e8680f7ad10c2a07aae91ddabfcb6f1e6e3"}
Sep 18 14:09:38.588014 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.587646    2575 scope.go:117] "RemoveContainer" containerID="d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5"
Sep 18 14:09:38.589422 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.589398    2575 generic.go:356] "Generic (PLEG): container finished" podID="bc14f83f-340f-4c72-ab76-c5fe459eaa2c" containerID="436eb3478ba56f52fd76fcd70c106337494d8647663629747811fa117a1c3917" exitCode=0
Sep 18 14:09:38.589540 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.589498    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx" event={"ID":"bc14f83f-340f-4c72-ab76-c5fe459eaa2c","Type":"ContainerDied","Data":"436eb3478ba56f52fd76fcd70c106337494d8647663629747811fa117a1c3917"}
Sep 18 14:09:38.597181 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.597126    2575 scope.go:117] "RemoveContainer" containerID="d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5"
Sep 18 14:09:38.597456 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:09:38.597428    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5\": container with ID starting with d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5 not found: ID does not exist" containerID="d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5"
Sep 18 14:09:38.597508 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.597466    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5"} err="failed to get container status \"d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5\": rpc error: code = NotFound desc = could not find container \"d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5\": container with ID starting with d2976d46e1e544a217f683739232bd67bd207896bc2547370eadfe433e02e5f5 not found: ID does not exist"
Sep 18 14:09:38.605549 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.605524    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"]
Sep 18 14:09:38.611803 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:38.611778    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk"]
Sep 18 14:09:39.729229 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:39.729205    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"
Sep 18 14:09:39.859685 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:39.859592    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc14f83f-340f-4c72-ab76-c5fe459eaa2c-maas-api-service-ca\") pod \"bc14f83f-340f-4c72-ab76-c5fe459eaa2c\" (UID: \"bc14f83f-340f-4c72-ab76-c5fe459eaa2c\") "
Sep 18 14:09:39.859923 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:39.859897    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc14f83f-340f-4c72-ab76-c5fe459eaa2c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bc14f83f-340f-4c72-ab76-c5fe459eaa2c" (UID: "bc14f83f-340f-4c72-ab76-c5fe459eaa2c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:09:39.860107 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:39.860088    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc14f83f-340f-4c72-ab76-c5fe459eaa2c-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:40.294156 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:40.294064    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd787bbc-245b-48a1-a328-6cb739578cc8" path="/var/lib/kubelet/pods/cd787bbc-245b-48a1-a328-6cb739578cc8/volumes"
Sep 18 14:09:40.604495 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:40.604464    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"
Sep 18 14:09:40.604675 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:40.604499    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx" event={"ID":"bc14f83f-340f-4c72-ab76-c5fe459eaa2c","Type":"ContainerDied","Data":"db69c1c3420901ca696d3e58b780d05da84152296a159277065a311fff3375ad"}
Sep 18 14:09:40.604675 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:40.604552    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db69c1c3420901ca696d3e58b780d05da84152296a159277065a311fff3375ad"
Sep 18 14:09:41.549354 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:41.549319    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"]
Sep 18 14:09:45.429392 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.429357    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"]
Sep 18 14:09:45.429773 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.429642    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy" containerID="cri-o://7aaa1cc2858da7c10bed1203c30484b542a76f8400e985dd61960520518490c8" gracePeriod=30
Sep 18 14:09:45.758541 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.758456    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"]
Sep 18 14:09:45.759002 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.758988    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc14f83f-340f-4c72-ab76-c5fe459eaa2c" containerName="revoke-keys"
Sep 18 14:09:45.759053 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.759003    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc14f83f-340f-4c72-ab76-c5fe459eaa2c" containerName="revoke-keys"
Sep 18 14:09:45.759053 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.759019    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd787bbc-245b-48a1-a328-6cb739578cc8" containerName="payload-processing"
Sep 18 14:09:45.759053 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.759024    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd787bbc-245b-48a1-a328-6cb739578cc8" containerName="payload-processing"
Sep 18 14:09:45.759197 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.759105    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd787bbc-245b-48a1-a328-6cb739578cc8" containerName="payload-processing"
Sep 18 14:09:45.759197 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.759113    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc14f83f-340f-4c72-ab76-c5fe459eaa2c" containerName="revoke-keys"
Sep 18 14:09:45.762127 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.762111    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"
Sep 18 14:09:45.764993 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.764970    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:09:45.774055 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.774032    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"]
Sep 18 14:09:45.827700 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.827655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ea7747a-c0d5-42b4-adbf-d40375759643-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm\" (UID: \"2ea7747a-c0d5-42b4-adbf-d40375759643\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"
Sep 18 14:09:45.929674 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.929634    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ea7747a-c0d5-42b4-adbf-d40375759643-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm\" (UID: \"2ea7747a-c0d5-42b4-adbf-d40375759643\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"
Sep 18 14:09:45.931241 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:45.931196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ea7747a-c0d5-42b4-adbf-d40375759643-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm\" (UID: \"2ea7747a-c0d5-42b4-adbf-d40375759643\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"
Sep 18 14:09:46.073274 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:46.073244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"
Sep 18 14:09:46.351196 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:46.351166    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"]
Sep 18 14:09:46.352193 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:09:46.352168    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea7747a_c0d5_42b4_adbf_d40375759643.slice/crio-040ee9944ef3f98249d0adc608b38b811dfaafe35340778dc9e6b780b30be55a WatchSource:0}: Error finding container 040ee9944ef3f98249d0adc608b38b811dfaafe35340778dc9e6b780b30be55a: Status 404 returned error can't find the container with id 040ee9944ef3f98249d0adc608b38b811dfaafe35340778dc9e6b780b30be55a
Sep 18 14:09:46.647780 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:46.647747    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm" event={"ID":"2ea7747a-c0d5-42b4-adbf-d40375759643","Type":"ContainerStarted","Data":"040ee9944ef3f98249d0adc608b38b811dfaafe35340778dc9e6b780b30be55a"}
Sep 18 14:09:47.588782 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:47.588740    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"]
Sep 18 14:09:47.656071 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:47.656033    2575 generic.go:356] "Generic (PLEG): container finished" podID="2ea7747a-c0d5-42b4-adbf-d40375759643" containerID="b64f5204abdd852ed746c2fa673de9bd21eb1b92ad3c0b376f8df81c686a82b6" exitCode=0
Sep 18 14:09:47.656555 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:47.656118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm" event={"ID":"2ea7747a-c0d5-42b4-adbf-d40375759643","Type":"ContainerDied","Data":"b64f5204abdd852ed746c2fa673de9bd21eb1b92ad3c0b376f8df81c686a82b6"}
Sep 18 14:09:48.812026 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:48.811999    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"
Sep 18 14:09:48.864036 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:48.864001    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ea7747a-c0d5-42b4-adbf-d40375759643-maas-api-service-ca\") pod \"2ea7747a-c0d5-42b4-adbf-d40375759643\" (UID: \"2ea7747a-c0d5-42b4-adbf-d40375759643\") "
Sep 18 14:09:48.864446 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:48.864423    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ea7747a-c0d5-42b4-adbf-d40375759643-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2ea7747a-c0d5-42b4-adbf-d40375759643" (UID: "2ea7747a-c0d5-42b4-adbf-d40375759643"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:09:48.965368 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:48.965287    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ea7747a-c0d5-42b4-adbf-d40375759643-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:49.672429 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:49.672396    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"
Sep 18 14:09:49.672616 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:49.672433    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm" event={"ID":"2ea7747a-c0d5-42b4-adbf-d40375759643","Type":"ContainerDied","Data":"040ee9944ef3f98249d0adc608b38b811dfaafe35340778dc9e6b780b30be55a"}
Sep 18 14:09:49.672616 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:49.672490    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="040ee9944ef3f98249d0adc608b38b811dfaafe35340778dc9e6b780b30be55a"
Sep 18 14:09:50.680876 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.680848    2575 generic.go:356] "Generic (PLEG): container finished" podID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerID="7aaa1cc2858da7c10bed1203c30484b542a76f8400e985dd61960520518490c8" exitCode=0
Sep 18 14:09:50.681221 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.680919    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" event={"ID":"0d10805f-2250-4f05-97d5-57a8ef96ca75","Type":"ContainerDied","Data":"7aaa1cc2858da7c10bed1203c30484b542a76f8400e985dd61960520518490c8"}
Sep 18 14:09:50.681221 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.680977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2" event={"ID":"0d10805f-2250-4f05-97d5-57a8ef96ca75","Type":"ContainerDied","Data":"17317cb6e6b0fde640e6076cb80e350abc069d7d9e539db321def6fef867bfb7"}
Sep 18 14:09:50.681221 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.680998    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17317cb6e6b0fde640e6076cb80e350abc069d7d9e539db321def6fef867bfb7"
Sep 18 14:09:50.681221 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.681012    2575 scope.go:117] "RemoveContainer" containerID="be20aa9aafaf9bb82f75d266e07e6292ab00e7496bb19d82cc624e9d55dff292"
Sep 18 14:09:50.698944 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.698925    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:09:50.784906 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.784876    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q96bs\" (UniqueName: \"kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-kube-api-access-q96bs\") pod \"0d10805f-2250-4f05-97d5-57a8ef96ca75\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") "
Sep 18 14:09:50.784906 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.784911    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-certs\") pod \"0d10805f-2250-4f05-97d5-57a8ef96ca75\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") "
Sep 18 14:09:50.785123 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.784969    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-socket\") pod \"0d10805f-2250-4f05-97d5-57a8ef96ca75\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") "
Sep 18 14:09:50.785123 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785043    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-credential-socket\") pod \"0d10805f-2250-4f05-97d5-57a8ef96ca75\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") "
Sep 18 14:09:50.785123 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785077    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-token\") pod \"0d10805f-2250-4f05-97d5-57a8ef96ca75\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") "
Sep 18 14:09:50.785123 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785095    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-podinfo\") pod \"0d10805f-2250-4f05-97d5-57a8ef96ca75\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") "
Sep 18 14:09:50.785123 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785110    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-data\") pod \"0d10805f-2250-4f05-97d5-57a8ef96ca75\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") "
Sep 18 14:09:50.785410 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785184    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d10805f-2250-4f05-97d5-57a8ef96ca75-istiod-ca-cert\") pod \"0d10805f-2250-4f05-97d5-57a8ef96ca75\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") "
Sep 18 14:09:50.785410 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785225    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-envoy\") pod \"0d10805f-2250-4f05-97d5-57a8ef96ca75\" (UID: \"0d10805f-2250-4f05-97d5-57a8ef96ca75\") "
Sep 18 14:09:50.785410 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785271    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d10805f-2250-4f05-97d5-57a8ef96ca75" (UID: "0d10805f-2250-4f05-97d5-57a8ef96ca75"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:50.785410 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785369    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d10805f-2250-4f05-97d5-57a8ef96ca75" (UID: "0d10805f-2250-4f05-97d5-57a8ef96ca75"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:50.785599 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785415    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d10805f-2250-4f05-97d5-57a8ef96ca75" (UID: "0d10805f-2250-4f05-97d5-57a8ef96ca75"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:50.785653 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785614    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d10805f-2250-4f05-97d5-57a8ef96ca75-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d10805f-2250-4f05-97d5-57a8ef96ca75" (UID: "0d10805f-2250-4f05-97d5-57a8ef96ca75"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:09:50.785768 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785746    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:50.785849 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785758    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d10805f-2250-4f05-97d5-57a8ef96ca75" (UID: "0d10805f-2250-4f05-97d5-57a8ef96ca75"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:50.785849 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785771    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-workload-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:50.785849 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785787    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-credential-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:50.785849 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.785802    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d10805f-2250-4f05-97d5-57a8ef96ca75-istiod-ca-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:50.787275 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.787245    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-kube-api-access-q96bs" (OuterVolumeSpecName: "kube-api-access-q96bs") pod "0d10805f-2250-4f05-97d5-57a8ef96ca75" (UID: "0d10805f-2250-4f05-97d5-57a8ef96ca75"). InnerVolumeSpecName "kube-api-access-q96bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:09:50.787599 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.787577    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d10805f-2250-4f05-97d5-57a8ef96ca75" (UID: "0d10805f-2250-4f05-97d5-57a8ef96ca75"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:09:50.787717 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.787700    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d10805f-2250-4f05-97d5-57a8ef96ca75" (UID: "0d10805f-2250-4f05-97d5-57a8ef96ca75"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:09:50.787779 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.787703    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d10805f-2250-4f05-97d5-57a8ef96ca75" (UID: "0d10805f-2250-4f05-97d5-57a8ef96ca75"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:50.887160 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.887098    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-token\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:50.887160 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.887158    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-podinfo\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:50.887160 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.887168    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-data\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:50.887400 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.887176    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d10805f-2250-4f05-97d5-57a8ef96ca75-istio-envoy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:50.887400 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:50.887184    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q96bs\" (UniqueName: \"kubernetes.io/projected/0d10805f-2250-4f05-97d5-57a8ef96ca75-kube-api-access-q96bs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:51.688695 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:51.688657    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"
Sep 18 14:09:51.723466 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:51.723435    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"]
Sep 18 14:09:51.729537 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:51.729514    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2"]
Sep 18 14:09:52.294259 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:52.294226    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" path="/var/lib/kubelet/pods/0d10805f-2250-4f05-97d5-57a8ef96ca75/volumes"
Sep 18 14:09:55.453492 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.453459    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"]
Sep 18 14:09:55.453980 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.453671    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv" podUID="8ddebbe5-776d-4979-a32f-f7e1ad7b98b3" containerName="payload-pre-processing" containerID="cri-o://00fdaa7810213fb43c875e92c934e82ea0c0aa670f3972f84cd86c895efcc8f3" gracePeriod=30
Sep 18 14:09:55.620246 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.620212    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"]
Sep 18 14:09:55.623736 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.623714    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-377ca2-zlmqx"]
Sep 18 14:09:55.719345 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.719253    2575 generic.go:356] "Generic (PLEG): container finished" podID="8ddebbe5-776d-4979-a32f-f7e1ad7b98b3" containerID="00fdaa7810213fb43c875e92c934e82ea0c0aa670f3972f84cd86c895efcc8f3" exitCode=0
Sep 18 14:09:55.719635 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.719437    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv" event={"ID":"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3","Type":"ContainerDied","Data":"00fdaa7810213fb43c875e92c934e82ea0c0aa670f3972f84cd86c895efcc8f3"}
Sep 18 14:09:55.719635 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.719489    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv" event={"ID":"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3","Type":"ContainerDied","Data":"d82d6f303d543326c5747659b0e6a738c519d37bf3cf426ea2ef7ecd1208fb8d"}
Sep 18 14:09:55.719635 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.719510    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d82d6f303d543326c5747659b0e6a738c519d37bf3cf426ea2ef7ecd1208fb8d"
Sep 18 14:09:55.728250 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.728225    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 14:09:55.842438 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.842404    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-plugins-config-volume\") pod \"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3\" (UID: \"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3\") "
Sep 18 14:09:55.842627 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.842539    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85w68\" (UniqueName: \"kubernetes.io/projected/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-kube-api-access-85w68\") pod \"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3\" (UID: \"8ddebbe5-776d-4979-a32f-f7e1ad7b98b3\") "
Sep 18 14:09:55.842812 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.842789    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ddebbe5-776d-4979-a32f-f7e1ad7b98b3" (UID: "8ddebbe5-776d-4979-a32f-f7e1ad7b98b3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:09:55.842980 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.842965    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:55.844716 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.844687    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-kube-api-access-85w68" (OuterVolumeSpecName: "kube-api-access-85w68") pod "8ddebbe5-776d-4979-a32f-f7e1ad7b98b3" (UID: "8ddebbe5-776d-4979-a32f-f7e1ad7b98b3"). InnerVolumeSpecName "kube-api-access-85w68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:09:55.944171 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:55.944122    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85w68\" (UniqueName: \"kubernetes.io/projected/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3-kube-api-access-85w68\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:56.294793 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.294758    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc14f83f-340f-4c72-ab76-c5fe459eaa2c" path="/var/lib/kubelet/pods/bc14f83f-340f-4c72-ab76-c5fe459eaa2c/volumes"
Sep 18 14:09:56.569387 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.569350    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v" podUID="0d6b44e5-ae6d-4382-a015-88c24edfc2bd" containerName="main" containerID="cri-o://cedcd146a2045a15d58ab45bbf3b48da233d90acd5b3912156ba5b26fb979032" gracePeriod=45
Sep 18 14:09:56.728444 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.728411    2575 generic.go:356] "Generic (PLEG): container finished" podID="0d6b44e5-ae6d-4382-a015-88c24edfc2bd" containerID="cedcd146a2045a15d58ab45bbf3b48da233d90acd5b3912156ba5b26fb979032" exitCode=0
Sep 18 14:09:56.728638 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.728481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v" event={"ID":"0d6b44e5-ae6d-4382-a015-88c24edfc2bd","Type":"ContainerDied","Data":"cedcd146a2045a15d58ab45bbf3b48da233d90acd5b3912156ba5b26fb979032"}
Sep 18 14:09:56.728638 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.728503    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"
Sep 18 14:09:56.752190 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.752163    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"]
Sep 18 14:09:56.756299 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.756253    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv"]
Sep 18 14:09:56.840405 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.840382    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:09:56.956147 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.956104    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tls-certs\") pod \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") "
Sep 18 14:09:56.956322 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.956255    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m55gx\" (UniqueName: \"kubernetes.io/projected/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-kube-api-access-m55gx\") pod \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") "
Sep 18 14:09:56.956322 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.956306    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tmp-dir\") pod \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") "
Sep 18 14:09:56.956414 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.956336    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-dshm\") pod \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") "
Sep 18 14:09:56.956414 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.956371    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-home\") pod \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") "
Sep 18 14:09:56.956521 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.956451    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-model-cache\") pod \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\" (UID: \"0d6b44e5-ae6d-4382-a015-88c24edfc2bd\") "
Sep 18 14:09:56.956729 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.956594    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0d6b44e5-ae6d-4382-a015-88c24edfc2bd" (UID: "0d6b44e5-ae6d-4382-a015-88c24edfc2bd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:56.956876 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.956791    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-home" (OuterVolumeSpecName: "home") pod "0d6b44e5-ae6d-4382-a015-88c24edfc2bd" (UID: "0d6b44e5-ae6d-4382-a015-88c24edfc2bd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:56.956876 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.956823    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-model-cache" (OuterVolumeSpecName: "model-cache") pod "0d6b44e5-ae6d-4382-a015-88c24edfc2bd" (UID: "0d6b44e5-ae6d-4382-a015-88c24edfc2bd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:56.957261 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.957202    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tmp-dir\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:56.957261 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.957228    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-home\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:56.957261 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.957241    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-model-cache\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:56.958484 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.958458    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-dshm" (OuterVolumeSpecName: "dshm") pod "0d6b44e5-ae6d-4382-a015-88c24edfc2bd" (UID: "0d6b44e5-ae6d-4382-a015-88c24edfc2bd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:56.958659 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.958639    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0d6b44e5-ae6d-4382-a015-88c24edfc2bd" (UID: "0d6b44e5-ae6d-4382-a015-88c24edfc2bd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:09:56.958915 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:56.958892    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-kube-api-access-m55gx" (OuterVolumeSpecName: "kube-api-access-m55gx") pod "0d6b44e5-ae6d-4382-a015-88c24edfc2bd" (UID: "0d6b44e5-ae6d-4382-a015-88c24edfc2bd"). InnerVolumeSpecName "kube-api-access-m55gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:09:57.058004 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:57.057969    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m55gx\" (UniqueName: \"kubernetes.io/projected/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-kube-api-access-m55gx\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:57.058004 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:57.057998    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-dshm\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:57.058004 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:57.058008    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d6b44e5-ae6d-4382-a015-88c24edfc2bd-tls-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:09:57.736091 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:57.736059    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"
Sep 18 14:09:57.736616 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:57.736062    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v" event={"ID":"0d6b44e5-ae6d-4382-a015-88c24edfc2bd","Type":"ContainerDied","Data":"9bf7f1f33f153de0bbb737427044f7b3d7993b83db25b4798481cd77442c3bdb"}
Sep 18 14:09:57.736616 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:57.736198    2575 scope.go:117] "RemoveContainer" containerID="cedcd146a2045a15d58ab45bbf3b48da233d90acd5b3912156ba5b26fb979032"
Sep 18 14:09:57.759675 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:57.759645    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"]
Sep 18 14:09:57.763684 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:57.763661    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-377ca2/distinct-2-w4-377ca2-kserve-856fdb49bc-6lb4v"]
Sep 18 14:09:58.293403 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:58.293370    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d6b44e5-ae6d-4382-a015-88c24edfc2bd" path="/var/lib/kubelet/pods/0d6b44e5-ae6d-4382-a015-88c24edfc2bd/volumes"
Sep 18 14:09:58.293753 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:09:58.293739    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ddebbe5-776d-4979-a32f-f7e1ad7b98b3" path="/var/lib/kubelet/pods/8ddebbe5-776d-4979-a32f-f7e1ad7b98b3/volumes"
Sep 18 14:10:02.370199 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:02.370162    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"]
Sep 18 14:10:02.370681 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:02.370572    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy" containerID="cri-o://5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7" gracePeriod=30
Sep 18 14:10:02.608228 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:02.608173    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt" podUID="23fc7689-aa84-49d2-b919-bd8369b03740" containerName="main" containerID="cri-o://c61a24ccc922ef18f2bdbafa873ee0afe41038e9583ff9606ae64141e111be75" gracePeriod=45
Sep 18 14:10:02.775253 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:02.775223    2575 generic.go:356] "Generic (PLEG): container finished" podID="23fc7689-aa84-49d2-b919-bd8369b03740" containerID="c61a24ccc922ef18f2bdbafa873ee0afe41038e9583ff9606ae64141e111be75" exitCode=0
Sep 18 14:10:02.775428 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:02.775310    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt" event={"ID":"23fc7689-aa84-49d2-b919-bd8369b03740","Type":"ContainerDied","Data":"c61a24ccc922ef18f2bdbafa873ee0afe41038e9583ff9606ae64141e111be75"}
Sep 18 14:10:02.863043 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:02.863014    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:10:03.017304 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.017207    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23fc7689-aa84-49d2-b919-bd8369b03740-tls-certs\") pod \"23fc7689-aa84-49d2-b919-bd8369b03740\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") "
Sep 18 14:10:03.017304 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.017252    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-home\") pod \"23fc7689-aa84-49d2-b919-bd8369b03740\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") "
Sep 18 14:10:03.017304 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.017298    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-dshm\") pod \"23fc7689-aa84-49d2-b919-bd8369b03740\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") "
Sep 18 14:10:03.017643 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.017427    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvc9l\" (UniqueName: \"kubernetes.io/projected/23fc7689-aa84-49d2-b919-bd8369b03740-kube-api-access-zvc9l\") pod \"23fc7689-aa84-49d2-b919-bd8369b03740\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") "
Sep 18 14:10:03.017643 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.017502    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-model-cache\") pod \"23fc7689-aa84-49d2-b919-bd8369b03740\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") "
Sep 18 14:10:03.017643 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.017580    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-home" (OuterVolumeSpecName: "home") pod "23fc7689-aa84-49d2-b919-bd8369b03740" (UID: "23fc7689-aa84-49d2-b919-bd8369b03740"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:10:03.017643 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.017605    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-tmp-dir\") pod \"23fc7689-aa84-49d2-b919-bd8369b03740\" (UID: \"23fc7689-aa84-49d2-b919-bd8369b03740\") "
Sep 18 14:10:03.017866 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.017737    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-model-cache" (OuterVolumeSpecName: "model-cache") pod "23fc7689-aa84-49d2-b919-bd8369b03740" (UID: "23fc7689-aa84-49d2-b919-bd8369b03740"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:10:03.017925 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.017873    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "23fc7689-aa84-49d2-b919-bd8369b03740" (UID: "23fc7689-aa84-49d2-b919-bd8369b03740"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:10:03.018064 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.018041    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-model-cache\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:03.018064 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.018061    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-tmp-dir\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:03.018196 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.018074    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-home\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:03.019641 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.019615    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23fc7689-aa84-49d2-b919-bd8369b03740-kube-api-access-zvc9l" (OuterVolumeSpecName: "kube-api-access-zvc9l") pod "23fc7689-aa84-49d2-b919-bd8369b03740" (UID: "23fc7689-aa84-49d2-b919-bd8369b03740"). InnerVolumeSpecName "kube-api-access-zvc9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:10:03.019826 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.019798    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23fc7689-aa84-49d2-b919-bd8369b03740-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "23fc7689-aa84-49d2-b919-bd8369b03740" (UID: "23fc7689-aa84-49d2-b919-bd8369b03740"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:10:03.019826 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.019802    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-dshm" (OuterVolumeSpecName: "dshm") pod "23fc7689-aa84-49d2-b919-bd8369b03740" (UID: "23fc7689-aa84-49d2-b919-bd8369b03740"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:10:03.119477 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.119441    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23fc7689-aa84-49d2-b919-bd8369b03740-tls-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:03.119477 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.119472    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23fc7689-aa84-49d2-b919-bd8369b03740-dshm\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:03.119477 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.119481    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvc9l\" (UniqueName: \"kubernetes.io/projected/23fc7689-aa84-49d2-b919-bd8369b03740-kube-api-access-zvc9l\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:03.782933 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.782902    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"
Sep 18 14:10:03.783375 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.782939    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt" event={"ID":"23fc7689-aa84-49d2-b919-bd8369b03740","Type":"ContainerDied","Data":"d339a26399b733a2adf0176f81879c6cea6177577a30400e513a3bbebae631bc"}
Sep 18 14:10:03.783375 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.782990    2575 scope.go:117] "RemoveContainer" containerID="c61a24ccc922ef18f2bdbafa873ee0afe41038e9583ff9606ae64141e111be75"
Sep 18 14:10:03.806985 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.806958    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"]
Sep 18 14:10:03.815505 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:03.815481    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-783872/auth-test-model-783872-kserve-66478d868c-w4pbt"]
Sep 18 14:10:04.294104 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:04.294065    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23fc7689-aa84-49d2-b919-bd8369b03740" path="/var/lib/kubelet/pods/23fc7689-aa84-49d2-b919-bd8369b03740/volumes"
Sep 18 14:10:05.516897 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.516859    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"]
Sep 18 14:10:05.517398 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.517104    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp" podUID="97eda5f6-4213-4b71-a4fe-5e4e81045564" containerName="payload-processing" containerID="cri-o://1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4" gracePeriod=30
Sep 18 14:10:05.686507 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.686474    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"]
Sep 18 14:10:05.690785 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.690757    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb3054-gtcdm"]
Sep 18 14:10:05.796478 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.796451    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:10:05.798609 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.798580    2575 generic.go:356] "Generic (PLEG): container finished" podID="97eda5f6-4213-4b71-a4fe-5e4e81045564" containerID="1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4" exitCode=0
Sep 18 14:10:05.798730 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.798612    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"
Sep 18 14:10:05.798730 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.798618    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp" event={"ID":"97eda5f6-4213-4b71-a4fe-5e4e81045564","Type":"ContainerDied","Data":"1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4"}
Sep 18 14:10:05.798730 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.798670    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp" event={"ID":"97eda5f6-4213-4b71-a4fe-5e4e81045564","Type":"ContainerDied","Data":"39963895bf97cc7cbee1767d3cba09503bcabe847e4403ba3036b76b565242b0"}
Sep 18 14:10:05.798730 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.798695    2575 scope.go:117] "RemoveContainer" containerID="1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4"
Sep 18 14:10:05.807638 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.807620    2575 scope.go:117] "RemoveContainer" containerID="1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4"
Sep 18 14:10:05.807909 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:10:05.807890    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4\": container with ID starting with 1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4 not found: ID does not exist" containerID="1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4"
Sep 18 14:10:05.807951 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.807920    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4"} err="failed to get container status \"1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4\": rpc error: code = NotFound desc = could not find container \"1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4\": container with ID starting with 1539a609ac717d13b1c372fd1e8e44456a2f8c67873701a59bd3c4f865e98ac4 not found: ID does not exist"
Sep 18 14:10:05.946201 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.946171    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr8d5\" (UniqueName: \"kubernetes.io/projected/97eda5f6-4213-4b71-a4fe-5e4e81045564-kube-api-access-tr8d5\") pod \"97eda5f6-4213-4b71-a4fe-5e4e81045564\" (UID: \"97eda5f6-4213-4b71-a4fe-5e4e81045564\") "
Sep 18 14:10:05.946369 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.946300    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eda5f6-4213-4b71-a4fe-5e4e81045564-plugins-config-volume\") pod \"97eda5f6-4213-4b71-a4fe-5e4e81045564\" (UID: \"97eda5f6-4213-4b71-a4fe-5e4e81045564\") "
Sep 18 14:10:05.946678 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.946655    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97eda5f6-4213-4b71-a4fe-5e4e81045564-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97eda5f6-4213-4b71-a4fe-5e4e81045564" (UID: "97eda5f6-4213-4b71-a4fe-5e4e81045564"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:10:05.948272 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:05.948252    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97eda5f6-4213-4b71-a4fe-5e4e81045564-kube-api-access-tr8d5" (OuterVolumeSpecName: "kube-api-access-tr8d5") pod "97eda5f6-4213-4b71-a4fe-5e4e81045564" (UID: "97eda5f6-4213-4b71-a4fe-5e4e81045564"). InnerVolumeSpecName "kube-api-access-tr8d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:10:06.047704 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:06.047673    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr8d5\" (UniqueName: \"kubernetes.io/projected/97eda5f6-4213-4b71-a4fe-5e4e81045564-kube-api-access-tr8d5\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:06.047704 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:06.047703    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eda5f6-4213-4b71-a4fe-5e4e81045564-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:06.121399 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:06.121366    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"]
Sep 18 14:10:06.126805 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:06.126780    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp"]
Sep 18 14:10:06.294786 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:06.294754    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ea7747a-c0d5-42b4-adbf-d40375759643" path="/var/lib/kubelet/pods/2ea7747a-c0d5-42b4-adbf-d40375759643/volumes"
Sep 18 14:10:06.295218 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:06.295202    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97eda5f6-4213-4b71-a4fe-5e4e81045564" path="/var/lib/kubelet/pods/97eda5f6-4213-4b71-a4fe-5e4e81045564/volumes"
Sep 18 14:10:07.636501 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.636462    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 14:10:07.767525 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.767442    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-data\") pod \"b52115b0-5068-47e8-801e-8114d9abe026\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") "
Sep 18 14:10:07.767525 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.767491    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-istio-token\") pod \"b52115b0-5068-47e8-801e-8114d9abe026\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") "
Sep 18 14:10:07.767723 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.767530    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-socket\") pod \"b52115b0-5068-47e8-801e-8114d9abe026\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") "
Sep 18 14:10:07.767723 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.767568    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-certs\") pod \"b52115b0-5068-47e8-801e-8114d9abe026\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") "
Sep 18 14:10:07.767723 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.767591    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b52115b0-5068-47e8-801e-8114d9abe026-istio-podinfo\") pod \"b52115b0-5068-47e8-801e-8114d9abe026\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") "
Sep 18 14:10:07.767723 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.767616    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-credential-socket\") pod \"b52115b0-5068-47e8-801e-8114d9abe026\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") "
Sep 18 14:10:07.767723 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.767665    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-envoy\") pod \"b52115b0-5068-47e8-801e-8114d9abe026\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") "
Sep 18 14:10:07.767960 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.767731    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b52115b0-5068-47e8-801e-8114d9abe026-istiod-ca-cert\") pod \"b52115b0-5068-47e8-801e-8114d9abe026\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") "
Sep 18 14:10:07.767960 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.767774    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmg8k\" (UniqueName: \"kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-kube-api-access-pmg8k\") pod \"b52115b0-5068-47e8-801e-8114d9abe026\" (UID: \"b52115b0-5068-47e8-801e-8114d9abe026\") "
Sep 18 14:10:07.767960 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.767833    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b52115b0-5068-47e8-801e-8114d9abe026" (UID: "b52115b0-5068-47e8-801e-8114d9abe026"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:10:07.767960 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.767889    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b52115b0-5068-47e8-801e-8114d9abe026" (UID: "b52115b0-5068-47e8-801e-8114d9abe026"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:10:07.768245 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.768095    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b52115b0-5068-47e8-801e-8114d9abe026" (UID: "b52115b0-5068-47e8-801e-8114d9abe026"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:10:07.768245 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.768162    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b52115b0-5068-47e8-801e-8114d9abe026-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b52115b0-5068-47e8-801e-8114d9abe026" (UID: "b52115b0-5068-47e8-801e-8114d9abe026"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:10:07.768364 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.768243    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-data" (OuterVolumeSpecName: "istio-data") pod "b52115b0-5068-47e8-801e-8114d9abe026" (UID: "b52115b0-5068-47e8-801e-8114d9abe026"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:10:07.768364 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.768342    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:07.768364 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.768358    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-credential-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:07.768521 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.768369    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b52115b0-5068-47e8-801e-8114d9abe026-istiod-ca-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:07.768521 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.768378    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-data\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:07.768521 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.768390    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-workload-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:07.769937 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.769903    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-kube-api-access-pmg8k" (OuterVolumeSpecName: "kube-api-access-pmg8k") pod "b52115b0-5068-47e8-801e-8114d9abe026" (UID: "b52115b0-5068-47e8-801e-8114d9abe026"). InnerVolumeSpecName "kube-api-access-pmg8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:10:07.769937 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.769916    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-istio-token" (OuterVolumeSpecName: "istio-token") pod "b52115b0-5068-47e8-801e-8114d9abe026" (UID: "b52115b0-5068-47e8-801e-8114d9abe026"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:10:07.770229 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.770211    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b52115b0-5068-47e8-801e-8114d9abe026-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b52115b0-5068-47e8-801e-8114d9abe026" (UID: "b52115b0-5068-47e8-801e-8114d9abe026"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:10:07.770229 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.770216    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b52115b0-5068-47e8-801e-8114d9abe026" (UID: "b52115b0-5068-47e8-801e-8114d9abe026"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:10:07.814362 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.814333    2575 generic.go:356] "Generic (PLEG): container finished" podID="b52115b0-5068-47e8-801e-8114d9abe026" containerID="5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7" exitCode=0
Sep 18 14:10:07.814496 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.814383    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"
Sep 18 14:10:07.814496 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.814424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" event={"ID":"b52115b0-5068-47e8-801e-8114d9abe026","Type":"ContainerDied","Data":"5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7"}
Sep 18 14:10:07.814496 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.814479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l" event={"ID":"b52115b0-5068-47e8-801e-8114d9abe026","Type":"ContainerDied","Data":"f4f43bc85966aa9696112705c4ad55703898727d192d648a3113822eeb7d9bca"}
Sep 18 14:10:07.814636 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.814504    2575 scope.go:117] "RemoveContainer" containerID="5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7"
Sep 18 14:10:07.824705 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.824691    2575 scope.go:117] "RemoveContainer" containerID="cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456"
Sep 18 14:10:07.834288 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.834270    2575 scope.go:117] "RemoveContainer" containerID="5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7"
Sep 18 14:10:07.834638 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:10:07.834610    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7\": container with ID starting with 5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7 not found: ID does not exist" containerID="5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7"
Sep 18 14:10:07.834713 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.834651    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7"} err="failed to get container status \"5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7\": rpc error: code = NotFound desc = could not find container \"5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7\": container with ID starting with 5ee151f2bb45cb0c2b3bbfc17944818665e0ae771348c745db1297a4dd59a2e7 not found: ID does not exist"
Sep 18 14:10:07.834713 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.834679    2575 scope.go:117] "RemoveContainer" containerID="cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456"
Sep 18 14:10:07.835008 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:10:07.834985    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456\": container with ID starting with cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456 not found: ID does not exist" containerID="cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456"
Sep 18 14:10:07.835103 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.835018    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456"} err="failed to get container status \"cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456\": rpc error: code = NotFound desc = could not find container \"cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456\": container with ID starting with cbe47846e6b4abb015526a5609b95d95661d5e3a6917b42cc444ed0eb904d456 not found: ID does not exist"
Sep 18 14:10:07.848240 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.848209    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"]
Sep 18 14:10:07.853380 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.853355    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l"]
Sep 18 14:10:07.869535 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.869510    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmg8k\" (UniqueName: \"kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-kube-api-access-pmg8k\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:07.869535 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.869533    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b52115b0-5068-47e8-801e-8114d9abe026-istio-token\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:07.869670 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.869544    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b52115b0-5068-47e8-801e-8114d9abe026-istio-podinfo\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:07.869670 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:07.869552    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b52115b0-5068-47e8-801e-8114d9abe026-istio-envoy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:08.293320 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:08.293291    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b52115b0-5068-47e8-801e-8114d9abe026" path="/var/lib/kubelet/pods/b52115b0-5068-47e8-801e-8114d9abe026/volumes"
Sep 18 14:10:12.828365 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828331    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"]
Sep 18 14:10:12.828835 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828810    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23fc7689-aa84-49d2-b919-bd8369b03740" containerName="main"
Sep 18 14:10:12.828835 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828825    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="23fc7689-aa84-49d2-b919-bd8369b03740" containerName="main"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828841    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828846    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828853    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d6b44e5-ae6d-4382-a015-88c24edfc2bd" containerName="main"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828859    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d6b44e5-ae6d-4382-a015-88c24edfc2bd" containerName="main"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828865    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828870    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828888    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ea7747a-c0d5-42b4-adbf-d40375759643" containerName="revoke-keys"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828893    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ea7747a-c0d5-42b4-adbf-d40375759643" containerName="revoke-keys"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828901    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828906    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828914    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97eda5f6-4213-4b71-a4fe-5e4e81045564" containerName="payload-processing"
Sep 18 14:10:12.828916 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828920    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="97eda5f6-4213-4b71-a4fe-5e4e81045564" containerName="payload-processing"
Sep 18 14:10:12.829298 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828929    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ddebbe5-776d-4979-a32f-f7e1ad7b98b3" containerName="payload-pre-processing"
Sep 18 14:10:12.829298 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.828934    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ddebbe5-776d-4979-a32f-f7e1ad7b98b3" containerName="payload-pre-processing"
Sep 18 14:10:12.829298 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.829000    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="97eda5f6-4213-4b71-a4fe-5e4e81045564" containerName="payload-processing"
Sep 18 14:10:12.829298 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.829008    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy"
Sep 18 14:10:12.829298 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.829014    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d6b44e5-ae6d-4382-a015-88c24edfc2bd" containerName="main"
Sep 18 14:10:12.829298 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.829020    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ddebbe5-776d-4979-a32f-f7e1ad7b98b3" containerName="payload-pre-processing"
Sep 18 14:10:12.829298 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.829026    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy"
Sep 18 14:10:12.829298 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.829032    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ea7747a-c0d5-42b4-adbf-d40375759643" containerName="revoke-keys"
Sep 18 14:10:12.829298 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.829039    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="23fc7689-aa84-49d2-b919-bd8369b03740" containerName="main"
Sep 18 14:10:12.833432 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.833415    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"
Sep 18 14:10:12.836851 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.836826    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:10:12.840244 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:12.840217    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"]
Sep 18 14:10:13.023346 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:13.023299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e1262a1-b9a1-4c90-b7df-c32cca8c1b55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp\" (UID: \"5e1262a1-b9a1-4c90-b7df-c32cca8c1b55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"
Sep 18 14:10:13.124210 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:13.124091    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e1262a1-b9a1-4c90-b7df-c32cca8c1b55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp\" (UID: \"5e1262a1-b9a1-4c90-b7df-c32cca8c1b55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"
Sep 18 14:10:13.124820 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:13.124794    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e1262a1-b9a1-4c90-b7df-c32cca8c1b55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp\" (UID: \"5e1262a1-b9a1-4c90-b7df-c32cca8c1b55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"
Sep 18 14:10:13.146823 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:13.146786    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"
Sep 18 14:10:13.422490 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:13.422464    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"]
Sep 18 14:10:13.424443 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:10:13.424414    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1262a1_b9a1_4c90_b7df_c32cca8c1b55.slice/crio-9e241c8163b64b41bd1e67333b26dd238c7017299a7d26037915fa649edcac0f WatchSource:0}: Error finding container 9e241c8163b64b41bd1e67333b26dd238c7017299a7d26037915fa649edcac0f: Status 404 returned error can't find the container with id 9e241c8163b64b41bd1e67333b26dd238c7017299a7d26037915fa649edcac0f
Sep 18 14:10:13.860880 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:13.860832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp" event={"ID":"5e1262a1-b9a1-4c90-b7df-c32cca8c1b55","Type":"ContainerStarted","Data":"3efb26ea496620d673c15f3357da0a42c8a17285aa72986ee87fc57c5c7c6e94"}
Sep 18 14:10:13.861321 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:13.860918    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp" event={"ID":"5e1262a1-b9a1-4c90-b7df-c32cca8c1b55","Type":"ContainerStarted","Data":"9e241c8163b64b41bd1e67333b26dd238c7017299a7d26037915fa649edcac0f"}
Sep 18 14:10:13.877898 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:13.877850    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp" podStartSLOduration=1.8778333 podStartE2EDuration="1.8778333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:10:13.875723317 +0000 UTC m=+1539.711562031" watchObservedRunningTime="2026-09-18 14:10:13.8778333 +0000 UTC m=+1539.713672013"
Sep 18 14:10:14.869697 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:14.869659    2575 generic.go:356] "Generic (PLEG): container finished" podID="5e1262a1-b9a1-4c90-b7df-c32cca8c1b55" containerID="3efb26ea496620d673c15f3357da0a42c8a17285aa72986ee87fc57c5c7c6e94" exitCode=0
Sep 18 14:10:14.870088 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:14.869742    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp" event={"ID":"5e1262a1-b9a1-4c90-b7df-c32cca8c1b55","Type":"ContainerDied","Data":"3efb26ea496620d673c15f3357da0a42c8a17285aa72986ee87fc57c5c7c6e94"}
Sep 18 14:10:16.017249 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:16.017226    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"
Sep 18 14:10:16.055523 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:16.055480    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e1262a1-b9a1-4c90-b7df-c32cca8c1b55-maas-api-service-ca\") pod \"5e1262a1-b9a1-4c90-b7df-c32cca8c1b55\" (UID: \"5e1262a1-b9a1-4c90-b7df-c32cca8c1b55\") "
Sep 18 14:10:16.055832 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:16.055803    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e1262a1-b9a1-4c90-b7df-c32cca8c1b55-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5e1262a1-b9a1-4c90-b7df-c32cca8c1b55" (UID: "5e1262a1-b9a1-4c90-b7df-c32cca8c1b55"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:10:16.156642 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:16.156546    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e1262a1-b9a1-4c90-b7df-c32cca8c1b55-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:16.886303 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:16.886272    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"
Sep 18 14:10:16.886303 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:16.886287    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp" event={"ID":"5e1262a1-b9a1-4c90-b7df-c32cca8c1b55","Type":"ContainerDied","Data":"9e241c8163b64b41bd1e67333b26dd238c7017299a7d26037915fa649edcac0f"}
Sep 18 14:10:16.886540 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:16.886345    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e241c8163b64b41bd1e67333b26dd238c7017299a7d26037915fa649edcac0f"
Sep 18 14:10:23.597958 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:23.597919    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"]
Sep 18 14:10:23.600744 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:23.600718    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-e46fbf-v8bmp"]
Sep 18 14:10:24.293971 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:24.293933    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e1262a1-b9a1-4c90-b7df-c32cca8c1b55" path="/var/lib/kubelet/pods/5e1262a1-b9a1-4c90-b7df-c32cca8c1b55/volumes"
Sep 18 14:10:30.606026 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.605989    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"]
Sep 18 14:10:30.606509 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.606496    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e1262a1-b9a1-4c90-b7df-c32cca8c1b55" containerName="revoke-keys"
Sep 18 14:10:30.606556 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.606511    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e1262a1-b9a1-4c90-b7df-c32cca8c1b55" containerName="revoke-keys"
Sep 18 14:10:30.606556 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.606520    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy"
Sep 18 14:10:30.606556 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.606526    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy"
Sep 18 14:10:30.606651 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.606606    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e1262a1-b9a1-4c90-b7df-c32cca8c1b55" containerName="revoke-keys"
Sep 18 14:10:30.606651 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.606620    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b52115b0-5068-47e8-801e-8114d9abe026" containerName="istio-proxy"
Sep 18 14:10:30.606651 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.606628    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d10805f-2250-4f05-97d5-57a8ef96ca75" containerName="istio-proxy"
Sep 18 14:10:30.609775 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.609754    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"
Sep 18 14:10:30.613282 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.613260    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:10:30.619473 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.619447    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"]
Sep 18 14:10:30.712046 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.712003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv\" (UID: \"139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"
Sep 18 14:10:30.812843 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.812799    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv\" (UID: \"139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"
Sep 18 14:10:30.813523 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.813500    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv\" (UID: \"139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"
Sep 18 14:10:30.922187 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:30.922095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"
Sep 18 14:10:31.199350 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:31.199291    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"]
Sep 18 14:10:31.201938 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:10:31.201906    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139fa4f2_d8cd_45c3_9a9e_2fda2f76bf59.slice/crio-25461e526430e1aea67d6f80d4428187b7188eca0ffc6d402713798335fcc049 WatchSource:0}: Error finding container 25461e526430e1aea67d6f80d4428187b7188eca0ffc6d402713798335fcc049: Status 404 returned error can't find the container with id 25461e526430e1aea67d6f80d4428187b7188eca0ffc6d402713798335fcc049
Sep 18 14:10:31.979977 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:31.979936    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv" event={"ID":"139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59","Type":"ContainerStarted","Data":"224c6c870265dbc31bdb58da4ec3cd1c2d2aed61e9fff07efaa8e64162729e7c"}
Sep 18 14:10:31.980402 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:31.980006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv" event={"ID":"139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59","Type":"ContainerStarted","Data":"25461e526430e1aea67d6f80d4428187b7188eca0ffc6d402713798335fcc049"}
Sep 18 14:10:31.997418 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:31.997363    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv" podStartSLOduration=1.997344827 podStartE2EDuration="1.997344827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:10:31.995459736 +0000 UTC m=+1557.831298446" watchObservedRunningTime="2026-09-18 14:10:31.997344827 +0000 UTC m=+1557.833183539"
Sep 18 14:10:32.994840 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:32.994804    2575 generic.go:356] "Generic (PLEG): container finished" podID="139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59" containerID="224c6c870265dbc31bdb58da4ec3cd1c2d2aed61e9fff07efaa8e64162729e7c" exitCode=0
Sep 18 14:10:32.995254 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:32.994851    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv" event={"ID":"139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59","Type":"ContainerDied","Data":"224c6c870265dbc31bdb58da4ec3cd1c2d2aed61e9fff07efaa8e64162729e7c"}
Sep 18 14:10:34.139304 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:34.139275    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"
Sep 18 14:10:34.249992 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:34.249958    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59-maas-api-service-ca\") pod \"139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59\" (UID: \"139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59\") "
Sep 18 14:10:34.250343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:34.250318    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59" (UID: "139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:10:34.351680 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:34.351641    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:35.009831 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:35.009802    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"
Sep 18 14:10:35.009974 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:35.009805    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv" event={"ID":"139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59","Type":"ContainerDied","Data":"25461e526430e1aea67d6f80d4428187b7188eca0ffc6d402713798335fcc049"}
Sep 18 14:10:35.009974 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:35.009950    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25461e526430e1aea67d6f80d4428187b7188eca0ffc6d402713798335fcc049"
Sep 18 14:10:36.679816 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:36.679787    2575 scope.go:117] "RemoveContainer" containerID="00fdaa7810213fb43c875e92c934e82ea0c0aa670f3972f84cd86c895efcc8f3"
Sep 18 14:10:41.104333 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:41.104004    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"]
Sep 18 14:10:41.105083 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:41.105039    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn" podUID="88900b46-be4f-42bb-9f86-ce29436f45bf" containerName="payload-pre-processing" containerID="cri-o://f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1" gracePeriod=30
Sep 18 14:10:41.290996 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:41.290956    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"]
Sep 18 14:10:41.293066 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:41.293037    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55bd4d-6lrtv"]
Sep 18 14:10:41.381851 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:41.381779    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:10:41.529987 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:41.529955    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88900b46-be4f-42bb-9f86-ce29436f45bf-plugins-config-volume\") pod \"88900b46-be4f-42bb-9f86-ce29436f45bf\" (UID: \"88900b46-be4f-42bb-9f86-ce29436f45bf\") "
Sep 18 14:10:41.530221 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:41.530003    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls756\" (UniqueName: \"kubernetes.io/projected/88900b46-be4f-42bb-9f86-ce29436f45bf-kube-api-access-ls756\") pod \"88900b46-be4f-42bb-9f86-ce29436f45bf\" (UID: \"88900b46-be4f-42bb-9f86-ce29436f45bf\") "
Sep 18 14:10:41.530340 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:41.530316    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88900b46-be4f-42bb-9f86-ce29436f45bf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "88900b46-be4f-42bb-9f86-ce29436f45bf" (UID: "88900b46-be4f-42bb-9f86-ce29436f45bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:10:41.532116 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:41.532091    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88900b46-be4f-42bb-9f86-ce29436f45bf-kube-api-access-ls756" (OuterVolumeSpecName: "kube-api-access-ls756") pod "88900b46-be4f-42bb-9f86-ce29436f45bf" (UID: "88900b46-be4f-42bb-9f86-ce29436f45bf"). InnerVolumeSpecName "kube-api-access-ls756". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:10:41.631765 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:41.631681    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88900b46-be4f-42bb-9f86-ce29436f45bf-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:41.631765 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:41.631712    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls756\" (UniqueName: \"kubernetes.io/projected/88900b46-be4f-42bb-9f86-ce29436f45bf-kube-api-access-ls756\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:10:42.055836 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:42.055799    2575 generic.go:356] "Generic (PLEG): container finished" podID="88900b46-be4f-42bb-9f86-ce29436f45bf" containerID="f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1" exitCode=0
Sep 18 14:10:42.055990 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:42.055849    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"
Sep 18 14:10:42.055990 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:42.055885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn" event={"ID":"88900b46-be4f-42bb-9f86-ce29436f45bf","Type":"ContainerDied","Data":"f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1"}
Sep 18 14:10:42.055990 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:42.055946    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn" event={"ID":"88900b46-be4f-42bb-9f86-ce29436f45bf","Type":"ContainerDied","Data":"8aa0a5051d55816432ad636a66e404ff972d1f1f9c6dcc2f5c7b322aaffd552f"}
Sep 18 14:10:42.055990 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:42.055971    2575 scope.go:117] "RemoveContainer" containerID="f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1"
Sep 18 14:10:42.065649 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:42.065630    2575 scope.go:117] "RemoveContainer" containerID="f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1"
Sep 18 14:10:42.065966 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:10:42.065945    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1\": container with ID starting with f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1 not found: ID does not exist" containerID="f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1"
Sep 18 14:10:42.066036 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:42.065974    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1"} err="failed to get container status \"f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1\": rpc error: code = NotFound desc = could not find container \"f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1\": container with ID starting with f08979f23d71e07ace83a78ad8f07b1ac7b724946d5abf726ac389139ddc11d1 not found: ID does not exist"
Sep 18 14:10:42.079461 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:42.079438    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"]
Sep 18 14:10:42.084290 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:42.084268    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn"]
Sep 18 14:10:42.293812 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:42.293774    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59" path="/var/lib/kubelet/pods/139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59/volumes"
Sep 18 14:10:42.294195 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:10:42.294156    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88900b46-be4f-42bb-9f86-ce29436f45bf" path="/var/lib/kubelet/pods/88900b46-be4f-42bb-9f86-ce29436f45bf/volumes"
Sep 18 14:12:36.740714 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:36.740673    2575 scope.go:117] "RemoveContainer" containerID="4fff6a8c680a78460833547ad4f2ad1c195b54d90fb9e736ccd2e18a7b3a6ed5"
Sep 18 14:12:38.013214 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.013176    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"]
Sep 18 14:12:38.013725 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.013709    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88900b46-be4f-42bb-9f86-ce29436f45bf" containerName="payload-pre-processing"
Sep 18 14:12:38.013771 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.013728    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="88900b46-be4f-42bb-9f86-ce29436f45bf" containerName="payload-pre-processing"
Sep 18 14:12:38.013771 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.013757    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59" containerName="revoke-keys"
Sep 18 14:12:38.013771 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.013763    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59" containerName="revoke-keys"
Sep 18 14:12:38.013880 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.013835    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="139fa4f2-d8cd-45c3-9a9e-2fda2f76bf59" containerName="revoke-keys"
Sep 18 14:12:38.013880 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.013848    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="88900b46-be4f-42bb-9f86-ce29436f45bf" containerName="payload-pre-processing"
Sep 18 14:12:38.018561 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.018544    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:12:38.021710 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.021685    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b6289c-dockercfg-5gwn6\""
Sep 18 14:12:38.021922 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.021902    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b6289c\""
Sep 18 14:12:38.031933 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.031908    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"]
Sep 18 14:12:38.176483 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.176448    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf8px\" (UniqueName: \"kubernetes.io/projected/4d6f0425-f05c-4723-93c6-964ed91c85ae-kube-api-access-kf8px\") pod \"payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc\" (UID: \"4d6f0425-f05c-4723-93c6-964ed91c85ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:12:38.176633 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.176491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d6f0425-f05c-4723-93c6-964ed91c85ae-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc\" (UID: \"4d6f0425-f05c-4723-93c6-964ed91c85ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:12:38.277845 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.277749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d6f0425-f05c-4723-93c6-964ed91c85ae-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc\" (UID: \"4d6f0425-f05c-4723-93c6-964ed91c85ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:12:38.278086 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.277889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf8px\" (UniqueName: \"kubernetes.io/projected/4d6f0425-f05c-4723-93c6-964ed91c85ae-kube-api-access-kf8px\") pod \"payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc\" (UID: \"4d6f0425-f05c-4723-93c6-964ed91c85ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:12:38.278589 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.278563    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d6f0425-f05c-4723-93c6-964ed91c85ae-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc\" (UID: \"4d6f0425-f05c-4723-93c6-964ed91c85ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:12:38.292247 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.292216    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf8px\" (UniqueName: \"kubernetes.io/projected/4d6f0425-f05c-4723-93c6-964ed91c85ae-kube-api-access-kf8px\") pod \"payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc\" (UID: \"4d6f0425-f05c-4723-93c6-964ed91c85ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:12:38.329889 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.329864    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:12:38.611582 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.611553    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"]
Sep 18 14:12:38.612373 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:12:38.612348    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6f0425_f05c_4723_93c6_964ed91c85ae.slice/crio-62132a15ed5f89d59ebba2614160dee2abe612292555a6b0e0d6e8e087cdfd16 WatchSource:0}: Error finding container 62132a15ed5f89d59ebba2614160dee2abe612292555a6b0e0d6e8e087cdfd16: Status 404 returned error can't find the container with id 62132a15ed5f89d59ebba2614160dee2abe612292555a6b0e0d6e8e087cdfd16
Sep 18 14:12:38.765700 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.765651    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc" event={"ID":"4d6f0425-f05c-4723-93c6-964ed91c85ae","Type":"ContainerStarted","Data":"71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6"}
Sep 18 14:12:38.765885 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.765725    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:12:38.765885 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.765747    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc" event={"ID":"4d6f0425-f05c-4723-93c6-964ed91c85ae","Type":"ContainerStarted","Data":"62132a15ed5f89d59ebba2614160dee2abe612292555a6b0e0d6e8e087cdfd16"}
Sep 18 14:12:38.789090 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:38.789032    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc" podStartSLOduration=1.789016446 podStartE2EDuration="1.789016446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:12:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:12:38.787893862 +0000 UTC m=+1684.623732576" watchObservedRunningTime="2026-09-18 14:12:38.789016446 +0000 UTC m=+1684.624855160"
Sep 18 14:12:49.774731 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:12:49.774647    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:13:33.585935 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:13:33.585900    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-qmrgz_55bf2a5c-0c24-49ae-9b43-96af77cf2b54/payload-processing/0.log"
Sep 18 14:13:36.770920 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:13:36.770889    2575 scope.go:117] "RemoveContainer" containerID="0453f77424da400df7f6dafb73fcdd76c920a2a064b9cc63b438458106b360f9"
Sep 18 14:14:14.803250 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:14.803220    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc_4d6f0425-f05c-4723-93c6-964ed91c85ae/payload-processing/0.log"
Sep 18 14:14:14.929617 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:14.929580    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-qmrgz_55bf2a5c-0c24-49ae-9b43-96af77cf2b54/payload-processing/0.log"
Sep 18 14:14:15.742899 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.742867    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"]
Sep 18 14:14:15.746981 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.746958    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.750524 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.750505    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-cafbd6-openshift-default-dockercfg-pdmfb\""
Sep 18 14:14:15.762852 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.762820    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"]
Sep 18 14:14:15.868041 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.868005    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrrz\" (UniqueName: \"kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-kube-api-access-2jrrz\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.868432 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.868048    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-certs\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.868432 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.868155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-credential-socket\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.868432 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.868180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-envoy\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.868432 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.868197    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-data\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.868432 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.868217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-token\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.868432 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.868274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad3e318-450a-4519-82ff-efd93ed3aea7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.868432 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.868304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-podinfo\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.868432 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.868328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-socket\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.968960 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.968924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrrz\" (UniqueName: \"kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-kube-api-access-2jrrz\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.968960 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.968972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-certs\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969250 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969022    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-credential-socket\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969250 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969046    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-envoy\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969250 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-data\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969250 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-token\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969250 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad3e318-450a-4519-82ff-efd93ed3aea7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969250 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-podinfo\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969568 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-socket\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969568 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969504    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-credential-socket\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969568 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969549    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-data\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969728 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969642    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-certs\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969792 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969735    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-socket\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.969924 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.969902    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad3e318-450a-4519-82ff-efd93ed3aea7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.971503 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.971485    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-envoy\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.971799 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.971779    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-podinfo\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.977645 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.977625    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-token\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:15.977817 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:15.977798    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrrz\" (UniqueName: \"kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-kube-api-access-2jrrz\") pod \"e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") " pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:16.061934 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:16.061899    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:16.344309 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:16.344277    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"]
Sep 18 14:14:16.347410 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:14:16.347380    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad3e318_450a_4519_82ff_efd93ed3aea7.slice/crio-2b966215f4db68252b5b8964db0dbe5186ea0c555f810165c904222d5ef0ad69 WatchSource:0}: Error finding container 2b966215f4db68252b5b8964db0dbe5186ea0c555f810165c904222d5ef0ad69: Status 404 returned error can't find the container with id 2b966215f4db68252b5b8964db0dbe5186ea0c555f810165c904222d5ef0ad69
Sep 18 14:14:16.349893 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:16.349857    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:14:16.349975 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:16.349941    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:14:16.350015 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:16.349977    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:14:17.351173 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:17.351120    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" event={"ID":"8ad3e318-450a-4519-82ff-efd93ed3aea7","Type":"ContainerStarted","Data":"177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7"}
Sep 18 14:14:17.351650 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:17.351208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" event={"ID":"8ad3e318-450a-4519-82ff-efd93ed3aea7","Type":"ContainerStarted","Data":"2b966215f4db68252b5b8964db0dbe5186ea0c555f810165c904222d5ef0ad69"}
Sep 18 14:14:17.375179 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:17.375112    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" podStartSLOduration=2.375095416 podStartE2EDuration="2.375095416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:14:17.373599023 +0000 UTC m=+1783.209437736" watchObservedRunningTime="2026-09-18 14:14:17.375095416 +0000 UTC m=+1783.210934120"
Sep 18 14:14:18.062351 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:18.062314    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:18.067594 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:18.067567    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:18.357343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:18.357240    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:18.358271 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:18.358252    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:23.045818 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.045781    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"]
Sep 18 14:14:23.050044 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.050026    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:23.052972 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.052947    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-cafbd6\""
Sep 18 14:14:23.053094 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.052956    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-cafbd6-dockercfg-txr6q\""
Sep 18 14:14:23.058958 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.058636    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"]
Sep 18 14:14:23.147797 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.147722    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwrlh\" (UniqueName: \"kubernetes.io/projected/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-kube-api-access-mwrlh\") pod \"payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl\" (UID: \"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:23.148271 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.148237    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl\" (UID: \"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:23.248942 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.248906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl\" (UID: \"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:23.249111 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.249046    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwrlh\" (UniqueName: \"kubernetes.io/projected/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-kube-api-access-mwrlh\") pod \"payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl\" (UID: \"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:23.249601 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.249579    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl\" (UID: \"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:23.257601 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.257577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwrlh\" (UniqueName: \"kubernetes.io/projected/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-kube-api-access-mwrlh\") pod \"payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl\" (UID: \"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:23.363012 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.362926    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:23.644240 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:23.644165    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"]
Sep 18 14:14:23.648074 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:14:23.648043    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8011de_7757_4fb2_a199_b4a3f0cf8e1a.slice/crio-ec4d9d26bc3156fabeb3fbf8102a9cb2c2534f3f6afd5dca0991af1bfbfaa583 WatchSource:0}: Error finding container ec4d9d26bc3156fabeb3fbf8102a9cb2c2534f3f6afd5dca0991af1bfbfaa583: Status 404 returned error can't find the container with id ec4d9d26bc3156fabeb3fbf8102a9cb2c2534f3f6afd5dca0991af1bfbfaa583
Sep 18 14:14:24.397108 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:24.397067    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl" event={"ID":"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a","Type":"ContainerStarted","Data":"49784b70b4fa00a8571ddc2dd03e8b48bfaec38a8c09b4bee6f30e4aaeebcd32"}
Sep 18 14:14:24.397519 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:24.397126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl" event={"ID":"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a","Type":"ContainerStarted","Data":"ec4d9d26bc3156fabeb3fbf8102a9cb2c2534f3f6afd5dca0991af1bfbfaa583"}
Sep 18 14:14:24.397519 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:24.397171    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:24.417825 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:24.417766    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl" podStartSLOduration=1.417746102 podStartE2EDuration="1.417746102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:14:24.417297987 +0000 UTC m=+1790.253136700" watchObservedRunningTime="2026-09-18 14:14:24.417746102 +0000 UTC m=+1790.253584817"
Sep 18 14:14:35.405787 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:35.405759    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:36.425245 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:36.425213    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 14:14:36.428127 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:36.428100    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 14:14:36.796566 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:36.796532    2575 scope.go:117] "RemoveContainer" containerID="6a920c780dec15b0f28c9bf842ba15c06feeb675b8fca70975652e24b0ef244a"
Sep 18 14:14:39.498273 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:39.498235    2575 generic.go:356] "Generic (PLEG): container finished" podID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerID="177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7" exitCode=0
Sep 18 14:14:39.498722 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:39.498297    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" event={"ID":"8ad3e318-450a-4519-82ff-efd93ed3aea7","Type":"ContainerDied","Data":"177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7"}
Sep 18 14:14:39.498781 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:39.498770    2575 scope.go:117] "RemoveContainer" containerID="177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7"
Sep 18 14:14:39.499989 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:39.499958    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:14:39.500108 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:39.500041    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:14:39.500108 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:39.500090    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 18 14:14:40.505411 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:40.505372    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" event={"ID":"8ad3e318-450a-4519-82ff-efd93ed3aea7","Type":"ContainerStarted","Data":"a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c"}
Sep 18 14:14:41.062950 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:41.062909    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:41.063299 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:41.063267    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 18 14:14:41.063380 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:41.063337    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 18 14:14:42.062717 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:42.062670    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 18 14:14:42.063405 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:42.063348    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 18 14:14:43.062903 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:43.062850    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 18 14:14:43.063441 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:43.062948    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 18 14:14:44.063270 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:44.063232    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 18 14:14:44.063695 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:44.063287    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 18 14:14:44.957062 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:44.957008    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"]
Sep 18 14:14:44.961398 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:44.961373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"
Sep 18 14:14:44.964446 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:44.964420    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:14:44.968866 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:44.968842    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"]
Sep 18 14:14:45.062660 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:45.062625    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 18 14:14:45.062844 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:45.062699    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 18 14:14:45.097933 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:45.097899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c71dbedf-71ed-4e94-ae20-00cb9bc37114-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg\" (UID: \"c71dbedf-71ed-4e94-ae20-00cb9bc37114\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"
Sep 18 14:14:45.198810 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:45.198769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c71dbedf-71ed-4e94-ae20-00cb9bc37114-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg\" (UID: \"c71dbedf-71ed-4e94-ae20-00cb9bc37114\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"
Sep 18 14:14:45.199419 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:45.199397    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c71dbedf-71ed-4e94-ae20-00cb9bc37114-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg\" (UID: \"c71dbedf-71ed-4e94-ae20-00cb9bc37114\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"
Sep 18 14:14:45.273846 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:45.273759    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"
Sep 18 14:14:45.550987 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:45.550800    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"]
Sep 18 14:14:46.063057 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:46.063021    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 18 14:14:46.063295 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:46.063204    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 18 14:14:46.541435 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:46.541395    2575 generic.go:356] "Generic (PLEG): container finished" podID="c71dbedf-71ed-4e94-ae20-00cb9bc37114" containerID="51932c65d18f7d19f2f7a929a73bfee84ef9e3d49fb58d6ba96d883bd71bcf4a" exitCode=0
Sep 18 14:14:46.541820 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:46.541485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg" event={"ID":"c71dbedf-71ed-4e94-ae20-00cb9bc37114","Type":"ContainerDied","Data":"51932c65d18f7d19f2f7a929a73bfee84ef9e3d49fb58d6ba96d883bd71bcf4a"}
Sep 18 14:14:46.541820 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:46.541554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg" event={"ID":"c71dbedf-71ed-4e94-ae20-00cb9bc37114","Type":"ContainerStarted","Data":"5b711ba4c7fc5fb3c08aa1cbebf580627ae9dfb5770aef3c2c02dad12b75600c"}
Sep 18 14:14:47.067354 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:47.067307    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:47.067823 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:47.067797    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:47.068492 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:47.068473    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:14:47.686887 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:47.686864    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"
Sep 18 14:14:47.830542 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:47.830455    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c71dbedf-71ed-4e94-ae20-00cb9bc37114-maas-api-service-ca\") pod \"c71dbedf-71ed-4e94-ae20-00cb9bc37114\" (UID: \"c71dbedf-71ed-4e94-ae20-00cb9bc37114\") "
Sep 18 14:14:47.830813 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:47.830791    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c71dbedf-71ed-4e94-ae20-00cb9bc37114-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c71dbedf-71ed-4e94-ae20-00cb9bc37114" (UID: "c71dbedf-71ed-4e94-ae20-00cb9bc37114"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:14:47.932047 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:47.932012    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c71dbedf-71ed-4e94-ae20-00cb9bc37114-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:14:48.558239 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:48.558151    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg" event={"ID":"c71dbedf-71ed-4e94-ae20-00cb9bc37114","Type":"ContainerDied","Data":"5b711ba4c7fc5fb3c08aa1cbebf580627ae9dfb5770aef3c2c02dad12b75600c"}
Sep 18 14:14:48.558239 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:48.558176    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"
Sep 18 14:14:48.558239 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:48.558214    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b711ba4c7fc5fb3c08aa1cbebf580627ae9dfb5770aef3c2c02dad12b75600c"
Sep 18 14:14:51.316091 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.316055    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"]
Sep 18 14:14:51.316672 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.316354    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl" podUID="5c8011de-7757-4fb2-a199-b4a3f0cf8e1a" containerName="payload-processing" containerID="cri-o://49784b70b4fa00a8571ddc2dd03e8b48bfaec38a8c09b4bee6f30e4aaeebcd32" gracePeriod=30
Sep 18 14:14:51.459918 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.459872    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"]
Sep 18 14:14:51.463044 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.463014    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cafbd6-xncxg"]
Sep 18 14:14:51.579471 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.579421    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c8011de-7757-4fb2-a199-b4a3f0cf8e1a" containerID="49784b70b4fa00a8571ddc2dd03e8b48bfaec38a8c09b4bee6f30e4aaeebcd32" exitCode=0
Sep 18 14:14:51.579641 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.579529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl" event={"ID":"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a","Type":"ContainerDied","Data":"49784b70b4fa00a8571ddc2dd03e8b48bfaec38a8c09b4bee6f30e4aaeebcd32"}
Sep 18 14:14:51.579641 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.579584    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl" event={"ID":"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a","Type":"ContainerDied","Data":"ec4d9d26bc3156fabeb3fbf8102a9cb2c2534f3f6afd5dca0991af1bfbfaa583"}
Sep 18 14:14:51.579641 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.579607    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec4d9d26bc3156fabeb3fbf8102a9cb2c2534f3f6afd5dca0991af1bfbfaa583"
Sep 18 14:14:51.596368 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.596340    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:51.778264 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.778231    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwrlh\" (UniqueName: \"kubernetes.io/projected/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-kube-api-access-mwrlh\") pod \"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a\" (UID: \"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a\") "
Sep 18 14:14:51.778463 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.778351    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-plugins-config-volume\") pod \"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a\" (UID: \"5c8011de-7757-4fb2-a199-b4a3f0cf8e1a\") "
Sep 18 14:14:51.778706 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.778681    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5c8011de-7757-4fb2-a199-b4a3f0cf8e1a" (UID: "5c8011de-7757-4fb2-a199-b4a3f0cf8e1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:14:51.780463 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.780436    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-kube-api-access-mwrlh" (OuterVolumeSpecName: "kube-api-access-mwrlh") pod "5c8011de-7757-4fb2-a199-b4a3f0cf8e1a" (UID: "5c8011de-7757-4fb2-a199-b4a3f0cf8e1a"). InnerVolumeSpecName "kube-api-access-mwrlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:14:51.879598 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.879508    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:14:51.879598 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:51.879543    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwrlh\" (UniqueName: \"kubernetes.io/projected/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a-kube-api-access-mwrlh\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:14:52.293907 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:52.293829    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c71dbedf-71ed-4e94-ae20-00cb9bc37114" path="/var/lib/kubelet/pods/c71dbedf-71ed-4e94-ae20-00cb9bc37114/volumes"
Sep 18 14:14:52.585225 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:52.585193    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"
Sep 18 14:14:52.616815 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:52.616789    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"]
Sep 18 14:14:52.624514 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:52.624487    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl"]
Sep 18 14:14:54.293488 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:54.293453    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c8011de-7757-4fb2-a199-b4a3f0cf8e1a" path="/var/lib/kubelet/pods/5c8011de-7757-4fb2-a199-b4a3f0cf8e1a/volumes"
Sep 18 14:14:58.775446 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:58.775411    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"]
Sep 18 14:14:58.775932 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:14:58.775620    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy" containerID="cri-o://a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c" gracePeriod=30
Sep 18 14:15:00.142459 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.142422    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn"]
Sep 18 14:15:00.143145 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.143109    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c8011de-7757-4fb2-a199-b4a3f0cf8e1a" containerName="payload-processing"
Sep 18 14:15:00.143260 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.143157    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c8011de-7757-4fb2-a199-b4a3f0cf8e1a" containerName="payload-processing"
Sep 18 14:15:00.143260 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.143209    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c71dbedf-71ed-4e94-ae20-00cb9bc37114" containerName="revoke-keys"
Sep 18 14:15:00.143260 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.143218    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c71dbedf-71ed-4e94-ae20-00cb9bc37114" containerName="revoke-keys"
Sep 18 14:15:00.143411 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.143327    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c71dbedf-71ed-4e94-ae20-00cb9bc37114" containerName="revoke-keys"
Sep 18 14:15:00.143411 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.143342    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c8011de-7757-4fb2-a199-b4a3f0cf8e1a" containerName="payload-processing"
Sep 18 14:15:00.146489 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.146467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn"
Sep 18 14:15:00.150648 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.150623    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:15:00.155511 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.155492    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf"]
Sep 18 14:15:00.158782 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.158761    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn"
Sep 18 14:15:00.159035 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.159018    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829015-z2nbk"]
Sep 18 14:15:00.159266 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.159229    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf"
Sep 18 14:15:00.163069 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.163045    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn"]
Sep 18 14:15:00.163215 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.163195    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-z2nbk"
Sep 18 14:15:00.175216 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.175101    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf"]
Sep 18 14:15:00.179951 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.179917    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829015-z2nbk"]
Sep 18 14:15:00.197107 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.197076    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf"
Sep 18 14:15:00.204293 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.204262    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-z2nbk"
Sep 18 14:15:00.453425 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.453393    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn"]
Sep 18 14:15:00.455349 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:15:00.455318    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d66f0f_ba7d_4e9e_a07a_9da1ebb39a33.slice/crio-2601781d27459377258da96ed8daae25e594be69fa819dc6be0a8014db180620 WatchSource:0}: Error finding container 2601781d27459377258da96ed8daae25e594be69fa819dc6be0a8014db180620: Status 404 returned error can't find the container with id 2601781d27459377258da96ed8daae25e594be69fa819dc6be0a8014db180620
Sep 18 14:15:00.497412 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.497381    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf"]
Sep 18 14:15:00.499163 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:15:00.499105    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e10332_dbd9_4edd_8c15_cb197da57b0e.slice/crio-a798b09bd33c47f11510414ae69fb53afdf55653907630a79fc871f35cab8389 WatchSource:0}: Error finding container a798b09bd33c47f11510414ae69fb53afdf55653907630a79fc871f35cab8389: Status 404 returned error can't find the container with id a798b09bd33c47f11510414ae69fb53afdf55653907630a79fc871f35cab8389
Sep 18 14:15:00.514256 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.514231    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829015-z2nbk"]
Sep 18 14:15:00.515430 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:15:00.515409    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod976a7d23_dbfd_45b6_8871_b24b8ffe7f7f.slice/crio-3664f8a23f3e1dfd636ab025638292668c63b7b71ae1ee518803b8aef3c86cfe WatchSource:0}: Error finding container 3664f8a23f3e1dfd636ab025638292668c63b7b71ae1ee518803b8aef3c86cfe: Status 404 returned error can't find the container with id 3664f8a23f3e1dfd636ab025638292668c63b7b71ae1ee518803b8aef3c86cfe
Sep 18 14:15:00.636662 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.636339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn" event={"ID":"96d66f0f-ba7d-4e9e-a07a-9da1ebb39a33","Type":"ContainerStarted","Data":"2601781d27459377258da96ed8daae25e594be69fa819dc6be0a8014db180620"}
Sep 18 14:15:00.638445 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.638412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf" event={"ID":"b4e10332-dbd9-4edd-8c15-cb197da57b0e","Type":"ContainerStarted","Data":"a798b09bd33c47f11510414ae69fb53afdf55653907630a79fc871f35cab8389"}
Sep 18 14:15:00.640250 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:00.640213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-z2nbk" event={"ID":"976a7d23-dbfd-45b6-8871-b24b8ffe7f7f","Type":"ContainerStarted","Data":"3664f8a23f3e1dfd636ab025638292668c63b7b71ae1ee518803b8aef3c86cfe"}
Sep 18 14:15:01.647921 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:01.647829    2575 generic.go:356] "Generic (PLEG): container finished" podID="96d66f0f-ba7d-4e9e-a07a-9da1ebb39a33" containerID="b2c2b39a735d9f223eaf473972fd5c61619b90e512d1434f9c0e5a7379b6e447" exitCode=0
Sep 18 14:15:01.648363 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:01.647920    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn" event={"ID":"96d66f0f-ba7d-4e9e-a07a-9da1ebb39a33","Type":"ContainerDied","Data":"b2c2b39a735d9f223eaf473972fd5c61619b90e512d1434f9c0e5a7379b6e447"}
Sep 18 14:15:01.649589 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:01.649560    2575 generic.go:356] "Generic (PLEG): container finished" podID="b4e10332-dbd9-4edd-8c15-cb197da57b0e" containerID="75eb7a59187c5fbd323be0064b449f0434ce84b91e42845fbf4487d7b8152da7" exitCode=0
Sep 18 14:15:01.649715 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:01.649649    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf" event={"ID":"b4e10332-dbd9-4edd-8c15-cb197da57b0e","Type":"ContainerDied","Data":"75eb7a59187c5fbd323be0064b449f0434ce84b91e42845fbf4487d7b8152da7"}
Sep 18 14:15:01.651324 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:01.651300    2575 generic.go:356] "Generic (PLEG): container finished" podID="976a7d23-dbfd-45b6-8871-b24b8ffe7f7f" containerID="48cb073678d8a62f8ed5062ffa5834c415616ef5ead3c92ba09e27c7add4446e" exitCode=0
Sep 18 14:15:01.651410 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:01.651380    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-z2nbk" event={"ID":"976a7d23-dbfd-45b6-8871-b24b8ffe7f7f","Type":"ContainerDied","Data":"48cb073678d8a62f8ed5062ffa5834c415616ef5ead3c92ba09e27c7add4446e"}
Sep 18 14:15:02.069806 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.069770    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 18 14:15:02.069995 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.069839    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 14:15:02.347920 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.347823    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"]
Sep 18 14:15:02.351713 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.351688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"
Sep 18 14:15:02.359995 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.359964    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"]
Sep 18 14:15:02.391861 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.391818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07328c24-495f-48db-9a81-b6ed780d7e50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb\" (UID: \"07328c24-495f-48db-9a81-b6ed780d7e50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"
Sep 18 14:15:02.493525 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.493481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07328c24-495f-48db-9a81-b6ed780d7e50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb\" (UID: \"07328c24-495f-48db-9a81-b6ed780d7e50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"
Sep 18 14:15:02.494195 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.494173    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07328c24-495f-48db-9a81-b6ed780d7e50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb\" (UID: \"07328c24-495f-48db-9a81-b6ed780d7e50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"
Sep 18 14:15:02.664900 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.664864    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"
Sep 18 14:15:02.848112 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.848054    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf"
Sep 18 14:15:02.851384 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.851354    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-z2nbk"
Sep 18 14:15:02.859276 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.859247    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn"
Sep 18 14:15:02.987922 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:02.987897    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"]
Sep 18 14:15:02.988623 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:15:02.988600    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07328c24_495f_48db_9a81_b6ed780d7e50.slice/crio-013e773cb0bda5e0d4e29a9aa43d572812b53821d86ee5374fcde096cb16ab29 WatchSource:0}: Error finding container 013e773cb0bda5e0d4e29a9aa43d572812b53821d86ee5374fcde096cb16ab29: Status 404 returned error can't find the container with id 013e773cb0bda5e0d4e29a9aa43d572812b53821d86ee5374fcde096cb16ab29
Sep 18 14:15:03.665248 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.665214    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn"
Sep 18 14:15:03.665657 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.665249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn" event={"ID":"96d66f0f-ba7d-4e9e-a07a-9da1ebb39a33","Type":"ContainerDied","Data":"2601781d27459377258da96ed8daae25e594be69fa819dc6be0a8014db180620"}
Sep 18 14:15:03.665657 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.665303    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2601781d27459377258da96ed8daae25e594be69fa819dc6be0a8014db180620"
Sep 18 14:15:03.666704 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.666687    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf"
Sep 18 14:15:03.666832 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.666738    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf" event={"ID":"b4e10332-dbd9-4edd-8c15-cb197da57b0e","Type":"ContainerDied","Data":"a798b09bd33c47f11510414ae69fb53afdf55653907630a79fc871f35cab8389"}
Sep 18 14:15:03.666832 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.666783    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a798b09bd33c47f11510414ae69fb53afdf55653907630a79fc871f35cab8389"
Sep 18 14:15:03.668480 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.668460    2575 generic.go:356] "Generic (PLEG): container finished" podID="07328c24-495f-48db-9a81-b6ed780d7e50" containerID="1d3e58b233a25ba477d3032cc5a12596becf9880234f1e558b644f0701bb8dcb" exitCode=0
Sep 18 14:15:03.668590 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.668546    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb" event={"ID":"07328c24-495f-48db-9a81-b6ed780d7e50","Type":"ContainerDied","Data":"1d3e58b233a25ba477d3032cc5a12596becf9880234f1e558b644f0701bb8dcb"}
Sep 18 14:15:03.668651 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.668596    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb" event={"ID":"07328c24-495f-48db-9a81-b6ed780d7e50","Type":"ContainerStarted","Data":"013e773cb0bda5e0d4e29a9aa43d572812b53821d86ee5374fcde096cb16ab29"}
Sep 18 14:15:03.670024 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.670004    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-z2nbk" event={"ID":"976a7d23-dbfd-45b6-8871-b24b8ffe7f7f","Type":"ContainerDied","Data":"3664f8a23f3e1dfd636ab025638292668c63b7b71ae1ee518803b8aef3c86cfe"}
Sep 18 14:15:03.670111 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.670037    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3664f8a23f3e1dfd636ab025638292668c63b7b71ae1ee518803b8aef3c86cfe"
Sep 18 14:15:03.670111 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:03.670039    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-z2nbk"
Sep 18 14:15:04.048355 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.048328    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:15:04.110096 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110054    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-socket\") pod \"8ad3e318-450a-4519-82ff-efd93ed3aea7\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") "
Sep 18 14:15:04.110280 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110157    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-podinfo\") pod \"8ad3e318-450a-4519-82ff-efd93ed3aea7\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") "
Sep 18 14:15:04.110280 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110193    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-data\") pod \"8ad3e318-450a-4519-82ff-efd93ed3aea7\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") "
Sep 18 14:15:04.110280 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110252    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-envoy\") pod \"8ad3e318-450a-4519-82ff-efd93ed3aea7\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") "
Sep 18 14:15:04.110480 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110278    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-certs\") pod \"8ad3e318-450a-4519-82ff-efd93ed3aea7\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") "
Sep 18 14:15:04.110480 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110321    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad3e318-450a-4519-82ff-efd93ed3aea7-istiod-ca-cert\") pod \"8ad3e318-450a-4519-82ff-efd93ed3aea7\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") "
Sep 18 14:15:04.110480 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110403    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jrrz\" (UniqueName: \"kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-kube-api-access-2jrrz\") pod \"8ad3e318-450a-4519-82ff-efd93ed3aea7\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") "
Sep 18 14:15:04.110480 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110420    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ad3e318-450a-4519-82ff-efd93ed3aea7" (UID: "8ad3e318-450a-4519-82ff-efd93ed3aea7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:15:04.110480 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110431    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-token\") pod \"8ad3e318-450a-4519-82ff-efd93ed3aea7\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") "
Sep 18 14:15:04.110745 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110514    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-credential-socket\") pod \"8ad3e318-450a-4519-82ff-efd93ed3aea7\" (UID: \"8ad3e318-450a-4519-82ff-efd93ed3aea7\") "
Sep 18 14:15:04.110745 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110646    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ad3e318-450a-4519-82ff-efd93ed3aea7" (UID: "8ad3e318-450a-4519-82ff-efd93ed3aea7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:15:04.110859 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.110819    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ad3e318-450a-4519-82ff-efd93ed3aea7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ad3e318-450a-4519-82ff-efd93ed3aea7" (UID: "8ad3e318-450a-4519-82ff-efd93ed3aea7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:15:04.111096 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.111051    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ad3e318-450a-4519-82ff-efd93ed3aea7" (UID: "8ad3e318-450a-4519-82ff-efd93ed3aea7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:15:04.111293 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.111203    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad3e318-450a-4519-82ff-efd93ed3aea7-istiod-ca-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:04.111293 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.111232    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-credential-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:04.111293 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.111246    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:04.111293 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.111259    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-data\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:04.111931 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.111908    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ad3e318-450a-4519-82ff-efd93ed3aea7" (UID: "8ad3e318-450a-4519-82ff-efd93ed3aea7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:15:04.113052 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.113027    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-kube-api-access-2jrrz" (OuterVolumeSpecName: "kube-api-access-2jrrz") pod "8ad3e318-450a-4519-82ff-efd93ed3aea7" (UID: "8ad3e318-450a-4519-82ff-efd93ed3aea7"). InnerVolumeSpecName "kube-api-access-2jrrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:15:04.113262 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.113236    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ad3e318-450a-4519-82ff-efd93ed3aea7" (UID: "8ad3e318-450a-4519-82ff-efd93ed3aea7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:15:04.113337 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.113253    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ad3e318-450a-4519-82ff-efd93ed3aea7" (UID: "8ad3e318-450a-4519-82ff-efd93ed3aea7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:15:04.113337 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.113279    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ad3e318-450a-4519-82ff-efd93ed3aea7" (UID: "8ad3e318-450a-4519-82ff-efd93ed3aea7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:15:04.212286 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.212190    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-podinfo\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:04.212286 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.212227    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-envoy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:04.212286 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.212235    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad3e318-450a-4519-82ff-efd93ed3aea7-workload-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:04.212286 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.212243    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jrrz\" (UniqueName: \"kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-kube-api-access-2jrrz\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:04.212286 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.212254    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad3e318-450a-4519-82ff-efd93ed3aea7-istio-token\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:04.678226 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.678183    2575 generic.go:356] "Generic (PLEG): container finished" podID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerID="a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c" exitCode=0
Sep 18 14:15:04.678692 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.678243    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"
Sep 18 14:15:04.678692 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.678264    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" event={"ID":"8ad3e318-450a-4519-82ff-efd93ed3aea7","Type":"ContainerDied","Data":"a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c"}
Sep 18 14:15:04.678692 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.678317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l" event={"ID":"8ad3e318-450a-4519-82ff-efd93ed3aea7","Type":"ContainerDied","Data":"2b966215f4db68252b5b8964db0dbe5186ea0c555f810165c904222d5ef0ad69"}
Sep 18 14:15:04.678692 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.678339    2575 scope.go:117] "RemoveContainer" containerID="a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c"
Sep 18 14:15:04.690844 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.690820    2575 scope.go:117] "RemoveContainer" containerID="177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7"
Sep 18 14:15:04.700995 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.700918    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"]
Sep 18 14:15:04.702414 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.702392    2575 scope.go:117] "RemoveContainer" containerID="a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c"
Sep 18 14:15:04.702839 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:15:04.702816    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c\": container with ID starting with a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c not found: ID does not exist" containerID="a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c"
Sep 18 14:15:04.702922 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.702847    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c"} err="failed to get container status \"a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c\": rpc error: code = NotFound desc = could not find container \"a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c\": container with ID starting with a27e1a0e48158bad665b646a52c831df16470a2c93095dfdff43a689390fd63c not found: ID does not exist"
Sep 18 14:15:04.702922 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.702871    2575 scope.go:117] "RemoveContainer" containerID="177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7"
Sep 18 14:15:04.703280 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:15:04.703260    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7\": container with ID starting with 177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7 not found: ID does not exist" containerID="177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7"
Sep 18 14:15:04.703357 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.703287    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7"} err="failed to get container status \"177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7\": rpc error: code = NotFound desc = could not find container \"177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7\": container with ID starting with 177fc6f9b77adee5d6fc1bf0d8d55ac5f82c25945994a577ee6ce4ff785612a7 not found: ID does not exist"
Sep 18 14:15:04.704963 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.704932    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l"]
Sep 18 14:15:04.828407 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.828375    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"
Sep 18 14:15:04.917762 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.917725    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07328c24-495f-48db-9a81-b6ed780d7e50-maas-api-service-ca\") pod \"07328c24-495f-48db-9a81-b6ed780d7e50\" (UID: \"07328c24-495f-48db-9a81-b6ed780d7e50\") "
Sep 18 14:15:04.918097 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:04.918072    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07328c24-495f-48db-9a81-b6ed780d7e50-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "07328c24-495f-48db-9a81-b6ed780d7e50" (UID: "07328c24-495f-48db-9a81-b6ed780d7e50"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:15:05.019070 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:05.018973    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07328c24-495f-48db-9a81-b6ed780d7e50-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:05.686190 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:05.686150    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb" event={"ID":"07328c24-495f-48db-9a81-b6ed780d7e50","Type":"ContainerDied","Data":"013e773cb0bda5e0d4e29a9aa43d572812b53821d86ee5374fcde096cb16ab29"}
Sep 18 14:15:05.686618 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:05.686206    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="013e773cb0bda5e0d4e29a9aa43d572812b53821d86ee5374fcde096cb16ab29"
Sep 18 14:15:05.686618 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:05.686156    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"
Sep 18 14:15:06.294337 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:06.294302    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" path="/var/lib/kubelet/pods/8ad3e318-450a-4519-82ff-efd93ed3aea7/volumes"
Sep 18 14:15:17.890085 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:17.890046    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"]
Sep 18 14:15:17.890583 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:17.890376    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc" podUID="4d6f0425-f05c-4723-93c6-964ed91c85ae" containerName="payload-processing" containerID="cri-o://71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6" gracePeriod=30
Sep 18 14:15:18.092689 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.092642    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"]
Sep 18 14:15:18.095239 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.095213    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b6289c-mmsgb"]
Sep 18 14:15:18.185981 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.185950    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:15:18.292788 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.292753    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07328c24-495f-48db-9a81-b6ed780d7e50" path="/var/lib/kubelet/pods/07328c24-495f-48db-9a81-b6ed780d7e50/volumes"
Sep 18 14:15:18.358549 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.358506    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf8px\" (UniqueName: \"kubernetes.io/projected/4d6f0425-f05c-4723-93c6-964ed91c85ae-kube-api-access-kf8px\") pod \"4d6f0425-f05c-4723-93c6-964ed91c85ae\" (UID: \"4d6f0425-f05c-4723-93c6-964ed91c85ae\") "
Sep 18 14:15:18.358731 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.358576    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d6f0425-f05c-4723-93c6-964ed91c85ae-plugins-config-volume\") pod \"4d6f0425-f05c-4723-93c6-964ed91c85ae\" (UID: \"4d6f0425-f05c-4723-93c6-964ed91c85ae\") "
Sep 18 14:15:18.358968 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.358943    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d6f0425-f05c-4723-93c6-964ed91c85ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d6f0425-f05c-4723-93c6-964ed91c85ae" (UID: "4d6f0425-f05c-4723-93c6-964ed91c85ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:15:18.360769 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.360733    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d6f0425-f05c-4723-93c6-964ed91c85ae-kube-api-access-kf8px" (OuterVolumeSpecName: "kube-api-access-kf8px") pod "4d6f0425-f05c-4723-93c6-964ed91c85ae" (UID: "4d6f0425-f05c-4723-93c6-964ed91c85ae"). InnerVolumeSpecName "kube-api-access-kf8px". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:15:18.460096 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.460004    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf8px\" (UniqueName: \"kubernetes.io/projected/4d6f0425-f05c-4723-93c6-964ed91c85ae-kube-api-access-kf8px\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:18.460096 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.460037    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d6f0425-f05c-4723-93c6-964ed91c85ae-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:15:18.773980 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.773887    2575 generic.go:356] "Generic (PLEG): container finished" podID="4d6f0425-f05c-4723-93c6-964ed91c85ae" containerID="71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6" exitCode=0
Sep 18 14:15:18.773980 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.773934    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"
Sep 18 14:15:18.774225 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.773971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc" event={"ID":"4d6f0425-f05c-4723-93c6-964ed91c85ae","Type":"ContainerDied","Data":"71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6"}
Sep 18 14:15:18.774225 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.774030    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc" event={"ID":"4d6f0425-f05c-4723-93c6-964ed91c85ae","Type":"ContainerDied","Data":"62132a15ed5f89d59ebba2614160dee2abe612292555a6b0e0d6e8e087cdfd16"}
Sep 18 14:15:18.774225 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.774059    2575 scope.go:117] "RemoveContainer" containerID="71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6"
Sep 18 14:15:18.783702 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.783681    2575 scope.go:117] "RemoveContainer" containerID="71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6"
Sep 18 14:15:18.784002 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:15:18.783982    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6\": container with ID starting with 71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6 not found: ID does not exist" containerID="71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6"
Sep 18 14:15:18.784063 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.784015    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6"} err="failed to get container status \"71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6\": rpc error: code = NotFound desc = could not find container \"71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6\": container with ID starting with 71a6260dffadd50d1dd0b4a6a42bcb65f842ddd8fa56c829d25bc8457253bab6 not found: ID does not exist"
Sep 18 14:15:18.799442 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.799417    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"]
Sep 18 14:15:18.801687 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:18.801665    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc"]
Sep 18 14:15:20.292980 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:20.292934    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d6f0425-f05c-4723-93c6-964ed91c85ae" path="/var/lib/kubelet/pods/4d6f0425-f05c-4723-93c6-964ed91c85ae/volumes"
Sep 18 14:15:36.824896 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:36.824861    2575 scope.go:117] "RemoveContainer" containerID="7aaa1cc2858da7c10bed1203c30484b542a76f8400e985dd61960520518490c8"
Sep 18 14:15:36.835560 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:15:36.835542    2575 scope.go:117] "RemoveContainer" containerID="f03efa44b1b209ce2cd5c132f81e75da22982fa7447fb942e85859b1509fb625"
Sep 18 14:16:28.082391 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082352    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"]
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082811    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07328c24-495f-48db-9a81-b6ed780d7e50" containerName="revoke-keys"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082823    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="07328c24-495f-48db-9a81-b6ed780d7e50" containerName="revoke-keys"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082845    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082851    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082858    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d66f0f-ba7d-4e9e-a07a-9da1ebb39a33" containerName="cleanup"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082864    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d66f0f-ba7d-4e9e-a07a-9da1ebb39a33" containerName="cleanup"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082876    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="976a7d23-dbfd-45b6-8871-b24b8ffe7f7f" containerName="cleanup"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082882    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="976a7d23-dbfd-45b6-8871-b24b8ffe7f7f" containerName="cleanup"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082889    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d6f0425-f05c-4723-93c6-964ed91c85ae" containerName="payload-processing"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082894    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d6f0425-f05c-4723-93c6-964ed91c85ae" containerName="payload-processing"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082901    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082906    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082914    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e10332-dbd9-4edd-8c15-cb197da57b0e" containerName="cleanup"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082919    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e10332-dbd9-4edd-8c15-cb197da57b0e" containerName="cleanup"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082984    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="976a7d23-dbfd-45b6-8871-b24b8ffe7f7f" containerName="cleanup"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082991    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.082997    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="07328c24-495f-48db-9a81-b6ed780d7e50" containerName="revoke-keys"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.083004    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad3e318-450a-4519-82ff-efd93ed3aea7" containerName="istio-proxy"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.083012    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4e10332-dbd9-4edd-8c15-cb197da57b0e" containerName="cleanup"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.083017    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d66f0f-ba7d-4e9e-a07a-9da1ebb39a33" containerName="cleanup"
Sep 18 14:16:28.083016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.083025    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d6f0425-f05c-4723-93c6-964ed91c85ae" containerName="payload-processing"
Sep 18 14:16:28.086430 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.086411    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"
Sep 18 14:16:28.089952 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.089932    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:16:28.096279 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.096254    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"]
Sep 18 14:16:28.177215 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.177187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67f7a452-568a-4558-92a7-f358d27d46d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4\" (UID: \"67f7a452-568a-4558-92a7-f358d27d46d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"
Sep 18 14:16:28.277778 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.277744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67f7a452-568a-4558-92a7-f358d27d46d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4\" (UID: \"67f7a452-568a-4558-92a7-f358d27d46d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"
Sep 18 14:16:28.278417 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.278396    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67f7a452-568a-4558-92a7-f358d27d46d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4\" (UID: \"67f7a452-568a-4558-92a7-f358d27d46d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"
Sep 18 14:16:28.397714 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.397633    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"
Sep 18 14:16:28.672666 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:28.672631    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"]
Sep 18 14:16:28.674545 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:16:28.674507    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f7a452_568a_4558_92a7_f358d27d46d9.slice/crio-89c036e183b64e6d4aecf509bda4ac81711daeb1e0b5c2e3d60ad9820975fe84 WatchSource:0}: Error finding container 89c036e183b64e6d4aecf509bda4ac81711daeb1e0b5c2e3d60ad9820975fe84: Status 404 returned error can't find the container with id 89c036e183b64e6d4aecf509bda4ac81711daeb1e0b5c2e3d60ad9820975fe84
Sep 18 14:16:29.189799 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:29.189762    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4" event={"ID":"67f7a452-568a-4558-92a7-f358d27d46d9","Type":"ContainerStarted","Data":"37f2f51c42dbe728ac2828df62247856c94d6aa933537decbcba4ec41f9e742f"}
Sep 18 14:16:29.190222 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:29.189813    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4" event={"ID":"67f7a452-568a-4558-92a7-f358d27d46d9","Type":"ContainerStarted","Data":"89c036e183b64e6d4aecf509bda4ac81711daeb1e0b5c2e3d60ad9820975fe84"}
Sep 18 14:16:29.210505 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:29.210405    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4" podStartSLOduration=1.210389483 podStartE2EDuration="1.210389483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:16:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:16:29.209050608 +0000 UTC m=+1915.044889322" watchObservedRunningTime="2026-09-18 14:16:29.210389483 +0000 UTC m=+1915.046228196"
Sep 18 14:16:30.196835 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:30.196800    2575 generic.go:356] "Generic (PLEG): container finished" podID="67f7a452-568a-4558-92a7-f358d27d46d9" containerID="37f2f51c42dbe728ac2828df62247856c94d6aa933537decbcba4ec41f9e742f" exitCode=0
Sep 18 14:16:30.197220 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:30.196893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4" event={"ID":"67f7a452-568a-4558-92a7-f358d27d46d9","Type":"ContainerDied","Data":"37f2f51c42dbe728ac2828df62247856c94d6aa933537decbcba4ec41f9e742f"}
Sep 18 14:16:31.340737 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:31.340712    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"
Sep 18 14:16:31.506958 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:31.506866    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67f7a452-568a-4558-92a7-f358d27d46d9-maas-api-service-ca\") pod \"67f7a452-568a-4558-92a7-f358d27d46d9\" (UID: \"67f7a452-568a-4558-92a7-f358d27d46d9\") "
Sep 18 14:16:31.507266 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:31.507242    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67f7a452-568a-4558-92a7-f358d27d46d9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "67f7a452-568a-4558-92a7-f358d27d46d9" (UID: "67f7a452-568a-4558-92a7-f358d27d46d9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:16:31.608300 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:31.608266    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67f7a452-568a-4558-92a7-f358d27d46d9-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:16:32.210458 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:32.210426    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"
Sep 18 14:16:32.210661 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:32.210464    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4" event={"ID":"67f7a452-568a-4558-92a7-f358d27d46d9","Type":"ContainerDied","Data":"89c036e183b64e6d4aecf509bda4ac81711daeb1e0b5c2e3d60ad9820975fe84"}
Sep 18 14:16:32.210661 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:32.210517    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89c036e183b64e6d4aecf509bda4ac81711daeb1e0b5c2e3d60ad9820975fe84"
Sep 18 14:16:36.871538 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:36.871509    2575 scope.go:117] "RemoveContainer" containerID="b64f5204abdd852ed746c2fa673de9bd21eb1b92ad3c0b376f8df81c686a82b6"
Sep 18 14:16:36.880299 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:36.880278    2575 scope.go:117] "RemoveContainer" containerID="224c6c870265dbc31bdb58da4ec3cd1c2d2aed61e9fff07efaa8e64162729e7c"
Sep 18 14:16:36.888601 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:36.888585    2575 scope.go:117] "RemoveContainer" containerID="436eb3478ba56f52fd76fcd70c106337494d8647663629747811fa117a1c3917"
Sep 18 14:16:36.896477 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:36.896456    2575 scope.go:117] "RemoveContainer" containerID="3efb26ea496620d673c15f3357da0a42c8a17285aa72986ee87fc57c5c7c6e94"
Sep 18 14:16:38.735902 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:38.735860    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"]
Sep 18 14:16:38.738570 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:38.738537    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d6301-lfgc4"]
Sep 18 14:16:40.293924 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:40.293887    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67f7a452-568a-4558-92a7-f358d27d46d9" path="/var/lib/kubelet/pods/67f7a452-568a-4558-92a7-f358d27d46d9/volumes"
Sep 18 14:16:46.030033 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.030002    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"]
Sep 18 14:16:46.030525 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.030472    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67f7a452-568a-4558-92a7-f358d27d46d9" containerName="revoke-keys"
Sep 18 14:16:46.030525 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.030485    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="67f7a452-568a-4558-92a7-f358d27d46d9" containerName="revoke-keys"
Sep 18 14:16:46.030612 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.030560    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="67f7a452-568a-4558-92a7-f358d27d46d9" containerName="revoke-keys"
Sep 18 14:16:46.035552 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.035534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"
Sep 18 14:16:46.038453 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.038427    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:16:46.043182 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.042988    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"]
Sep 18 14:16:46.151445 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.151410    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af9dc59-0377-43cd-b4f8-fe1e9457cc37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs\" (UID: \"9af9dc59-0377-43cd-b4f8-fe1e9457cc37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"
Sep 18 14:16:46.252980 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.252937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af9dc59-0377-43cd-b4f8-fe1e9457cc37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs\" (UID: \"9af9dc59-0377-43cd-b4f8-fe1e9457cc37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"
Sep 18 14:16:46.253588 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.253568    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af9dc59-0377-43cd-b4f8-fe1e9457cc37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs\" (UID: \"9af9dc59-0377-43cd-b4f8-fe1e9457cc37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"
Sep 18 14:16:46.348015 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.347982    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"
Sep 18 14:16:46.626287 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:46.626262    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"]
Sep 18 14:16:46.628532 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:16:46.628507    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af9dc59_0377_43cd_b4f8_fe1e9457cc37.slice/crio-4c63cd21ca785f0802e1e6948cb7543c6d5715deca46505a5bd0f3bd21262e45 WatchSource:0}: Error finding container 4c63cd21ca785f0802e1e6948cb7543c6d5715deca46505a5bd0f3bd21262e45: Status 404 returned error can't find the container with id 4c63cd21ca785f0802e1e6948cb7543c6d5715deca46505a5bd0f3bd21262e45
Sep 18 14:16:47.308577 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:47.308538    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs" event={"ID":"9af9dc59-0377-43cd-b4f8-fe1e9457cc37","Type":"ContainerStarted","Data":"fd209a12760351c54fc8b8b0b44c72fea0e475751c27505fb1d984f704fe8832"}
Sep 18 14:16:47.309013 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:47.308595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs" event={"ID":"9af9dc59-0377-43cd-b4f8-fe1e9457cc37","Type":"ContainerStarted","Data":"4c63cd21ca785f0802e1e6948cb7543c6d5715deca46505a5bd0f3bd21262e45"}
Sep 18 14:16:47.326873 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:47.326821    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs" podStartSLOduration=1.326803365 podStartE2EDuration="1.326803365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:16:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:16:47.324060142 +0000 UTC m=+1933.159898857" watchObservedRunningTime="2026-09-18 14:16:47.326803365 +0000 UTC m=+1933.162642077"
Sep 18 14:16:48.315269 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:48.315232    2575 generic.go:356] "Generic (PLEG): container finished" podID="9af9dc59-0377-43cd-b4f8-fe1e9457cc37" containerID="fd209a12760351c54fc8b8b0b44c72fea0e475751c27505fb1d984f704fe8832" exitCode=0
Sep 18 14:16:48.315682 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:48.315317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs" event={"ID":"9af9dc59-0377-43cd-b4f8-fe1e9457cc37","Type":"ContainerDied","Data":"fd209a12760351c54fc8b8b0b44c72fea0e475751c27505fb1d984f704fe8832"}
Sep 18 14:16:49.459212 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:49.459185    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"
Sep 18 14:16:49.598063 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:49.597981    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af9dc59-0377-43cd-b4f8-fe1e9457cc37-maas-api-service-ca\") pod \"9af9dc59-0377-43cd-b4f8-fe1e9457cc37\" (UID: \"9af9dc59-0377-43cd-b4f8-fe1e9457cc37\") "
Sep 18 14:16:49.598381 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:49.598362    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af9dc59-0377-43cd-b4f8-fe1e9457cc37-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9af9dc59-0377-43cd-b4f8-fe1e9457cc37" (UID: "9af9dc59-0377-43cd-b4f8-fe1e9457cc37"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:16:49.699013 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:49.698985    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af9dc59-0377-43cd-b4f8-fe1e9457cc37-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:16:50.328056 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:50.328027    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"
Sep 18 14:16:50.328216 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:50.328073    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs" event={"ID":"9af9dc59-0377-43cd-b4f8-fe1e9457cc37","Type":"ContainerDied","Data":"4c63cd21ca785f0802e1e6948cb7543c6d5715deca46505a5bd0f3bd21262e45"}
Sep 18 14:16:50.328216 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:50.328144    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c63cd21ca785f0802e1e6948cb7543c6d5715deca46505a5bd0f3bd21262e45"
Sep 18 14:16:56.642618 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:56.642574    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn"]
Sep 18 14:16:56.645188 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:56.645156    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-783872-29829015-m49wn"]
Sep 18 14:16:56.669329 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:56.669290    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"]
Sep 18 14:16:56.669577 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:56.669551    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv" podUID="1334736e-7765-41bb-8968-02faa606f66c" containerName="payload-processing" containerID="cri-o://6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94" gracePeriod=30
Sep 18 14:16:56.832390 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:56.832352    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"]
Sep 18 14:16:56.834497 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:56.834461    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-783872-mn2gs"]
Sep 18 14:16:56.938848 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:56.938818    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:16:57.072688 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.072658    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dpqz\" (UniqueName: \"kubernetes.io/projected/1334736e-7765-41bb-8968-02faa606f66c-kube-api-access-8dpqz\") pod \"1334736e-7765-41bb-8968-02faa606f66c\" (UID: \"1334736e-7765-41bb-8968-02faa606f66c\") "
Sep 18 14:16:57.072871 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.072759    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1334736e-7765-41bb-8968-02faa606f66c-plugins-config-volume\") pod \"1334736e-7765-41bb-8968-02faa606f66c\" (UID: \"1334736e-7765-41bb-8968-02faa606f66c\") "
Sep 18 14:16:57.073182 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.073158    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1334736e-7765-41bb-8968-02faa606f66c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1334736e-7765-41bb-8968-02faa606f66c" (UID: "1334736e-7765-41bb-8968-02faa606f66c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:16:57.074723 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.074699    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1334736e-7765-41bb-8968-02faa606f66c-kube-api-access-8dpqz" (OuterVolumeSpecName: "kube-api-access-8dpqz") pod "1334736e-7765-41bb-8968-02faa606f66c" (UID: "1334736e-7765-41bb-8968-02faa606f66c"). InnerVolumeSpecName "kube-api-access-8dpqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:16:57.173726 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.173638    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1334736e-7765-41bb-8968-02faa606f66c-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:16:57.173726 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.173670    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dpqz\" (UniqueName: \"kubernetes.io/projected/1334736e-7765-41bb-8968-02faa606f66c-kube-api-access-8dpqz\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:16:57.367449 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.367416    2575 generic.go:356] "Generic (PLEG): container finished" podID="1334736e-7765-41bb-8968-02faa606f66c" containerID="6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94" exitCode=0
Sep 18 14:16:57.367626 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.367462    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"
Sep 18 14:16:57.367626 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.367505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv" event={"ID":"1334736e-7765-41bb-8968-02faa606f66c","Type":"ContainerDied","Data":"6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94"}
Sep 18 14:16:57.367626 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.367558    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv" event={"ID":"1334736e-7765-41bb-8968-02faa606f66c","Type":"ContainerDied","Data":"4c23024c6f800daa58604b46b7cac2ba8b3f04976bd3cffe8db9dead38e6764c"}
Sep 18 14:16:57.367626 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.367586    2575 scope.go:117] "RemoveContainer" containerID="6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94"
Sep 18 14:16:57.377080 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.377065    2575 scope.go:117] "RemoveContainer" containerID="6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94"
Sep 18 14:16:57.377352 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:16:57.377335    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94\": container with ID starting with 6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94 not found: ID does not exist" containerID="6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94"
Sep 18 14:16:57.377413 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.377361    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94"} err="failed to get container status \"6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94\": rpc error: code = NotFound desc = could not find container \"6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94\": container with ID starting with 6df83ff86096cdf744e3515ef3c0aaa2a6b41aa504063dbf7657419e91867e94 not found: ID does not exist"
Sep 18 14:16:57.395205 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.395178    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"]
Sep 18 14:16:57.398794 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:57.398769    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv"]
Sep 18 14:16:58.292997 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:58.292964    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1334736e-7765-41bb-8968-02faa606f66c" path="/var/lib/kubelet/pods/1334736e-7765-41bb-8968-02faa606f66c/volumes"
Sep 18 14:16:58.293410 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:58.293296    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d66f0f-ba7d-4e9e-a07a-9da1ebb39a33" path="/var/lib/kubelet/pods/96d66f0f-ba7d-4e9e-a07a-9da1ebb39a33/volumes"
Sep 18 14:16:58.293568 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:16:58.293555    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9af9dc59-0377-43cd-b4f8-fe1e9457cc37" path="/var/lib/kubelet/pods/9af9dc59-0377-43cd-b4f8-fe1e9457cc37/volumes"
Sep 18 14:17:04.047432 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.047392    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"]
Sep 18 14:17:04.047913 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.047856    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1334736e-7765-41bb-8968-02faa606f66c" containerName="payload-processing"
Sep 18 14:17:04.047913 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.047875    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1334736e-7765-41bb-8968-02faa606f66c" containerName="payload-processing"
Sep 18 14:17:04.047913 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.047913    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af9dc59-0377-43cd-b4f8-fe1e9457cc37" containerName="revoke-keys"
Sep 18 14:17:04.048027 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.047921    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af9dc59-0377-43cd-b4f8-fe1e9457cc37" containerName="revoke-keys"
Sep 18 14:17:04.048027 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.048014    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1334736e-7765-41bb-8968-02faa606f66c" containerName="payload-processing"
Sep 18 14:17:04.048102 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.048027    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af9dc59-0377-43cd-b4f8-fe1e9457cc37" containerName="revoke-keys"
Sep 18 14:17:04.051375 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.051352    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"
Sep 18 14:17:04.055149 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.055084    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxtb2\""
Sep 18 14:17:04.060459 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.060432    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"]
Sep 18 14:17:04.143950 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.143909    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d95f8da-d348-4373-89b6-41a8bcbfeed6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4\" (UID: \"2d95f8da-d348-4373-89b6-41a8bcbfeed6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"
Sep 18 14:17:04.245047 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.245012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d95f8da-d348-4373-89b6-41a8bcbfeed6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4\" (UID: \"2d95f8da-d348-4373-89b6-41a8bcbfeed6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"
Sep 18 14:17:04.245694 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.245661    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d95f8da-d348-4373-89b6-41a8bcbfeed6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4\" (UID: \"2d95f8da-d348-4373-89b6-41a8bcbfeed6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"
Sep 18 14:17:04.364689 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.364605    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"
Sep 18 14:17:04.643240 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:04.643208    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"]
Sep 18 14:17:04.645093 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:17:04.645061    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d95f8da_d348_4373_89b6_41a8bcbfeed6.slice/crio-c97c01712d92605b2d482392f73e6c0cfe92252a4d3c72e8638081a516433b1d WatchSource:0}: Error finding container c97c01712d92605b2d482392f73e6c0cfe92252a4d3c72e8638081a516433b1d: Status 404 returned error can't find the container with id c97c01712d92605b2d482392f73e6c0cfe92252a4d3c72e8638081a516433b1d
Sep 18 14:17:05.415818 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:05.415780    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4" event={"ID":"2d95f8da-d348-4373-89b6-41a8bcbfeed6","Type":"ContainerStarted","Data":"a2c8f023d0b52b1c578c716e8e334b89f68af7041fd03c1a5a79e4c831c14100"}
Sep 18 14:17:05.416284 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:05.415848    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4" event={"ID":"2d95f8da-d348-4373-89b6-41a8bcbfeed6","Type":"ContainerStarted","Data":"c97c01712d92605b2d482392f73e6c0cfe92252a4d3c72e8638081a516433b1d"}
Sep 18 14:17:05.433862 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:05.433812    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4" podStartSLOduration=1.433795849 podStartE2EDuration="1.433795849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:17:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:17:05.430809744 +0000 UTC m=+1951.266648470" watchObservedRunningTime="2026-09-18 14:17:05.433795849 +0000 UTC m=+1951.269634562"
Sep 18 14:17:06.422894 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:06.422862    2575 generic.go:356] "Generic (PLEG): container finished" podID="2d95f8da-d348-4373-89b6-41a8bcbfeed6" containerID="a2c8f023d0b52b1c578c716e8e334b89f68af7041fd03c1a5a79e4c831c14100" exitCode=0
Sep 18 14:17:06.423341 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:06.422948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4" event={"ID":"2d95f8da-d348-4373-89b6-41a8bcbfeed6","Type":"ContainerDied","Data":"a2c8f023d0b52b1c578c716e8e334b89f68af7041fd03c1a5a79e4c831c14100"}
Sep 18 14:17:07.563189 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:07.563163    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"
Sep 18 14:17:07.578460 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:07.578438    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d95f8da-d348-4373-89b6-41a8bcbfeed6-maas-api-service-ca\") pod \"2d95f8da-d348-4373-89b6-41a8bcbfeed6\" (UID: \"2d95f8da-d348-4373-89b6-41a8bcbfeed6\") "
Sep 18 14:17:07.579476 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:07.578820    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d95f8da-d348-4373-89b6-41a8bcbfeed6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d95f8da-d348-4373-89b6-41a8bcbfeed6" (UID: "2d95f8da-d348-4373-89b6-41a8bcbfeed6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:17:07.679258 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:07.679224    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d95f8da-d348-4373-89b6-41a8bcbfeed6-maas-api-service-ca\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:08.436348 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:08.436308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4" event={"ID":"2d95f8da-d348-4373-89b6-41a8bcbfeed6","Type":"ContainerDied","Data":"c97c01712d92605b2d482392f73e6c0cfe92252a4d3c72e8638081a516433b1d"}
Sep 18 14:17:08.436348 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:08.436333    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"
Sep 18 14:17:08.436609 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:08.436360    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c97c01712d92605b2d482392f73e6c0cfe92252a4d3c72e8638081a516433b1d"
Sep 18 14:17:14.672938 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:14.672899    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf"]
Sep 18 14:17:14.675404 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:14.675374    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-1a4b6d-29829015-xxvnf"]
Sep 18 14:17:14.700279 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:14.700244    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"]
Sep 18 14:17:14.700580 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:14.700541    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv" podUID="98c99c70-06ea-4074-9184-914eaca4ea8b" containerName="payload-processing" containerID="cri-o://618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e" gracePeriod=30
Sep 18 14:17:14.869215 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:14.869180    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"]
Sep 18 14:17:14.871754 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:14.871725    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1a4b6d-gf9b4"]
Sep 18 14:17:14.954758 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:14.954733    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:17:15.053614 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.053579    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csnst\" (UniqueName: \"kubernetes.io/projected/98c99c70-06ea-4074-9184-914eaca4ea8b-kube-api-access-csnst\") pod \"98c99c70-06ea-4074-9184-914eaca4ea8b\" (UID: \"98c99c70-06ea-4074-9184-914eaca4ea8b\") "
Sep 18 14:17:15.053804 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.053646    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c99c70-06ea-4074-9184-914eaca4ea8b-plugins-config-volume\") pod \"98c99c70-06ea-4074-9184-914eaca4ea8b\" (UID: \"98c99c70-06ea-4074-9184-914eaca4ea8b\") "
Sep 18 14:17:15.054081 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.054054    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98c99c70-06ea-4074-9184-914eaca4ea8b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98c99c70-06ea-4074-9184-914eaca4ea8b" (UID: "98c99c70-06ea-4074-9184-914eaca4ea8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:17:15.055854 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.055834    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98c99c70-06ea-4074-9184-914eaca4ea8b-kube-api-access-csnst" (OuterVolumeSpecName: "kube-api-access-csnst") pod "98c99c70-06ea-4074-9184-914eaca4ea8b" (UID: "98c99c70-06ea-4074-9184-914eaca4ea8b"). InnerVolumeSpecName "kube-api-access-csnst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:17:15.155352 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.155310    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csnst\" (UniqueName: \"kubernetes.io/projected/98c99c70-06ea-4074-9184-914eaca4ea8b-kube-api-access-csnst\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:15.155352 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.155345    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c99c70-06ea-4074-9184-914eaca4ea8b-plugins-config-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:15.477482 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.477443    2575 generic.go:356] "Generic (PLEG): container finished" podID="98c99c70-06ea-4074-9184-914eaca4ea8b" containerID="618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e" exitCode=0
Sep 18 14:17:15.477658 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.477490    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"
Sep 18 14:17:15.477658 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.477529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv" event={"ID":"98c99c70-06ea-4074-9184-914eaca4ea8b","Type":"ContainerDied","Data":"618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e"}
Sep 18 14:17:15.477658 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.477583    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv" event={"ID":"98c99c70-06ea-4074-9184-914eaca4ea8b","Type":"ContainerDied","Data":"93b855e9df489994c1288b9846ecff86e0f40c6b987e716a121f7000dc74727f"}
Sep 18 14:17:15.477658 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.477604    2575 scope.go:117] "RemoveContainer" containerID="618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e"
Sep 18 14:17:15.487368 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.487351    2575 scope.go:117] "RemoveContainer" containerID="618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e"
Sep 18 14:17:15.487630 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:17:15.487611    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e\": container with ID starting with 618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e not found: ID does not exist" containerID="618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e"
Sep 18 14:17:15.487694 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.487644    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e"} err="failed to get container status \"618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e\": rpc error: code = NotFound desc = could not find container \"618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e\": container with ID starting with 618fd55f67b51b38f85177826f4e3bff18fd4af93056889544e70ca677dd3c4e not found: ID does not exist"
Sep 18 14:17:15.527682 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.527646    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"]
Sep 18 14:17:15.539556 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:15.539527    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv"]
Sep 18 14:17:16.292820 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:16.292787    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d95f8da-d348-4373-89b6-41a8bcbfeed6" path="/var/lib/kubelet/pods/2d95f8da-d348-4373-89b6-41a8bcbfeed6/volumes"
Sep 18 14:17:16.293292 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:16.293275    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98c99c70-06ea-4074-9184-914eaca4ea8b" path="/var/lib/kubelet/pods/98c99c70-06ea-4074-9184-914eaca4ea8b/volumes"
Sep 18 14:17:16.293573 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:16.293560    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4e10332-dbd9-4edd-8c15-cb197da57b0e" path="/var/lib/kubelet/pods/b4e10332-dbd9-4edd-8c15-cb197da57b0e/volumes"
Sep 18 14:17:22.246627 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:22.246547    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"]
Sep 18 14:17:22.247011 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:22.246828    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy" containerID="cri-o://02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb" gracePeriod=30
Sep 18 14:17:27.203515 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.203475    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 14:17:27.203960 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.203541    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 14:17:27.503569 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.503544    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:17:27.561928 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.561890    2575 generic.go:356] "Generic (PLEG): container finished" podID="aa6322e8-c07b-4962-b302-37bbada56363" containerID="02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb" exitCode=0
Sep 18 14:17:27.562100 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.561941    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"
Sep 18 14:17:27.562100 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.561983    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" event={"ID":"aa6322e8-c07b-4962-b302-37bbada56363","Type":"ContainerDied","Data":"02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb"}
Sep 18 14:17:27.562100 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.562043    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2" event={"ID":"aa6322e8-c07b-4962-b302-37bbada56363","Type":"ContainerDied","Data":"79c67c17fe63234986efc22fd03c18ec6cf337caa405289f75c85889724a8d24"}
Sep 18 14:17:27.562100 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.562072    2575 scope.go:117] "RemoveContainer" containerID="02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb"
Sep 18 14:17:27.571369 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.571350    2575 scope.go:117] "RemoveContainer" containerID="6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d"
Sep 18 14:17:27.579563 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.579546    2575 scope.go:117] "RemoveContainer" containerID="02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb"
Sep 18 14:17:27.579833 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:17:27.579814    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb\": container with ID starting with 02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb not found: ID does not exist" containerID="02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb"
Sep 18 14:17:27.579875 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.579842    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb"} err="failed to get container status \"02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb\": rpc error: code = NotFound desc = could not find container \"02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb\": container with ID starting with 02c1bfaf896a8f410b178810200ee544f09aee1de967fe917fc3664be927eacb not found: ID does not exist"
Sep 18 14:17:27.579875 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.579858    2575 scope.go:117] "RemoveContainer" containerID="6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d"
Sep 18 14:17:27.580112 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:17:27.580092    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d\": container with ID starting with 6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d not found: ID does not exist" containerID="6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d"
Sep 18 14:17:27.580199 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.580119    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d"} err="failed to get container status \"6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d\": rpc error: code = NotFound desc = could not find container \"6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d\": container with ID starting with 6c769533a1a509305411f1749dca25c424207007377771c7e5afe692f318372d not found: ID does not exist"
Sep 18 14:17:27.582434 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.582418    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdj8w\" (UniqueName: \"kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-kube-api-access-rdj8w\") pod \"aa6322e8-c07b-4962-b302-37bbada56363\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") "
Sep 18 14:17:27.582490 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.582464    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa6322e8-c07b-4962-b302-37bbada56363-istiod-ca-cert\") pod \"aa6322e8-c07b-4962-b302-37bbada56363\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") "
Sep 18 14:17:27.582527 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.582501    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa6322e8-c07b-4962-b302-37bbada56363-istio-podinfo\") pod \"aa6322e8-c07b-4962-b302-37bbada56363\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") "
Sep 18 14:17:27.582565 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.582533    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-istio-token\") pod \"aa6322e8-c07b-4962-b302-37bbada56363\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") "
Sep 18 14:17:27.582565 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.582552    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-envoy\") pod \"aa6322e8-c07b-4962-b302-37bbada56363\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") "
Sep 18 14:17:27.582673 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.582567    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-certs\") pod \"aa6322e8-c07b-4962-b302-37bbada56363\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") "
Sep 18 14:17:27.582673 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.582608    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-socket\") pod \"aa6322e8-c07b-4962-b302-37bbada56363\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") "
Sep 18 14:17:27.582673 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.582650    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-credential-socket\") pod \"aa6322e8-c07b-4962-b302-37bbada56363\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") "
Sep 18 14:17:27.582820 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.582697    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-data\") pod \"aa6322e8-c07b-4962-b302-37bbada56363\" (UID: \"aa6322e8-c07b-4962-b302-37bbada56363\") "
Sep 18 14:17:27.583199 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.582912    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa6322e8-c07b-4962-b302-37bbada56363" (UID: "aa6322e8-c07b-4962-b302-37bbada56363"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:17:27.583199 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.582953    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6322e8-c07b-4962-b302-37bbada56363-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa6322e8-c07b-4962-b302-37bbada56363" (UID: "aa6322e8-c07b-4962-b302-37bbada56363"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:17:27.583199 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.583156    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa6322e8-c07b-4962-b302-37bbada56363-istiod-ca-cert\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:27.583199 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.583178    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:27.583199 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.583193    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa6322e8-c07b-4962-b302-37bbada56363" (UID: "aa6322e8-c07b-4962-b302-37bbada56363"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:17:27.583513 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.583290    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa6322e8-c07b-4962-b302-37bbada56363" (UID: "aa6322e8-c07b-4962-b302-37bbada56363"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:17:27.583513 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.583428    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa6322e8-c07b-4962-b302-37bbada56363" (UID: "aa6322e8-c07b-4962-b302-37bbada56363"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:17:27.584687 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.584663    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa6322e8-c07b-4962-b302-37bbada56363" (UID: "aa6322e8-c07b-4962-b302-37bbada56363"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:17:27.584779 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.584735    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa6322e8-c07b-4962-b302-37bbada56363-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa6322e8-c07b-4962-b302-37bbada56363" (UID: "aa6322e8-c07b-4962-b302-37bbada56363"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:17:27.584962 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.584932    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-kube-api-access-rdj8w" (OuterVolumeSpecName: "kube-api-access-rdj8w") pod "aa6322e8-c07b-4962-b302-37bbada56363" (UID: "aa6322e8-c07b-4962-b302-37bbada56363"). InnerVolumeSpecName "kube-api-access-rdj8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:17:27.585036 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.584966    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa6322e8-c07b-4962-b302-37bbada56363" (UID: "aa6322e8-c07b-4962-b302-37bbada56363"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:17:27.684662 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.684633    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa6322e8-c07b-4962-b302-37bbada56363-istio-podinfo\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:27.684662 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.684658    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-istio-token\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:27.684851 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.684671    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-envoy\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:27.684851 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.684684    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-workload-certs\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:27.684851 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.684696    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-credential-socket\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:27.684851 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.684706    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa6322e8-c07b-4962-b302-37bbada56363-istio-data\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:27.684851 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.684717    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdj8w\" (UniqueName: \"kubernetes.io/projected/aa6322e8-c07b-4962-b302-37bbada56363-kube-api-access-rdj8w\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:17:27.889478 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.889447    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"]
Sep 18 14:17:27.893904 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:27.893875    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2"]
Sep 18 14:17:28.294516 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:17:28.294432    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa6322e8-c07b-4962-b302-37bbada56363" path="/var/lib/kubelet/pods/aa6322e8-c07b-4962-b302-37bbada56363/volumes"
Sep 18 14:19:36.471810 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:19:36.471780    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 14:19:36.477212 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:19:36.477193    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qssl2_94bd071d-9824-45bf-b051-503e6b8d7743/ovn-acl-logging/0.log"
Sep 18 14:20:15.483017 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:15.482982    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"]
Sep 18 14:20:15.485545 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:15.483234    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7" podUID="1728b4fd-e854-4f7e-a663-81f51b57e2f5" containerName="manager" containerID="cri-o://f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c" gracePeriod=10
Sep 18 14:20:16.835941 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:16.835913    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 14:20:16.867568 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:16.867538    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1728b4fd-e854-4f7e-a663-81f51b57e2f5-extensions-socket-volume\") pod \"1728b4fd-e854-4f7e-a663-81f51b57e2f5\" (UID: \"1728b4fd-e854-4f7e-a663-81f51b57e2f5\") "
Sep 18 14:20:16.867761 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:16.867620    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr742\" (UniqueName: \"kubernetes.io/projected/1728b4fd-e854-4f7e-a663-81f51b57e2f5-kube-api-access-vr742\") pod \"1728b4fd-e854-4f7e-a663-81f51b57e2f5\" (UID: \"1728b4fd-e854-4f7e-a663-81f51b57e2f5\") "
Sep 18 14:20:16.867935 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:16.867912    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1728b4fd-e854-4f7e-a663-81f51b57e2f5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1728b4fd-e854-4f7e-a663-81f51b57e2f5" (UID: "1728b4fd-e854-4f7e-a663-81f51b57e2f5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:20:16.870167 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:16.870113    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1728b4fd-e854-4f7e-a663-81f51b57e2f5-kube-api-access-vr742" (OuterVolumeSpecName: "kube-api-access-vr742") pod "1728b4fd-e854-4f7e-a663-81f51b57e2f5" (UID: "1728b4fd-e854-4f7e-a663-81f51b57e2f5"). InnerVolumeSpecName "kube-api-access-vr742". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:20:16.969174 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:16.969076    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1728b4fd-e854-4f7e-a663-81f51b57e2f5-extensions-socket-volume\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:20:16.969174 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:16.969105    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr742\" (UniqueName: \"kubernetes.io/projected/1728b4fd-e854-4f7e-a663-81f51b57e2f5-kube-api-access-vr742\") on node \"ip-10-0-136-76.ec2.internal\" DevicePath \"\""
Sep 18 14:20:17.543826 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:17.543787    2575 generic.go:356] "Generic (PLEG): container finished" podID="1728b4fd-e854-4f7e-a663-81f51b57e2f5" containerID="f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c" exitCode=0
Sep 18 14:20:17.544035 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:17.543829    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7" event={"ID":"1728b4fd-e854-4f7e-a663-81f51b57e2f5","Type":"ContainerDied","Data":"f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c"}
Sep 18 14:20:17.544035 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:17.543871    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"
Sep 18 14:20:17.544035 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:17.543892    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7" event={"ID":"1728b4fd-e854-4f7e-a663-81f51b57e2f5","Type":"ContainerDied","Data":"f1597fb7017a3811b5a1b4ef15228b31809953f2c0c8964cec75b961644a2093"}
Sep 18 14:20:17.544035 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:17.543915    2575 scope.go:117] "RemoveContainer" containerID="f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c"
Sep 18 14:20:17.554066 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:17.554052    2575 scope.go:117] "RemoveContainer" containerID="f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c"
Sep 18 14:20:17.554387 ip-10-0-136-76 kubenswrapper[2575]: E0918 14:20:17.554364    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c\": container with ID starting with f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c not found: ID does not exist" containerID="f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c"
Sep 18 14:20:17.554454 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:17.554395    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c"} err="failed to get container status \"f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c\": rpc error: code = NotFound desc = could not find container \"f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c\": container with ID starting with f60c69fde5e3e0f5e75582a6f62206177289d10fe7da8e5bc35aa5a9eb4b697c not found: ID does not exist"
Sep 18 14:20:17.567469 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:17.567440    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"]
Sep 18 14:20:17.572532 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:17.572509    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7bjr7"]
Sep 18 14:20:18.292839 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:18.292765    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1728b4fd-e854-4f7e-a663-81f51b57e2f5" path="/var/lib/kubelet/pods/1728b4fd-e854-4f7e-a663-81f51b57e2f5/volumes"
Sep 18 14:20:36.973693 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:20:36.973660    2575 scope.go:117] "RemoveContainer" containerID="49784b70b4fa00a8571ddc2dd03e8b48bfaec38a8c09b4bee6f30e4aaeebcd32"
Sep 18 14:21:16.177384 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.177346    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"]
Sep 18 14:21:16.178020 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.177997    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy"
Sep 18 14:21:16.178102 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178023    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy"
Sep 18 14:21:16.178102 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178041    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1728b4fd-e854-4f7e-a663-81f51b57e2f5" containerName="manager"
Sep 18 14:21:16.178102 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178049    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1728b4fd-e854-4f7e-a663-81f51b57e2f5" containerName="manager"
Sep 18 14:21:16.178102 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178094    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d95f8da-d348-4373-89b6-41a8bcbfeed6" containerName="revoke-keys"
Sep 18 14:21:16.178353 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178102    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d95f8da-d348-4373-89b6-41a8bcbfeed6" containerName="revoke-keys"
Sep 18 14:21:16.178353 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178117    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98c99c70-06ea-4074-9184-914eaca4ea8b" containerName="payload-processing"
Sep 18 14:21:16.178353 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178126    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="98c99c70-06ea-4074-9184-914eaca4ea8b" containerName="payload-processing"
Sep 18 14:21:16.178353 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178239    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1728b4fd-e854-4f7e-a663-81f51b57e2f5" containerName="manager"
Sep 18 14:21:16.178353 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178252    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy"
Sep 18 14:21:16.178353 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178260    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="98c99c70-06ea-4074-9184-914eaca4ea8b" containerName="payload-processing"
Sep 18 14:21:16.178353 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178270    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d95f8da-d348-4373-89b6-41a8bcbfeed6" containerName="revoke-keys"
Sep 18 14:21:16.178353 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.178285    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy"
Sep 18 14:21:16.181605 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.181583    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"
Sep 18 14:21:16.184515 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.184490    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 14:21:16.184625 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.184556    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 14:21:16.184779 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.184764    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rfdfx\""
Sep 18 14:21:16.193327 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.193300    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"]
Sep 18 14:21:16.274434 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.274394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sqx6\" (UniqueName: \"kubernetes.io/projected/f0e50d00-d007-40d6-a549-152ef588c908-kube-api-access-7sqx6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fbvdc\" (UID: \"f0e50d00-d007-40d6-a549-152ef588c908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"
Sep 18 14:21:16.274640 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.274525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0e50d00-d007-40d6-a549-152ef588c908-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fbvdc\" (UID: \"f0e50d00-d007-40d6-a549-152ef588c908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"
Sep 18 14:21:16.375961 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.375916    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sqx6\" (UniqueName: \"kubernetes.io/projected/f0e50d00-d007-40d6-a549-152ef588c908-kube-api-access-7sqx6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fbvdc\" (UID: \"f0e50d00-d007-40d6-a549-152ef588c908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"
Sep 18 14:21:16.376202 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.376026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0e50d00-d007-40d6-a549-152ef588c908-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fbvdc\" (UID: \"f0e50d00-d007-40d6-a549-152ef588c908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"
Sep 18 14:21:16.376442 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.376422    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0e50d00-d007-40d6-a549-152ef588c908-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fbvdc\" (UID: \"f0e50d00-d007-40d6-a549-152ef588c908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"
Sep 18 14:21:16.385335 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.385308    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sqx6\" (UniqueName: \"kubernetes.io/projected/f0e50d00-d007-40d6-a549-152ef588c908-kube-api-access-7sqx6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fbvdc\" (UID: \"f0e50d00-d007-40d6-a549-152ef588c908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"
Sep 18 14:21:16.493479 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.493391    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"
Sep 18 14:21:16.775709 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.775681    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"]
Sep 18 14:21:16.778045 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:21:16.778016    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e50d00_d007_40d6_a549_152ef588c908.slice/crio-5f91ce9953966314e35507fb622521dd9a776c439ce15ca4f03980099b11a2e8 WatchSource:0}: Error finding container 5f91ce9953966314e35507fb622521dd9a776c439ce15ca4f03980099b11a2e8: Status 404 returned error can't find the container with id 5f91ce9953966314e35507fb622521dd9a776c439ce15ca4f03980099b11a2e8
Sep 18 14:21:16.887683 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.887641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc" event={"ID":"f0e50d00-d007-40d6-a549-152ef588c908","Type":"ContainerStarted","Data":"99c649e27c6123890e284573c0ba1747cdadcb8ad7a9aa52a1d21ee4dfc7ec45"}
Sep 18 14:21:16.887885 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.887736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc" event={"ID":"f0e50d00-d007-40d6-a549-152ef588c908","Type":"ContainerStarted","Data":"5f91ce9953966314e35507fb622521dd9a776c439ce15ca4f03980099b11a2e8"}
Sep 18 14:21:16.887885 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.887764    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"
Sep 18 14:21:16.910445 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:16.910390    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc" podStartSLOduration=0.910372341 podStartE2EDuration="910.372341ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:21:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:21:16.909185964 +0000 UTC m=+2202.745024679" watchObservedRunningTime="2026-09-18 14:21:16.910372341 +0000 UTC m=+2202.746211054"
Sep 18 14:21:27.895531 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:27.895493    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fbvdc"
Sep 18 14:21:37.000797 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:37.000747    2575 scope.go:117] "RemoveContainer" containerID="1d3e58b233a25ba477d3032cc5a12596becf9880234f1e558b644f0701bb8dcb"
Sep 18 14:21:37.010007 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:37.009985    2575 scope.go:117] "RemoveContainer" containerID="51932c65d18f7d19f2f7a929a73bfee84ef9e3d49fb58d6ba96d883bd71bcf4a"
Sep 18 14:21:37.018053 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:37.018036    2575 scope.go:117] "RemoveContainer" containerID="b2c2b39a735d9f223eaf473972fd5c61619b90e512d1434f9c0e5a7379b6e447"
Sep 18 14:21:37.025797 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:21:37.025772    2575 scope.go:117] "RemoveContainer" containerID="75eb7a59187c5fbd323be0064b449f0434ce84b91e42845fbf4487d7b8152da7"
Sep 18 14:22:37.073289 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:22:37.073254    2575 scope.go:117] "RemoveContainer" containerID="37f2f51c42dbe728ac2828df62247856c94d6aa933537decbcba4ec41f9e742f"
Sep 18 14:23:37.094786 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:37.094748    2575 scope.go:117] "RemoveContainer" containerID="a2c8f023d0b52b1c578c716e8e334b89f68af7041fd03c1a5a79e4c831c14100"
Sep 18 14:23:37.103412 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:37.103390    2575 scope.go:117] "RemoveContainer" containerID="fd209a12760351c54fc8b8b0b44c72fea0e475751c27505fb1d984f704fe8832"
Sep 18 14:23:37.466423 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:37.466350    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bnd97_4f700fcd-28c8-403d-9100-a67bcbea7504/manager/0.log"
Sep 18 14:23:37.582826 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:37.582795    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mv44n_94a5c9d4-17c4-4963-962d-69f53b0d3b98/manager/0.log"
Sep 18 14:23:37.945937 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:37.945894    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9kk4g_c2d1e7e5-5395-493c-ab75-459ca47fa50c/manager/0.log"
Sep 18 14:23:38.192195 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:38.192167    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-978ccd68d-g52bn_40f4a16f-43ae-4469-aa10-54ecc22e4112/copy-manifests/0.log"
Sep 18 14:23:38.198724 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:38.198651    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-978ccd68d-g52bn_40f4a16f-43ae-4469-aa10-54ecc22e4112/manager/0.log"
Sep 18 14:23:38.923343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:38.923315    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29829000-nzcvq_3b96b734-2da2-4728-884e-0d692816b397/cleanup/0.log"
Sep 18 14:23:39.037637 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:39.037602    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29829015-z2nbk_976a7d23-dbfd-45b6-8871-b24b8ffe7f7f/cleanup/0.log"
Sep 18 14:23:39.154899 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:39.154860    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tfkxz_2e2f82d0-d411-400c-a776-0c85396395d6/postgres/0.log"
Sep 18 14:23:40.410552 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:40.410510    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fbvdc_f0e50d00-d007-40d6-a549-152ef588c908/manager/0.log"
Sep 18 14:23:41.040095 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:41.040065    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw_ebb191b6-d7fa-4b59-8ec4-0182ead09892/istio-proxy/0.log"
Sep 18 14:23:41.497058 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:41.497015    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2bw5x_a0799f42-d527-43eb-9dc7-189bc2dc4893/istio-proxy/1.log"
Sep 18 14:23:41.614798 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:41.614766    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pzffv_2dae585c-fdd4-4bbd-8a04-74e1e25ea992/payload-pre-processing/0.log"
Sep 18 14:23:41.730359 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:41.730332    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-qmrgz_55bf2a5c-0c24-49ae-9b43-96af77cf2b54/payload-processing/0.log"
Sep 18 14:23:42.402758 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:42.402720    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-7mj4v_05119603-8d6a-4a1e-875c-2d2a3a180494/main/0.log"
Sep 18 14:23:42.514025 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:42.513996    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-pvbz8_483b2ee5-7ec7-4cbc-b880-11feaba5b9db/main/0.log"
Sep 18 14:23:42.734732 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:42.734651    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wbppg_357da5fd-6df3-49e5-a979-0e211120f868/main/0.log"
Sep 18 14:23:51.853651 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:51.853622    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4jndn_d1b6473d-cfa1-4894-a473-6d83bb810cab/global-pull-secret-syncer/0.log"
Sep 18 14:23:52.023210 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:52.023177    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8zn42_9396c3f0-550f-44f2-b331-dd4cfab9db06/konnectivity-agent/0.log"
Sep 18 14:23:52.085744 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:52.085706    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-76.ec2.internal_9485666a2553da508936cccb36d7017e/haproxy/0.log"
Sep 18 14:23:57.114714 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:57.114676    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fbvdc_f0e50d00-d007-40d6-a549-152ef588c908/manager/0.log"
Sep 18 14:23:58.525803 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.525774    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c94fbf-5228-4cda-8868-67a115102bb6/alertmanager/0.log"
Sep 18 14:23:58.551263 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.551239    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c94fbf-5228-4cda-8868-67a115102bb6/config-reloader/0.log"
Sep 18 14:23:58.573773 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.573745    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c94fbf-5228-4cda-8868-67a115102bb6/kube-rbac-proxy-web/0.log"
Sep 18 14:23:58.602566 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.602540    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c94fbf-5228-4cda-8868-67a115102bb6/kube-rbac-proxy/0.log"
Sep 18 14:23:58.623322 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.623288    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c94fbf-5228-4cda-8868-67a115102bb6/kube-rbac-proxy-metric/0.log"
Sep 18 14:23:58.647034 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.647010    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c94fbf-5228-4cda-8868-67a115102bb6/prom-label-proxy/0.log"
Sep 18 14:23:58.683690 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.683643    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c94fbf-5228-4cda-8868-67a115102bb6/init-config-reloader/0.log"
Sep 18 14:23:58.761339 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.761254    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-b9wsj_84fe0d15-4629-45c2-985b-dc6b34898876/kube-state-metrics/0.log"
Sep 18 14:23:58.781614 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.781585    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-b9wsj_84fe0d15-4629-45c2-985b-dc6b34898876/kube-rbac-proxy-main/0.log"
Sep 18 14:23:58.806519 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.806494    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-b9wsj_84fe0d15-4629-45c2-985b-dc6b34898876/kube-rbac-proxy-self/0.log"
Sep 18 14:23:58.834237 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.834211    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5dfd679d6-dl2r8_b7adb34c-92db-4b15-b1c3-2e1e5a544af9/metrics-server/0.log"
Sep 18 14:23:58.858947 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.858917    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-pmdsc_9e67a49b-b4d2-4850-9aa0-de7870b187b4/monitoring-plugin/0.log"
Sep 18 14:23:58.989570 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:58.989530    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pjvd2_6d9456b5-d539-4c30-ae70-68a116eefa1f/node-exporter/0.log"
Sep 18 14:23:59.013748 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.013655    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pjvd2_6d9456b5-d539-4c30-ae70-68a116eefa1f/kube-rbac-proxy/0.log"
Sep 18 14:23:59.037449 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.037423    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pjvd2_6d9456b5-d539-4c30-ae70-68a116eefa1f/init-textfile/0.log"
Sep 18 14:23:59.147634 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.147605    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-5b8xc_f5b1b1c6-1179-4b72-a9ac-02f8a52a3710/kube-rbac-proxy-main/0.log"
Sep 18 14:23:59.169198 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.169172    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-5b8xc_f5b1b1c6-1179-4b72-a9ac-02f8a52a3710/kube-rbac-proxy-self/0.log"
Sep 18 14:23:59.191802 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.191550    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-5b8xc_f5b1b1c6-1179-4b72-a9ac-02f8a52a3710/openshift-state-metrics/0.log"
Sep 18 14:23:59.234580 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.234538    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92618e6c-2e9a-495d-aa12-c42838b7ed15/prometheus/0.log"
Sep 18 14:23:59.264693 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.264599    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92618e6c-2e9a-495d-aa12-c42838b7ed15/config-reloader/0.log"
Sep 18 14:23:59.304384 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.304359    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92618e6c-2e9a-495d-aa12-c42838b7ed15/thanos-sidecar/0.log"
Sep 18 14:23:59.336785 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.336735    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92618e6c-2e9a-495d-aa12-c42838b7ed15/kube-rbac-proxy-web/0.log"
Sep 18 14:23:59.386057 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.386032    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92618e6c-2e9a-495d-aa12-c42838b7ed15/kube-rbac-proxy/0.log"
Sep 18 14:23:59.418838 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.418813    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92618e6c-2e9a-495d-aa12-c42838b7ed15/kube-rbac-proxy-thanos/0.log"
Sep 18 14:23:59.450107 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.450081    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92618e6c-2e9a-495d-aa12-c42838b7ed15/init-config-reloader/0.log"
Sep 18 14:23:59.496447 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.496421    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-scdbf_3cb59ab9-f6ee-4478-8542-f26308473d65/prometheus-operator/0.log"
Sep 18 14:23:59.518596 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.518532    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-scdbf_3cb59ab9-f6ee-4478-8542-f26308473d65/kube-rbac-proxy/0.log"
Sep 18 14:23:59.554075 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.554047    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-vsksr_568858ef-c897-458b-88da-2c932b5f0aa2/prometheus-operator-admission-webhook/0.log"
Sep 18 14:23:59.585390 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.585365    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c9556f9bc-tltk6_45b8df18-47ac-48d3-9761-30b717efa8c8/telemeter-client/0.log"
Sep 18 14:23:59.615081 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.615056    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c9556f9bc-tltk6_45b8df18-47ac-48d3-9761-30b717efa8c8/reload/0.log"
Sep 18 14:23:59.639932 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.639907    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c9556f9bc-tltk6_45b8df18-47ac-48d3-9761-30b717efa8c8/kube-rbac-proxy/0.log"
Sep 18 14:23:59.673016 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.672990    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645d58d866-6jw8s_07876426-7422-4f9e-bd6d-fc2a967580cb/thanos-query/0.log"
Sep 18 14:23:59.697447 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.697421    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645d58d866-6jw8s_07876426-7422-4f9e-bd6d-fc2a967580cb/kube-rbac-proxy-web/0.log"
Sep 18 14:23:59.724763 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.724714    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645d58d866-6jw8s_07876426-7422-4f9e-bd6d-fc2a967580cb/kube-rbac-proxy/0.log"
Sep 18 14:23:59.754485 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.754459    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645d58d866-6jw8s_07876426-7422-4f9e-bd6d-fc2a967580cb/prom-label-proxy/0.log"
Sep 18 14:23:59.784455 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.784377    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645d58d866-6jw8s_07876426-7422-4f9e-bd6d-fc2a967580cb/kube-rbac-proxy-rules/0.log"
Sep 18 14:23:59.810963 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:23:59.810936    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645d58d866-6jw8s_07876426-7422-4f9e-bd6d-fc2a967580cb/kube-rbac-proxy-metrics/0.log"
Sep 18 14:24:01.824873 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.824833    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"]
Sep 18 14:24:01.825444 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.825426    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy"
Sep 18 14:24:01.825490 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.825446    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa6322e8-c07b-4962-b302-37bbada56363" containerName="istio-proxy"
Sep 18 14:24:01.830425 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.830404    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:01.833058 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.833038    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mptg\"/\"kube-root-ca.crt\""
Sep 18 14:24:01.833199 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.833056    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mptg\"/\"openshift-service-ca.crt\""
Sep 18 14:24:01.834282 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.834240    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8mptg\"/\"default-dockercfg-9mm44\""
Sep 18 14:24:01.837955 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.837746    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"]
Sep 18 14:24:01.951387 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.951349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c5cf\" (UniqueName: \"kubernetes.io/projected/30ddc08c-1202-49a8-b042-8726b79e01a2-kube-api-access-6c5cf\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:01.951571 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.951427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-proc\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:01.951571 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.951456    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-lib-modules\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:01.951571 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.951483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-sys\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:01.951571 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:01.951519    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-podres\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.053069 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.053030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-sys\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.053069 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.053071    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-podres\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.053332 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.053188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c5cf\" (UniqueName: \"kubernetes.io/projected/30ddc08c-1202-49a8-b042-8726b79e01a2-kube-api-access-6c5cf\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.053332 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.053215    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-sys\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.053332 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.053242    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-proc\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.053332 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.053280    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-podres\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.053332 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.053290    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-proc\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.053332 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.053302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-lib-modules\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.053597 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.053478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30ddc08c-1202-49a8-b042-8726b79e01a2-lib-modules\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.061975 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.061945    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c5cf\" (UniqueName: \"kubernetes.io/projected/30ddc08c-1202-49a8-b042-8726b79e01a2-kube-api-access-6c5cf\") pod \"perf-node-gather-daemonset-58t6t\" (UID: \"30ddc08c-1202-49a8-b042-8726b79e01a2\") " pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.142270 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.142166    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.329795 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.329763    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d6bcf46bc-h6xsb_ce9ded1d-d195-45f8-a886-45ac505446e0/console/0.log"
Sep 18 14:24:02.414821 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.414792    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"]
Sep 18 14:24:02.416989 ip-10-0-136-76 kubenswrapper[2575]: W0918 14:24:02.416960    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod30ddc08c_1202_49a8_b042_8726b79e01a2.slice/crio-e022b49607b75e5ef389f84240ffb8bbe46d3493058d4b7b4c983ac78301ff9a WatchSource:0}: Error finding container e022b49607b75e5ef389f84240ffb8bbe46d3493058d4b7b4c983ac78301ff9a: Status 404 returned error can't find the container with id e022b49607b75e5ef389f84240ffb8bbe46d3493058d4b7b4c983ac78301ff9a
Sep 18 14:24:02.813225 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.813182    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t" event={"ID":"30ddc08c-1202-49a8-b042-8726b79e01a2","Type":"ContainerStarted","Data":"608c8d1fd0224cade90dabc25ccdb59a7a7b2948f3b1628cb450830bf98955bd"}
Sep 18 14:24:02.813425 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.813340    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:02.813425 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.813381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t" event={"ID":"30ddc08c-1202-49a8-b042-8726b79e01a2","Type":"ContainerStarted","Data":"e022b49607b75e5ef389f84240ffb8bbe46d3493058d4b7b4c983ac78301ff9a"}
Sep 18 14:24:02.832690 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:02.832622    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t" podStartSLOduration=1.832606127 podStartE2EDuration="1.832606127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:24:02.830571565 +0000 UTC m=+2368.666410275" watchObservedRunningTime="2026-09-18 14:24:02.832606127 +0000 UTC m=+2368.668444839"
Sep 18 14:24:04.305514 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:04.305483    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s2ntp_9c8053d9-4da3-43dd-9e80-291986e34a82/dns/0.log"
Sep 18 14:24:04.327387 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:04.327358    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s2ntp_9c8053d9-4da3-43dd-9e80-291986e34a82/kube-rbac-proxy/0.log"
Sep 18 14:24:04.352674 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:04.352649    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cxdkt_fd112042-77f9-4d45-a8b6-6e83b91c2bb3/dns-node-resolver/0.log"
Sep 18 14:24:05.010343 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:05.010310    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bkvl8_fc9e1723-2aa9-424d-a2e1-33af09eb8e32/node-ca/0.log"
Sep 18 14:24:05.981262 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:05.981217    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw_ebb191b6-d7fa-4b59-8ec4-0182ead09892/istio-proxy/0.log"
Sep 18 14:24:06.479502 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:06.479441    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2bw5x_a0799f42-d527-43eb-9dc7-189bc2dc4893/istio-proxy/0.log"
Sep 18 14:24:06.482808 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:06.482782    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2bw5x_a0799f42-d527-43eb-9dc7-189bc2dc4893/istio-proxy/1.log"
Sep 18 14:24:06.518640 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:06.518604    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pzffv_2dae585c-fdd4-4bbd-8a04-74e1e25ea992/payload-pre-processing/0.log"
Sep 18 14:24:06.551555 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:06.551519    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-qmrgz_55bf2a5c-0c24-49ae-9b43-96af77cf2b54/payload-processing/0.log"
Sep 18 14:24:07.530846 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:07.530815    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x4p9j_0f4deaf7-ae6b-4714-991c-270303038728/serve-healthcheck-canary/0.log"
Sep 18 14:24:08.045097 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:08.045068    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4b2sz_38ceb72e-d2ba-44fc-9ab4-f18e59951595/kube-rbac-proxy/0.log"
Sep 18 14:24:08.068718 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:08.068692    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4b2sz_38ceb72e-d2ba-44fc-9ab4-f18e59951595/exporter/0.log"
Sep 18 14:24:08.090012 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:08.089977    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4b2sz_38ceb72e-d2ba-44fc-9ab4-f18e59951595/extractor/0.log"
Sep 18 14:24:08.829420 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:08.829392    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8mptg/perf-node-gather-daemonset-58t6t"
Sep 18 14:24:10.399857 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:10.399821    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bnd97_4f700fcd-28c8-403d-9100-a67bcbea7504/manager/0.log"
Sep 18 14:24:10.675645 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:10.675564    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mv44n_94a5c9d4-17c4-4963-962d-69f53b0d3b98/manager/0.log"
Sep 18 14:24:10.846244 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:10.846217    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9kk4g_c2d1e7e5-5395-493c-ab75-459ca47fa50c/manager/0.log"
Sep 18 14:24:10.933308 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:10.933232    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-978ccd68d-g52bn_40f4a16f-43ae-4469-aa10-54ecc22e4112/manager/0.log"
Sep 18 14:24:10.960398 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:10.960369    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-978ccd68d-g52bn_40f4a16f-43ae-4469-aa10-54ecc22e4112/copy-manifests/0.log"
Sep 18 14:24:12.431008 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:12.430974    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6cdc5b77c9-7b4w2_adeb8047-14f1-44d3-8419-f5be177efc66/manager/0.log"
Sep 18 14:24:12.772744 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:12.772646    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw_ebb191b6-d7fa-4b59-8ec4-0182ead09892/istio-proxy/0.log"
Sep 18 14:24:13.237731 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:13.237700    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2bw5x_a0799f42-d527-43eb-9dc7-189bc2dc4893/istio-proxy/0.log"
Sep 18 14:24:13.241103 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:13.241083    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2bw5x_a0799f42-d527-43eb-9dc7-189bc2dc4893/istio-proxy/1.log"
Sep 18 14:24:13.263473 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:13.263454    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pzffv_2dae585c-fdd4-4bbd-8a04-74e1e25ea992/payload-pre-processing/0.log"
Sep 18 14:24:13.291034 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:13.290962    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-qmrgz_55bf2a5c-0c24-49ae-9b43-96af77cf2b54/payload-processing/0.log"
Sep 18 14:24:14.950296 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:14.950266    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw_ebb191b6-d7fa-4b59-8ec4-0182ead09892/istio-proxy/0.log"
Sep 18 14:24:15.439267 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:15.439237    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2bw5x_a0799f42-d527-43eb-9dc7-189bc2dc4893/istio-proxy/0.log"
Sep 18 14:24:15.444462 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:15.444407    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2bw5x_a0799f42-d527-43eb-9dc7-189bc2dc4893/istio-proxy/1.log"
Sep 18 14:24:15.473839 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:15.473808    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pzffv_2dae585c-fdd4-4bbd-8a04-74e1e25ea992/payload-pre-processing/0.log"
Sep 18 14:24:15.498991 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:15.498959    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-qmrgz_55bf2a5c-0c24-49ae-9b43-96af77cf2b54/payload-processing/0.log"
Sep 18 14:24:19.331297 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:19.331256    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-94xfb_fcd2b632-1411-45f7-b108-13d885d68910/kube-multus/0.log"
Sep 18 14:24:19.357448 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:19.357418    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcdls_82adfcd0-c5e4-4bfd-b693-04fa2b6b4929/kube-multus-additional-cni-plugins/0.log"
Sep 18 14:24:19.382945 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:19.382918    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcdls_82adfcd0-c5e4-4bfd-b693-04fa2b6b4929/egress-router-binary-copy/0.log"
Sep 18 14:24:19.407495 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:19.407469    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcdls_82adfcd0-c5e4-4bfd-b693-04fa2b6b4929/cni-plugins/0.log"
Sep 18 14:24:19.430484 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:19.430459    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcdls_82adfcd0-c5e4-4bfd-b693-04fa2b6b4929/bond-cni-plugin/0.log"
Sep 18 14:24:19.451422 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:19.451394    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcdls_82adfcd0-c5e4-4bfd-b693-04fa2b6b4929/routeoverride-cni/0.log"
Sep 18 14:24:19.472112 ip-10-0-136-76 kubenswrapper[2575]: I0918 14:24:19.472085    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcdls_82adfcd0-c5e4-4bfd-b693-04fa2b6b4929/whereabouts-cni-bincopy/0.log"